2024-02-17T00:25:09.584 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T00:25:09.584 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --verbose --archive /home/teuthworker/archive/vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi/7563947 --owner scheduled_vshankar@teuthology --name vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi/7563947/orig.config.yaml 2024-02-17T00:25:09.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T00:25:09.701 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi/7563947 branch: wip-63945-ranks description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7563947' kernel: client: sha1: distro flavor: default kdb: true sha1: 8d59ab0bd93c806231018a6729893bf309624262 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-63945-ranks ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2d9ecbfd71ad813d2904991462c430e98ff63b84 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2d9ecbfd71ad813d2904991462c430e98ff63b84 kclient: syntax: v1 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63945-ranks sha1: 2d9ecbfd71ad813d2904991462c430e98ff63b84 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2522 sha1: 2d9ecbfd71ad813d2904991462c430e98ff63b84 sleep_before_teardown: 0 subset: 740/1024 suite: fs:functional suite_branch: wip-63945-ranks suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2d9ecbfd71ad813d2904991462c430e98ff63b84/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2d9ecbfd71ad813d2904991462c430e98ff63b84 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuP5jeEtz5E/zG0lhvvEZhi8dk4QL7Ut3age08Ni0SgoHH07jsRxbeSNiG6zflT6c2LewpRVEuMl//yhIfSjes= smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMl7lwzoGwkJScYuyNEXnhTAEauZ5DA4IMzbw3huURzX4L3TR+sqOWK1tvqgjj0RORaWFVez5iWMmnmfALo8s2I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-16_23:22:03 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-17T00:25:09.701 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2d9ecbfd71ad813d2904991462c430e98ff63b84/qa; will attempt to use it 2024-02-17T00:25:09.702 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2d9ecbfd71ad813d2904991462c430e98ff63b84/qa/tasks 2024-02-17T00:25:09.702 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-17T00:25:09.704 INFO:teuthology.task.internal:Checking packages... 2024-02-17T00:25:09.726 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2d9ecbfd71ad813d2904991462c430e98ff63b84' 2024-02-17T00:25:09.726 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-17T00:25:09.726 INFO:teuthology.packaging:ref: None 2024-02-17T00:25:09.726 INFO:teuthology.packaging:tag: None 2024-02-17T00:25:09.726 INFO:teuthology.packaging:branch: wip-63945-ranks 2024-02-17T00:25:09.726 INFO:teuthology.packaging:sha1: 2d9ecbfd71ad813d2904991462c430e98ff63b84 2024-02-17T00:25:09.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-63945-ranks 2024-02-17T00:25:09.949 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1507.g2d9ecbfd 2024-02-17T00:25:09.950 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-17T00:25:09.957 INFO:teuthology.task.internal:no buildpackages task found 2024-02-17T00:25:09.957 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-17T00:25:09.978 INFO:teuthology.task.internal:Saving configuration 2024-02-17T00:25:09.992 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-17T00:25:09.998 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T00:25:10.021 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi/7563947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 00:19:30.515286', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuP5jeEtz5E/zG0lhvvEZhi8dk4QL7Ut3age08Ni0SgoHH07jsRxbeSNiG6zflT6c2LewpRVEuMl//yhIfSjes='} 2024-02-17T00:25:10.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi/7563947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 00:19:30.513532', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMl7lwzoGwkJScYuyNEXnhTAEauZ5DA4IMzbw3huURzX4L3TR+sqOWK1tvqgjj0RORaWFVez5iWMmnmfALo8s2I='} 2024-02-17T00:25:10.042 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-17T00:25:10.048 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-02-17T00:25:10.048 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-02-17T00:25:10.048 INFO:teuthology.run_tasks:Running task console_log... 2024-02-17T00:25:10.115 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe12f1b3160>, signals=[15]) 2024-02-17T00:25:10.116 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-17T00:25:10.121 INFO:teuthology.task.internal:Opening connections... 2024-02-17T00:25:10.121 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:25:10.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:25:10.227 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:25:10.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:25:10.328 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-17T00:25:10.334 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-02-17T00:25:10.351 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-02-17T00:25:10.352 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-02-17T00:25:10.408 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T00:25:10.409 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-02-17T00:25:10.409 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T00:25:10.409 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T00:25:10.409 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T00:25:10.409 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-02-17T00:25:10.428 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-02-17T00:25:10.446 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-02-17T00:25:10.446 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-02-17T00:25:10.503 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-02-17T00:25:10.516 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T00:25:10.517 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T00:25:10.517 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T00:25:10.517 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-02-17T00:25:10.536 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-17T00:25:10.545 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-17T00:25:10.551 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-17T00:25:10.551 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-02-17T00:25:10.553 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-02-17T00:25:10.569 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-17T00:25:10.575 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-17T00:25:10.575 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-02-17T00:25:10.610 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-02-17T00:25:10.632 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-17T00:25:10.684 INFO:teuthology.run_tasks:Running task kernel... 2024-02-17T00:25:10.699 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'} 2024-02-17T00:25:10.699 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-02-17T00:25:10.699 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-02-17T00:25:10.699 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T00:25:10.699 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T00:25:10.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:25:10.716 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-02-17T00:25:10.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:25:10.717 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-02-17T00:25:10.774 INFO:teuthology.orchestra.run.smithi032.stdout:5.14.0-361.el9.x86_64 2024-02-17T00:25:10.774 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.14.0-361.el9.x86_64 2024-02-17T00:25:10.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum install -y kernel 2024-02-17T00:25:10.775 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-361.el9.x86_64 2024-02-17T00:25:10.775 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-361.el9.x86_64 2024-02-17T00:25:10.775 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-02-17T00:25:12.867 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-02-17T00:25:12.926 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-02-17T00:25:14.350 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2024-02-17T00:25:14.360 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2024-02-17T00:25:15.524 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.0 MB 00:00 2024-02-17T00:25:15.736 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.0 MB 00:01 2024-02-17T00:25:18.117 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-02-17T00:25:19.885 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:03 2024-02-17T00:25:22.409 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-02-17T00:25:24.160 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2024-02-17T00:25:24.253 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.1 MB 00:00 2024-02-17T00:25:25.937 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-17T00:25:28.564 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 20 MB 00:04 2024-02-17T00:25:30.624 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 20 MB 00:04 2024-02-17T00:25:33.610 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-02-17T00:25:35.763 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-02-17T00:25:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-17T00:25:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-17T00:25:36.104 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-02-17T00:25:36.116 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-02-17T00:25:36.116 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-02-17T00:25:36.116 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-02-17T00:25:36.116 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-02-17T00:25:36.117 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:25:36.118 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 100 M 2024-02-17T00:25:36.118 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 123 M 2024-02-17T00:25:36.118 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-02-17T00:25:36.578 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 13 MB/s | 6.1 MB 00:00 2024-02-17T00:25:37.112 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-02-17T00:25:37.745 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 24 MB/s | 39 MB 00:01 2024-02-17T00:25:38.112 INFO:teuthology.orchestra.run.smithi032.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-17T00:25:38.112 INFO:teuthology.orchestra.run.smithi032.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-17T00:25:38.210 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-17T00:25:38.218 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout:Install 4 Packages 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 100 M 2024-02-17T00:25:38.219 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 123 M 2024-02-17T00:25:38.220 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-02-17T00:25:38.254 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 20 MB/s | 33 MB 00:01 2024-02-17T00:25:38.257 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-02-17T00:25:38.257 INFO:teuthology.orchestra.run.smithi039.stdout:Total 47 MB/s | 100 MB 00:02 2024-02-17T00:25:38.257 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-02-17T00:25:38.706 INFO:teuthology.orchestra.run.smithi032.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 12 MB/s | 6.1 MB 00:00 2024-02-17T00:25:38.721 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-02-17T00:25:38.721 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-02-17T00:25:39.115 INFO:teuthology.orchestra.run.smithi032.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-02-17T00:25:39.715 INFO:teuthology.orchestra.run.smithi032.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 26 MB/s | 39 MB 00:01 2024-02-17T00:25:39.753 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-02-17T00:25:39.753 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-02-17T00:25:40.207 INFO:teuthology.orchestra.run.smithi032.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 22 MB/s | 33 MB 00:01 2024-02-17T00:25:40.210 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-02-17T00:25:40.210 INFO:teuthology.orchestra.run.smithi032.stdout:Total 50 MB/s | 100 MB 00:01 2024-02-17T00:25:40.211 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-02-17T00:25:40.636 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-02-17T00:25:40.637 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-02-17T00:25:41.693 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-02-17T00:25:41.693 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-02-17T00:25:42.299 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-02-17T00:25:42.981 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-17T00:25:43.112 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T00:25:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-02-17T00:25:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-17T00:25:45.042 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T00:25:46.023 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T00:25:46.207 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T00:25:47.965 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T00:25:48.156 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T00:25:51.275 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T00:25:51.379 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:25:53.256 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T00:25:53.361 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:25:56.472 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:25:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:27.492 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:27.493 INFO:teuthology.orchestra.run.smithi039.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-17T00:26:27.493 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:26:27.573 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:28.058 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:28.058 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-17T00:26:28.058 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T00:26:28.058 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:26:28.484 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-02-17T00:26:28.987 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T00:26:29.036 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:29.036 INFO:teuthology.orchestra.run.smithi032.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-17T00:26:29.037 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:26:29.109 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:29.122 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T00:26:29.123 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T00:26:29.123 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-17T00:26:29.123 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T00:26:29.123 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T00:26:29.123 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-02-17T00:26:29.123 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T00:26:29.124 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T00:26:29.236 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T00:26:29.236 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T00:26:29.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 68.el9 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8264254 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-02-17T00:26:29.283 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T00:26:29.284 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-02-17T00:26:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:26:29.285 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T00:26:29.285 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T00:26:29.286 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-421.el9.x86_64 2024-02-17T00:26:29.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T00:26:29.562 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:29.562 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-17T00:26:29.562 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T00:26:29.562 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T00:26:29.883 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-02-17T00:26:29.993 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:26:29.994 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-02-17T00:26:30.496 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T00:26:30.624 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T00:26:30.624 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T00:26:30.624 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-17T00:26:30.624 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T00:26:30.624 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T00:26:30.624 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-02-17T00:26:30.624 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T00:26:30.624 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T00:26:30.736 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T00:26:30.737 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T00:26:30.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -qi grub2-tools 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Name : grub2-tools 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Epoch : 1 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Version : 2.06 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Release : 68.el9 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: x86_64 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Group : Unspecified 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Size : 8264254 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:License : GPLv3+ 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-17T00:26:30.775 INFO:teuthology.orchestra.run.smithi032.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:Packager : builder@centos.org 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:Vendor : CentOS 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:Summary : Support tools for GRUB. 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:Description : 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:hardware devices. 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:26:30.776 INFO:teuthology.orchestra.run.smithi032.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T00:26:30.777 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T00:26:30.777 INFO:teuthology.task.kernel:Updating grub on smithi032 to boot 5.14.0-421.el9.x86_64 2024-02-17T00:26:30.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T00:26:31.295 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-17T00:26:31.341 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-02-17T00:26:31.343 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-02-17T00:26:31.358 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.ih5CXb9zXn 2024-02-17T00:26:31.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ih5CXb9zXn 2024-02-17T00:26:31.398 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-02-17T00:26:31.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.ih5CXb9zXn 2024-02-17T00:26:31.585 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.ih5CXb9zXn is 6KB 2024-02-17T00:26:31.634 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.ih5CXb9zXn 2024-02-17T00:26:31.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T00:26:31.726 INFO:teuthology.orchestra.run.smithi039.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-17T00:26:31.726 INFO:teuthology.orchestra.run.smithi039.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-17T00:26:31.726 INFO:teuthology.orchestra.run.smithi039.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-17T00:26:31.726 INFO:teuthology.orchestra.run.smithi039.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-17T00:26:31.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-17T00:26:31.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-02-17T00:26:32.850 INFO:teuthology.orchestra.run.smithi032.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-17T00:26:32.871 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-02-17T00:26:32.873 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-02-17T00:26:32.889 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.O0bP21zrbP 2024-02-17T00:26:32.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O0bP21zrbP 2024-02-17T00:26:32.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.O0bP21zrbP 2024-02-17T00:26:33.106 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.O0bP21zrbP is 6KB 2024-02-17T00:26:33.127 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.O0bP21zrbP 2024-02-17T00:26:33.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T00:26:33.217 INFO:teuthology.orchestra.run.smithi032.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-17T00:26:33.217 INFO:teuthology.orchestra.run.smithi032.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-17T00:26:33.218 INFO:teuthology.orchestra.run.smithi032.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-17T00:26:33.218 INFO:teuthology.orchestra.run.smithi032.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-17T00:26:33.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-17T00:26:33.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-02-17T00:27:01.927 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-02-17T00:27:01.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:27:01.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:27:03.378 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-17T00:27:03.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-17T00:27:03.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:27:20.252 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-17T00:27:21.788 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-17T00:27:29.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:27:29.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:27:30.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-17T00:27:30.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:27:32.316 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-17T00:27:44.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:27:44.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:27:47.388 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-17T00:27:49.180 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-17T00:28:01.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-17T00:28:01.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:28:01.541 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-02-17T00:28:01.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-17T00:28:01.953 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-421.el9.x86_64"... 2024-02-17T00:28:01.953 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-02-17T00:28:01.967 INFO:teuthology.orchestra.run.smithi032.stdout:5.14.0-421.el9.x86_64 2024-02-17T00:28:01.967 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-17T00:28:01.967 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T00:28:01.967 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T00:28:02.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:28:02.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:28:02.968 DEBUG:teuthology.parallel:result is None 2024-02-17T00:29:02.392 DEBUG:teuthology.orchestra.remote:timed out 2024-02-17T00:29:20.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:29:20.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:29:20.739 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-02-17T00:29:21.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:29:21.113 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-421.el9.x86_64"... 2024-02-17T00:29:21.113 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-02-17T00:29:21.128 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-421.el9.x86_64 2024-02-17T00:29:21.128 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-17T00:29:21.128 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T00:29:21.128 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T00:29:22.129 DEBUG:teuthology.parallel:result is None 2024-02-17T00:29:22.130 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-17T00:29:22.140 INFO:teuthology.task.internal:Creating test directory... 2024-02-17T00:29:22.140 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T00:29:22.143 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T00:29:22.160 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-17T00:29:22.166 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-17T00:29:22.173 INFO:teuthology.task.internal:Creating archive directory... 2024-02-17T00:29:22.173 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T00:29:22.201 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T00:29:22.230 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-17T00:29:22.237 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-17T00:29:22.237 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T00:29:22.267 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T00:29:22.363 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T00:29:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T00:29:22.403 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T00:29:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T00:29:22.420 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-17T00:29:22.428 INFO:teuthology.task.internal:Configuring sudo... 2024-02-17T00:29:22.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T00:29:22.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T00:29:22.460 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-17T00:29:22.469 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-17T00:29:22.469 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T00:29:22.501 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T00:29:22.516 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T00:29:22.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T00:29:22.656 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T00:29:22.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T00:29:22.780 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:29:22.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T00:29:22.848 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T00:29:22.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T00:29:22.948 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T00:29:23.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T00:29:23.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:29:23.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T00:29:23.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-02-17T00:29:23.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-02-17T00:29:23.189 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T00:29:23.238 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T00:29:23.570 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-17T00:29:23.579 INFO:teuthology.task.internal:Starting timer... 2024-02-17T00:29:23.579 INFO:teuthology.run_tasks:Running task pcp... 2024-02-17T00:29:23.590 INFO:teuthology.run_tasks:Running task selinux... 2024-02-17T00:29:23.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo service auditd rotate 2024-02-17T00:29:23.666 INFO:teuthology.orchestra.run.smithi032.stdout:Rotating logs: 2024-02-17T00:29:23.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-02-17T00:29:23.727 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-02-17T00:29:23.729 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-17T00:29:23.729 DEBUG:teuthology.orchestra.run.smithi032:> /usr/sbin/getenforce 2024-02-17T00:29:23.755 INFO:teuthology.orchestra.run.smithi032.stdout:Permissive 2024-02-17T00:29:23.756 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-02-17T00:29:23.778 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-02-17T00:29:23.778 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi032.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi039.front.sepia.ceph.com': 'permissive'} 2024-02-17T00:29:23.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T00:29:23.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:29:23.825 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T00:29:23.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:29:23.853 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-17T00:29:23.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo /usr/sbin/setenforce permissive 2024-02-17T00:29:23.899 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-02-17T00:29:23.930 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-17T00:29:23.940 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-17T00:29:23.945 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-17T00:29:24.105 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-17T00:29:24.120 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-17T00:29:24.121 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi039.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-17T00:33:37.751 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi039.front.sepia.ceph.com')] 2024-02-17T00:33:37.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-17T00:33:37.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:33:37.846 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-02-17T00:33:37.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-17T00:33:37.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:33:37.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T00:33:38.009 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-02-17T00:33:38.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-17T00:33:38.087 INFO:teuthology.run_tasks:Running task clock... 2024-02-17T00:33:38.099 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-17T00:33:38.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T00:33:38.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T00:33:38.102 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T00:33:38.102 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T00:33:38.131 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T00:33:38.148 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T00:33:38.158 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T00:33:38.175 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T00:33:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: ntpd: command not found 2024-02-17T00:33:38.191 INFO:teuthology.orchestra.run.smithi032.stdout:506 Cannot talk to daemon 2024-02-17T00:33:38.204 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-02-17T00:33:38.208 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T00:33:38.217 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-02-17T00:33:38.224 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T00:33:38.234 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T00:33:38.250 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T00:33:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: ntpq: command not found 2024-02-17T00:33:38.276 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T00:33:38.276 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2024-02-17T00:33:38.276 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.276 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.276 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.276 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.301 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-02-17T00:33:38.304 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T00:33:38.304 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-02-17T00:33:38.304 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.304 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.304 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.304 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T00:33:38.305 INFO:teuthology.run_tasks:Running task install... 2024-02-17T00:33:38.313 DEBUG:teuthology.task.install:project ceph 2024-02-17T00:33:38.313 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84'}} 2024-02-17T00:33:38.313 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84'} 2024-02-17T00:33:38.313 INFO:teuthology.task.install:Using flavor: default 2024-02-17T00:33:38.319 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-17T00:33:38.319 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-17T00:33:38.320 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84', 'tag': None, 'wait_for_package': False} 2024-02-17T00:33:38.320 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2d9ecbfd71ad813d2904991462c430e98ff63b84 2024-02-17T00:33:38.322 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84', 'tag': None, 'wait_for_package': False} 2024-02-17T00:33:38.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2d9ecbfd71ad813d2904991462c430e98ff63b84 2024-02-17T00:33:38.469 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/ 2024-02-17T00:33:38.469 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1507.g2d9ecbfd 2024-02-17T00:33:38.482 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/ 2024-02-17T00:33:38.482 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1507.g2d9ecbfd 2024-02-17T00:33:38.654 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-17T00:33:38.654 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:33:38.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-17T00:33:38.660 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63945-ranks/2d9ecbfd71ad813d2904991462c430e98ff63b84/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-17T00:33:38.660 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:33:38.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-17T00:33:38.683 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-17T00:33:38.683 DEBUG:teuthology.orchestra.run.smithi032:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2d9ecbfd71ad813d2904991462c430e98ff63b84/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-17T00:33:38.689 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-17T00:33:38.689 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2d9ecbfd71ad813d2904991462c430e98ff63b84/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-17T00:33:38.752 DEBUG:teuthology.orchestra.run.smithi032:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-17T00:33:38.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-17T00:33:38.832 DEBUG:teuthology.orchestra.run.smithi032:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-17T00:33:38.836 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-17T00:33:38.898 INFO:teuthology.orchestra.run.smithi032.stdout:check_obsoletes = 1 2024-02-17T00:33:38.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum clean all 2024-02-17T00:33:38.903 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-02-17T00:33:38.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-02-17T00:33:39.145 INFO:teuthology.orchestra.run.smithi032.stdout:74 files removed 2024-02-17T00:33:39.146 INFO:teuthology.orchestra.run.smithi039.stdout:74 files removed 2024-02-17T00:33:39.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-17T00:33:39.173 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-17T00:33:39.803 INFO:teuthology.orchestra.run.smithi032.stdout:ceph packages for x86_64 267 kB/s | 82 kB 00:00 2024-02-17T00:33:40.004 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 161 kB/s | 82 kB 00:00 2024-02-17T00:33:40.304 INFO:teuthology.orchestra.run.smithi032.stdout:ceph noarch packages 22 kB/s | 10 kB 00:00 2024-02-17T00:33:40.463 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-02-17T00:33:40.729 INFO:teuthology.orchestra.run.smithi032.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-02-17T00:33:40.897 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-02-17T00:33:41.366 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-02-17T00:33:41.390 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-17T00:33:42.958 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-02-17T00:33:43.009 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2024-02-17T00:33:44.774 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-02-17T00:33:46.573 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.0 MB 00:03 2024-02-17T00:33:46.609 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-02-17T00:33:48.482 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-02-17T00:33:50.977 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.1 MB 00:00 2024-02-17T00:33:53.278 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2024-02-17T00:33:56.087 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 20 MB 00:02 2024-02-17T00:34:01.079 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-02-17T00:34:03.785 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T00:34:03.785 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T00:34:03.800 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-17T00:34:03.801 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-17T00:34:03.802 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-17T00:34:03.803 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-17T00:34:03.805 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T00:34:03.808 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-17T00:34:03.809 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-17T00:34:03.898 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================================ 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================================ 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 6.6 k 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 5.3 M 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 886 k 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 145 k 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 1.5 M 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 138 k 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 1.8 M 2024-02-17T00:34:03.921 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 7.4 M 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 52 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 9.7 M 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 47 M 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 264 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 748 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 220 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 27 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 18 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 31 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 742 k 2024-02-17T00:34:03.922 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 127 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 162 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 320 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 298 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 99 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 85 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 3.1 M 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 171 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-17T00:34:03.923 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-17T00:34:03.924 INFO:teuthology.orchestra.run.smithi039.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 3.4 M 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 3.1 M 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-17T00:34:03.925 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 20 M 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 31 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 2.1 M 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 247 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 4.7 M 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 17 M 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 15 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 25 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-17T00:34:03.926 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 163 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 498 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 5.1 M 2024-02-17T00:34:03.927 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-17T00:34:03.928 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 45 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 131 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-17T00:34:03.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-17T00:34:03.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-17T00:34:03.931 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-17T00:34:03.932 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-17T00:34:03.933 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================================ 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout:Install 150 Packages 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 26 Packages 2024-02-17T00:34:03.934 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:03.935 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 223 M 2024-02-17T00:34:03.935 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-02-17T00:34:04.255 INFO:teuthology.orchestra.run.smithi039.stdout:(1/176): ceph-19.0.0-1507.g2d9ecbfd.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-02-17T00:34:04.464 INFO:teuthology.orchestra.run.smithi039.stdout:(2/176): ceph-fuse-19.0.0-1507.g2d9ecbfd.el9.x8 4.2 MB/s | 886 kB 00:00 2024-02-17T00:34:04.522 INFO:teuthology.orchestra.run.smithi039.stdout:(3/176): ceph-immutable-object-cache-19.0.0-150 2.4 MB/s | 145 kB 00:00 2024-02-17T00:34:04.781 INFO:teuthology.orchestra.run.smithi039.stdout:(4/176): ceph-mds-19.0.0-1507.g2d9ecbfd.el9.x86 8.2 MB/s | 2.1 MB 00:00 2024-02-17T00:34:04.973 INFO:teuthology.orchestra.run.smithi039.stdout:(5/176): ceph-mgr-19.0.0-1507.g2d9ecbfd.el9.x86 7.8 MB/s | 1.5 MB 00:00 2024-02-17T00:34:05.515 INFO:teuthology.orchestra.run.smithi039.stdout:(6/176): ceph-base-19.0.0-1507.g2d9ecbfd.el9.x8 3.7 MB/s | 5.3 MB 00:01 2024-02-17T00:34:05.573 INFO:teuthology.orchestra.run.smithi039.stdout:(7/176): ceph-mon-19.0.0-1507.g2d9ecbfd.el9.x86 7.8 MB/s | 4.7 MB 00:00 2024-02-17T00:34:05.790 INFO:teuthology.orchestra.run.smithi039.stdout:(8/176): ceph-common-19.0.0-1507.g2d9ecbfd.el9. 12 MB/s | 20 MB 00:01 2024-02-17T00:34:05.832 INFO:teuthology.orchestra.run.smithi039.stdout:(9/176): ceph-selinux-19.0.0-1507.g2d9ecbfd.el9 607 kB/s | 25 kB 00:00 2024-02-17T00:34:06.282 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - CRB 441 kB/s | 6.1 MB 00:14 2024-02-17T00:34:06.383 INFO:teuthology.orchestra.run.smithi039.stdout:(10/176): ceph-radosgw-19.0.0-1507.g2d9ecbfd.el 12 MB/s | 9.7 MB 00:00 2024-02-17T00:34:06.466 INFO:teuthology.orchestra.run.smithi039.stdout:(11/176): cephfs-mirror-19.0.0-1507.g2d9ecbfd.e 2.6 MB/s | 220 kB 00:00 2024-02-17T00:34:06.533 INFO:teuthology.orchestra.run.smithi039.stdout:(12/176): cephfs-shell-19.0.0-1507.g2d9ecbfd.el 408 kB/s | 27 kB 00:00 2024-02-17T00:34:06.600 INFO:teuthology.orchestra.run.smithi039.stdout:(13/176): libcephfs-devel-19.0.0-1507.g2d9ecbfd 467 kB/s | 31 kB 00:00 2024-02-17T00:34:06.692 INFO:teuthology.orchestra.run.smithi039.stdout:(14/176): libcephfs2-19.0.0-1507.g2d9ecbfd.el9. 7.9 MB/s | 742 kB 00:00 2024-02-17T00:34:06.767 INFO:teuthology.orchestra.run.smithi039.stdout:(15/176): libcephsqlite-19.0.0-1507.g2d9ecbfd.e 2.1 MB/s | 163 kB 00:00 2024-02-17T00:34:06.843 INFO:teuthology.orchestra.run.smithi039.stdout:(16/176): librados-devel-19.0.0-1507.g2d9ecbfd. 1.6 MB/s | 127 kB 00:00 2024-02-17T00:34:06.943 INFO:teuthology.orchestra.run.smithi039.stdout:(17/176): libradosstriper1-19.0.0-1507.g2d9ecbf 4.9 MB/s | 498 kB 00:00 2024-02-17T00:34:07.168 INFO:teuthology.orchestra.run.smithi039.stdout:(18/176): ceph-osd-19.0.0-1507.g2d9ecbfd.el9.x8 10 MB/s | 17 MB 00:01 2024-02-17T00:34:07.260 INFO:teuthology.orchestra.run.smithi039.stdout:(19/176): python3-ceph-argparse-19.0.0-1507.g2d 493 kB/s | 45 kB 00:00 2024-02-17T00:34:07.344 INFO:teuthology.orchestra.run.smithi039.stdout:(20/176): librgw2-19.0.0-1507.g2d9ecbfd.el9.x86 13 MB/s | 5.1 MB 00:00 2024-02-17T00:34:07.369 INFO:teuthology.orchestra.run.smithi039.stdout:(21/176): python3-ceph-common-19.0.0-1507.g2d9e 1.2 MB/s | 131 kB 00:00 2024-02-17T00:34:07.402 INFO:teuthology.orchestra.run.smithi039.stdout:(22/176): python3-cephfs-19.0.0-1507.g2d9ecbfd. 2.7 MB/s | 162 kB 00:00 2024-02-17T00:34:07.453 INFO:teuthology.orchestra.run.smithi039.stdout:(23/176): python3-rados-19.0.0-1507.g2d9ecbfd.e 3.7 MB/s | 320 kB 00:00 2024-02-17T00:34:07.478 INFO:teuthology.orchestra.run.smithi039.stdout:(24/176): python3-rbd-19.0.0-1507.g2d9ecbfd.el9 3.9 MB/s | 298 kB 00:00 2024-02-17T00:34:07.529 INFO:teuthology.orchestra.run.smithi039.stdout:(25/176): python3-rgw-19.0.0-1507.g2d9ecbfd.el9 1.3 MB/s | 99 kB 00:00 2024-02-17T00:34:07.554 INFO:teuthology.orchestra.run.smithi039.stdout:(26/176): rbd-fuse-19.0.0-1507.g2d9ecbfd.el9.x8 1.1 MB/s | 85 kB 00:00 2024-02-17T00:34:07.654 INFO:teuthology.orchestra.run.smithi039.stdout:(27/176): rbd-nbd-19.0.0-1507.g2d9ecbfd.el9.x86 1.7 MB/s | 171 kB 00:00 2024-02-17T00:34:07.721 INFO:teuthology.orchestra.run.smithi039.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1507.g 473 kB/s | 31 kB 00:00 2024-02-17T00:34:07.788 INFO:teuthology.orchestra.run.smithi039.stdout:(29/176): rbd-mirror-19.0.0-1507.g2d9ecbfd.el9. 12 MB/s | 3.1 MB 00:00 2024-02-17T00:34:07.813 INFO:teuthology.orchestra.run.smithi039.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1507.g2d9ecbf 1.5 MB/s | 138 kB 00:00 2024-02-17T00:34:07.964 INFO:teuthology.orchestra.run.smithi039.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1507.g2d9ec 10 MB/s | 1.8 MB 00:00 2024-02-17T00:34:08.056 INFO:teuthology.orchestra.run.smithi039.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1507.g2d 2.6 MB/s | 247 kB 00:00 2024-02-17T00:34:08.139 INFO:teuthology.orchestra.run.smithi039.stdout:(33/176): ceph-mgr-rook-19.0.0-1507.g2d9ecbfd.e 628 kB/s | 52 kB 00:00 2024-02-17T00:34:08.223 INFO:teuthology.orchestra.run.smithi039.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1507.g2 184 kB/s | 15 kB 00:00 2024-02-17T00:34:08.315 INFO:teuthology.orchestra.run.smithi039.stdout:(35/176): ceph-volume-19.0.0-1507.g2d9ecbfd.el9 2.8 MB/s | 264 kB 00:00 2024-02-17T00:34:08.432 INFO:teuthology.orchestra.run.smithi039.stdout:(36/176): cephadm-19.0.0-1507.g2d9ecbfd.el9.noa 6.3 MB/s | 748 kB 00:00 2024-02-17T00:34:08.541 INFO:teuthology.orchestra.run.smithi039.stdout:(37/176): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-02-17T00:34:08.566 INFO:teuthology.orchestra.run.smithi039.stdout:(38/176): cephfs-top-19.0.0-1507.g2d9ecbfd.el9. 136 kB/s | 18 kB 00:00 2024-02-17T00:34:08.666 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2024-02-17T00:34:08.716 INFO:teuthology.orchestra.run.smithi039.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 6.0 MB/s | 920 kB 00:00 2024-02-17T00:34:08.750 INFO:teuthology.orchestra.run.smithi039.stdout:(40/176): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 662 kB 00:00 2024-02-17T00:34:08.775 INFO:teuthology.orchestra.run.smithi039.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-02-17T00:34:08.801 INFO:teuthology.orchestra.run.smithi039.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 408 kB/s | 20 kB 00:00 2024-02-17T00:34:08.826 INFO:teuthology.orchestra.run.smithi039.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-02-17T00:34:08.851 INFO:teuthology.orchestra.run.smithi039.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2024-02-17T00:34:08.943 INFO:teuthology.orchestra.run.smithi039.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-02-17T00:34:08.968 INFO:teuthology.orchestra.run.smithi039.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2024-02-17T00:34:09.002 INFO:teuthology.orchestra.run.smithi039.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 305 kB/s | 10 kB 00:00 2024-02-17T00:34:09.027 INFO:teuthology.orchestra.run.smithi039.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-02-17T00:34:09.053 INFO:teuthology.orchestra.run.smithi039.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2024-02-17T00:34:09.078 INFO:teuthology.orchestra.run.smithi039.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-02-17T00:34:09.103 INFO:teuthology.orchestra.run.smithi039.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-02-17T00:34:09.129 INFO:teuthology.orchestra.run.smithi039.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 494 kB/s | 24 kB 00:00 2024-02-17T00:34:09.145 INFO:teuthology.orchestra.run.smithi039.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-02-17T00:34:09.171 INFO:teuthology.orchestra.run.smithi039.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-02-17T00:34:09.196 INFO:teuthology.orchestra.run.smithi039.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-02-17T00:34:09.213 INFO:teuthology.orchestra.run.smithi039.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 821 kB/s | 34 kB 00:00 2024-02-17T00:34:09.330 INFO:teuthology.orchestra.run.smithi039.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-02-17T00:34:09.389 INFO:teuthology.orchestra.run.smithi039.stdout:(58/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 17 MB/s | 3.0 MB 00:00 2024-02-17T00:34:09.431 INFO:teuthology.orchestra.run.smithi039.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-02-17T00:34:09.464 INFO:teuthology.orchestra.run.smithi039.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-17T00:34:09.490 INFO:teuthology.orchestra.run.smithi039.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-02-17T00:34:09.915 INFO:teuthology.orchestra.run.smithi039.stdout:(62/176): ceph-test-19.0.0-1507.g2d9ecbfd.el9.x 12 MB/s | 47 MB 00:04 2024-02-17T00:34:10.007 INFO:teuthology.orchestra.run.smithi039.stdout:(63/176): postgresql-server-13.11-1.el9.x86_64. 10 MB/s | 5.7 MB 00:00 2024-02-17T00:34:10.040 INFO:teuthology.orchestra.run.smithi039.stdout:(64/176): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-02-17T00:34:10.074 INFO:teuthology.orchestra.run.smithi039.stdout:(65/176): python3-attrs-20.3.0-7.el9.noarch.rpm 499 kB/s | 78 kB 00:00 2024-02-17T00:34:10.170 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2024-02-17T00:34:10.191 INFO:teuthology.orchestra.run.smithi039.stdout:(66/176): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 5.8 MB 00:00 2024-02-17T00:34:10.216 INFO:teuthology.orchestra.run.smithi039.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 176 kB/s | 24 kB 00:00 2024-02-17T00:34:10.242 INFO:teuthology.orchestra.run.smithi039.stdout:(68/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.4 MB/s | 227 kB 00:00 2024-02-17T00:34:10.267 INFO:teuthology.orchestra.run.smithi039.stdout:(69/176): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2024-02-17T00:34:10.292 INFO:teuthology.orchestra.run.smithi039.stdout:(70/176): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-02-17T00:34:10.317 INFO:teuthology.orchestra.run.smithi039.stdout:(71/176): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2024-02-17T00:34:10.426 INFO:teuthology.orchestra.run.smithi039.stdout:(72/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2024-02-17T00:34:10.443 INFO:teuthology.orchestra.run.smithi039.stdout:(73/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-02-17T00:34:10.468 INFO:teuthology.orchestra.run.smithi039.stdout:(74/176): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-02-17T00:34:10.494 INFO:teuthology.orchestra.run.smithi039.stdout:(75/176): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-02-17T00:34:10.519 INFO:teuthology.orchestra.run.smithi039.stdout:(76/176): python3-prettytable-0.7.2-27.el9.noar 827 kB/s | 41 kB 00:00 2024-02-17T00:34:10.544 INFO:teuthology.orchestra.run.smithi039.stdout:(77/176): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-02-17T00:34:10.569 INFO:teuthology.orchestra.run.smithi039.stdout:(78/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-02-17T00:34:10.594 INFO:teuthology.orchestra.run.smithi039.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 953 kB/s | 47 kB 00:00 2024-02-17T00:34:10.620 INFO:teuthology.orchestra.run.smithi039.stdout:(80/176): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-02-17T00:34:10.645 INFO:teuthology.orchestra.run.smithi039.stdout:(81/176): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-02-17T00:34:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 181 kB/s | 39 kB 00:00 2024-02-17T00:34:10.887 INFO:teuthology.orchestra.run.smithi039.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 172 kB/s | 41 kB 00:00 2024-02-17T00:34:11.046 INFO:teuthology.orchestra.run.smithi039.stdout:(84/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-02-17T00:34:11.071 INFO:teuthology.orchestra.run.smithi039.stdout:(85/176): qatlib-23.11.0-1.el9.x86_64.rpm 1.0 MB/s | 215 kB 00:00 2024-02-17T00:34:11.096 INFO:teuthology.orchestra.run.smithi039.stdout:(86/176): qatlib-service-23.11.0-1.el9.x86_64.r 164 kB/s | 34 kB 00:00 2024-02-17T00:34:11.122 INFO:teuthology.orchestra.run.smithi039.stdout:(87/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 871 kB/s | 43 kB 00:00 2024-02-17T00:34:11.147 INFO:teuthology.orchestra.run.smithi039.stdout:(88/176): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-02-17T00:34:11.172 INFO:teuthology.orchestra.run.smithi039.stdout:(89/176): uuid-1.6.2-55.el9.x86_64.rpm 749 kB/s | 56 kB 00:00 2024-02-17T00:34:11.197 INFO:teuthology.orchestra.run.smithi039.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-02-17T00:34:11.222 INFO:teuthology.orchestra.run.smithi039.stdout:(91/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-02-17T00:34:11.248 INFO:teuthology.orchestra.run.smithi039.stdout:(92/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 585 kB/s | 44 kB 00:00 2024-02-17T00:34:11.273 INFO:teuthology.orchestra.run.smithi039.stdout:(93/176): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-02-17T00:34:11.298 INFO:teuthology.orchestra.run.smithi039.stdout:(94/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-17T00:34:11.332 INFO:teuthology.orchestra.run.smithi039.stdout:(95/176): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-17T00:34:11.357 INFO:teuthology.orchestra.run.smithi039.stdout:(96/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 194 kB 00:00 2024-02-17T00:34:11.383 INFO:teuthology.orchestra.run.smithi039.stdout:(97/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-02-17T00:34:11.408 INFO:teuthology.orchestra.run.smithi039.stdout:(98/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-02-17T00:34:11.450 INFO:teuthology.orchestra.run.smithi039.stdout:(99/176): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-02-17T00:34:11.475 INFO:teuthology.orchestra.run.smithi039.stdout:(100/176): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-02-17T00:34:11.500 INFO:teuthology.orchestra.run.smithi039.stdout:(101/176): python3-pycparser-2.20-6.el9.noarch. 1.4 MB/s | 124 kB 00:00 2024-02-17T00:34:11.526 INFO:teuthology.orchestra.run.smithi039.stdout:(102/176): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 113 kB 00:00 2024-02-17T00:34:11.551 INFO:teuthology.orchestra.run.smithi039.stdout:(103/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-17T00:34:11.709 INFO:teuthology.orchestra.run.smithi039.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 122 kB/s | 22 kB 00:00 2024-02-17T00:34:11.768 INFO:teuthology.orchestra.run.smithi039.stdout:(105/176): python3-devel-3.9.17-2.el9.x86_64.rp 919 kB/s | 245 kB 00:00 2024-02-17T00:34:11.902 INFO:teuthology.orchestra.run.smithi039.stdout:(106/176): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-02-17T00:34:12.144 INFO:teuthology.orchestra.run.smithi039.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-02-17T00:34:12.227 INFO:teuthology.orchestra.run.smithi039.stdout:(108/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-02-17T00:34:12.252 INFO:teuthology.orchestra.run.smithi039.stdout:(109/176): gperftools-libs-2.9.1-2.el9.x86_64.r 638 kB/s | 309 kB 00:00 2024-02-17T00:34:12.319 INFO:teuthology.orchestra.run.smithi039.stdout:(110/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-02-17T00:34:12.353 INFO:teuthology.orchestra.run.smithi039.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-02-17T00:34:12.412 INFO:teuthology.orchestra.run.smithi039.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-02-17T00:34:12.454 INFO:teuthology.orchestra.run.smithi039.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-02-17T00:34:12.596 INFO:teuthology.orchestra.run.smithi039.stdout:(114/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-02-17T00:34:12.629 INFO:teuthology.orchestra.run.smithi039.stdout:(115/176): python3-asyncssh-2.13.2-3.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-02-17T00:34:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-02-17T00:34:12.730 INFO:teuthology.orchestra.run.smithi039.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-02-17T00:34:12.788 INFO:teuthology.orchestra.run.smithi039.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-02-17T00:34:12.830 INFO:teuthology.orchestra.run.smithi039.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-02-17T00:34:12.897 INFO:teuthology.orchestra.run.smithi039.stdout:(120/176): libarrow-9.0.0-10.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-02-17T00:34:12.922 INFO:teuthology.orchestra.run.smithi039.stdout:(121/176): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-02-17T00:34:12.948 INFO:teuthology.orchestra.run.smithi039.stdout:(122/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-02-17T00:34:12.998 INFO:teuthology.orchestra.run.smithi039.stdout:(123/176): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-02-17T00:34:13.023 INFO:teuthology.orchestra.run.smithi039.stdout:(124/176): python3-google-auth-2.27.0-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-02-17T00:34:13.099 INFO:teuthology.orchestra.run.smithi039.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-02-17T00:34:13.124 INFO:teuthology.orchestra.run.smithi039.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-02-17T00:34:13.175 INFO:teuthology.orchestra.run.smithi039.stdout:(127/176): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-02-17T00:34:13.200 INFO:teuthology.orchestra.run.smithi039.stdout:(128/176): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-02-17T00:34:13.217 INFO:teuthology.orchestra.run.smithi039.stdout:(129/176): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-02-17T00:34:13.267 INFO:teuthology.orchestra.run.smithi039.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-02-17T00:34:13.292 INFO:teuthology.orchestra.run.smithi039.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-02-17T00:34:13.343 INFO:teuthology.orchestra.run.smithi039.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-02-17T00:34:13.360 INFO:teuthology.orchestra.run.smithi039.stdout:(133/176): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-02-17T00:34:13.385 INFO:teuthology.orchestra.run.smithi039.stdout:(134/176): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-02-17T00:34:13.435 INFO:teuthology.orchestra.run.smithi039.stdout:(135/176): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-02-17T00:34:13.460 INFO:teuthology.orchestra.run.smithi039.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-02-17T00:34:13.486 INFO:teuthology.orchestra.run.smithi039.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-02-17T00:34:13.536 INFO:teuthology.orchestra.run.smithi039.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-02-17T00:34:13.561 INFO:teuthology.orchestra.run.smithi039.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-02-17T00:34:13.587 INFO:teuthology.orchestra.run.smithi039.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-02-17T00:34:13.645 INFO:teuthology.orchestra.run.smithi039.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-02-17T00:34:13.671 INFO:teuthology.orchestra.run.smithi039.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 544 kB/s | 59 kB 00:00 2024-02-17T00:34:13.696 INFO:teuthology.orchestra.run.smithi039.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-02-17T00:34:13.746 INFO:teuthology.orchestra.run.smithi039.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-02-17T00:34:13.771 INFO:teuthology.orchestra.run.smithi039.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-02-17T00:34:13.797 INFO:teuthology.orchestra.run.smithi039.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2024-02-17T00:34:13.847 INFO:teuthology.orchestra.run.smithi039.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-02-17T00:34:13.872 INFO:teuthology.orchestra.run.smithi039.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-02-17T00:34:13.889 INFO:teuthology.orchestra.run.smithi039.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-02-17T00:34:14.148 INFO:teuthology.orchestra.run.smithi039.stdout:(150/176): librados2-19.0.0-1507.g2d9ecbfd.el9. 12 MB/s | 3.4 MB 00:00 2024-02-17T00:34:14.181 INFO:teuthology.orchestra.run.smithi039.stdout:(151/176): thrift-0.15.0-2.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-02-17T00:34:14.215 INFO:teuthology.orchestra.run.smithi039.stdout:(152/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2024-02-17T00:34:14.315 INFO:teuthology.orchestra.run.smithi039.stdout:(153/176): NetworkManager-1.45.91-1.el9.x86_64. 17 MB/s | 2.3 MB 00:00 2024-02-17T00:34:14.391 INFO:teuthology.orchestra.run.smithi039.stdout:(154/176): NetworkManager-libnm-1.45.91-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-02-17T00:34:14.424 INFO:teuthology.orchestra.run.smithi039.stdout:(155/176): NetworkManager-team-1.45.91-1.el9.x8 380 kB/s | 41 kB 00:00 2024-02-17T00:34:14.483 INFO:teuthology.orchestra.run.smithi039.stdout:(156/176): librbd1-19.0.0-1507.g2d9ecbfd.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-02-17T00:34:14.508 INFO:teuthology.orchestra.run.smithi039.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 826 kB/s | 69 kB 00:00 2024-02-17T00:34:14.533 INFO:teuthology.orchestra.run.smithi039.stdout:(158/176): NetworkManager-tui-1.45.91-1.el9.x86 2.2 MB/s | 246 kB 00:00 2024-02-17T00:34:14.559 INFO:teuthology.orchestra.run.smithi039.stdout:(159/176): elfutils-debuginfod-client-0.190-2.e 469 kB/s | 35 kB 00:00 2024-02-17T00:34:14.584 INFO:teuthology.orchestra.run.smithi039.stdout:(160/176): elfutils-libelf-0.190-2.el9.x86_64.r 2.5 MB/s | 191 kB 00:00 2024-02-17T00:34:14.642 INFO:teuthology.orchestra.run.smithi039.stdout:(161/176): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 254 kB 00:00 2024-02-17T00:34:14.755 INFO:teuthology.orchestra.run.smithi039.stdout:(162/176): iproute-6.7.0-2.el9.x86_64.rpm 4.0 MB/s | 802 kB 00:00 2024-02-17T00:34:14.793 INFO:teuthology.orchestra.run.smithi039.stdout:(163/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 2.0 MB/s | 433 kB 00:00 2024-02-17T00:34:14.818 INFO:teuthology.orchestra.run.smithi039.stdout:(164/176): libacl-2.3.1-4.el9.x86_64.rpm 126 kB/s | 22 kB 00:00 2024-02-17T00:34:14.852 INFO:teuthology.orchestra.run.smithi039.stdout:(165/176): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-02-17T00:34:14.869 INFO:teuthology.orchestra.run.smithi039.stdout:(166/176): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 154 kB 00:00 2024-02-17T00:34:14.895 INFO:teuthology.orchestra.run.smithi039.stdout:(167/176): libmount-2.37.4-18.el9.x86_64.rpm 1.7 MB/s | 135 kB 00:00 2024-02-17T00:34:14.911 INFO:teuthology.orchestra.run.smithi039.stdout:(168/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.0 MB/s | 63 kB 00:00 2024-02-17T00:34:14.928 INFO:teuthology.orchestra.run.smithi039.stdout:(169/176): libuuid-2.37.4-18.el9.x86_64.rpm 473 kB/s | 28 kB 00:00 2024-02-17T00:34:14.987 INFO:teuthology.orchestra.run.smithi039.stdout:(170/176): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-02-17T00:34:15.054 INFO:teuthology.orchestra.run.smithi039.stdout:(171/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2024-02-17T00:34:15.104 INFO:teuthology.orchestra.run.smithi039.stdout:(172/176): util-linux-2.37.4-18.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-02-17T00:34:15.129 INFO:teuthology.orchestra.run.smithi039.stdout:(173/176): util-linux-core-2.37.4-18.el9.x86_64 3.1 MB/s | 438 kB 00:00 2024-02-17T00:34:15.154 INFO:teuthology.orchestra.run.smithi039.stdout:(174/176): util-linux-user-2.37.4-18.el9.x86_64 310 kB/s | 30 kB 00:00 2024-02-17T00:34:15.159 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-02-17T00:34:15.180 INFO:teuthology.orchestra.run.smithi039.stdout:(175/176): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2024-02-17T00:34:15.230 INFO:teuthology.orchestra.run.smithi039.stdout:(176/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-02-17T00:34:15.235 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-02-17T00:34:15.236 INFO:teuthology.orchestra.run.smithi039.stdout:Total 20 MB/s | 223 MB 00:11 2024-02-17T00:34:15.287 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-02-17T00:34:15.614 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-02-17T00:34:15.614 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-02-17T00:34:17.641 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-02-17T00:34:17.642 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-02-17T00:34:17.874 INFO:teuthology.orchestra.run.smithi032.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T00:34:17.875 INFO:teuthology.orchestra.run.smithi032.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T00:34:17.887 INFO:teuthology.orchestra.run.smithi032.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-17T00:34:17.888 INFO:teuthology.orchestra.run.smithi032.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-17T00:34:17.889 INFO:teuthology.orchestra.run.smithi032.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-17T00:34:17.890 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-17T00:34:17.892 INFO:teuthology.orchestra.run.smithi032.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T00:34:17.894 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-17T00:34:17.895 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-17T00:34:17.980 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================================ 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================================ 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 6.6 k 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 5.3 M 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 886 k 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 145 k 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 1.5 M 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 138 k 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 1.8 M 2024-02-17T00:34:17.998 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 7.4 M 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 52 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 9.7 M 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 47 M 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 264 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 748 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 220 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-shell x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 27 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 18 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 31 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 742 k 2024-02-17T00:34:17.999 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 127 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 162 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 320 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 298 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 99 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 85 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 3.1 M 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 171 k 2024-02-17T00:34:18.000 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-17T00:34:18.001 INFO:teuthology.orchestra.run.smithi032.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 3.4 M 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 3.1 M 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-02-17T00:34:18.002 INFO:teuthology.orchestra.run.smithi032.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 20 M 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 31 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 2.1 M 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 247 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 4.7 M 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 17 M 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1507.g2d9ecbfd.el9 ceph-noarch 15 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 25 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-17T00:34:18.003 INFO:teuthology.orchestra.run.smithi032.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 163 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 498 k 2024-02-17T00:34:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2 x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 5.1 M 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-17T00:34:18.005 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 45 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common x86_64 2:19.0.0-1507.g2d9ecbfd.el9 ceph 131 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-17T00:34:18.006 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-17T00:34:18.007 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-17T00:34:18.008 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-17T00:34:18.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-17T00:34:18.010 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout:Installing weak dependencies: 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================================ 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout:Install 150 Packages 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 26 Packages 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:34:18.011 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 223 M 2024-02-17T00:34:18.012 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-02-17T00:34:18.494 INFO:teuthology.orchestra.run.smithi032.stdout:(1/176): ceph-19.0.0-1507.g2d9ecbfd.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-02-17T00:34:19.136 INFO:teuthology.orchestra.run.smithi032.stdout:(2/176): ceph-fuse-19.0.0-1507.g2d9ecbfd.el9.x8 1.3 MB/s | 886 kB 00:00 2024-02-17T00:34:19.311 INFO:teuthology.orchestra.run.smithi032.stdout:(3/176): ceph-immutable-object-cache-19.0.0-150 830 kB/s | 145 kB 00:00 2024-02-17T00:34:19.536 INFO:teuthology.orchestra.run.smithi032.stdout:(4/176): ceph-common-19.0.0-1507.g2d9ecbfd.el9. 16 MB/s | 20 MB 00:01 2024-02-17T00:34:19.695 INFO:teuthology.orchestra.run.smithi032.stdout:(5/176): ceph-mgr-19.0.0-1507.g2d9ecbfd.el9.x86 9.4 MB/s | 1.5 MB 00:00 2024-02-17T00:34:19.937 INFO:teuthology.orchestra.run.smithi032.stdout:(6/176): ceph-base-19.0.0-1507.g2d9ecbfd.el9.x8 3.2 MB/s | 5.3 MB 00:01 2024-02-17T00:34:20.012 INFO:teuthology.orchestra.run.smithi032.stdout:(7/176): ceph-mon-19.0.0-1507.g2d9ecbfd.el9.x86 15 MB/s | 4.7 MB 00:00 2024-02-17T00:34:20.296 INFO:teuthology.orchestra.run.smithi032.stdout:(8/176): ceph-mds-19.0.0-1507.g2d9ecbfd.el9.x86 2.2 MB/s | 2.1 MB 00:00 2024-02-17T00:34:20.396 INFO:teuthology.orchestra.run.smithi032.stdout:(9/176): ceph-selinux-19.0.0-1507.g2d9ecbfd.el9 253 kB/s | 25 kB 00:00 2024-02-17T00:34:20.613 INFO:teuthology.orchestra.run.smithi032.stdout:(10/176): ceph-radosgw-19.0.0-1507.g2d9ecbfd.el 16 MB/s | 9.7 MB 00:00 2024-02-17T00:34:20.671 INFO:teuthology.orchestra.run.smithi032.stdout:(11/176): cephfs-mirror-19.0.0-1507.g2d9ecbfd.e 3.7 MB/s | 220 kB 00:00 2024-02-17T00:34:20.730 INFO:teuthology.orchestra.run.smithi032.stdout:(12/176): cephfs-shell-19.0.0-1507.g2d9ecbfd.el 466 kB/s | 27 kB 00:00 2024-02-17T00:34:20.797 INFO:teuthology.orchestra.run.smithi032.stdout:(13/176): libcephfs-devel-19.0.0-1507.g2d9ecbfd 468 kB/s | 31 kB 00:00 2024-02-17T00:34:20.880 INFO:teuthology.orchestra.run.smithi032.stdout:(14/176): libcephfs2-19.0.0-1507.g2d9ecbfd.el9. 8.7 MB/s | 742 kB 00:00 2024-02-17T00:34:20.930 INFO:teuthology.orchestra.run.smithi032.stdout:(15/176): libcephsqlite-19.0.0-1507.g2d9ecbfd.e 3.2 MB/s | 163 kB 00:00 2024-02-17T00:34:20.989 INFO:teuthology.orchestra.run.smithi032.stdout:(16/176): librados-devel-19.0.0-1507.g2d9ecbfd. 2.1 MB/s | 127 kB 00:00 2024-02-17T00:34:21.081 INFO:teuthology.orchestra.run.smithi032.stdout:(17/176): libradosstriper1-19.0.0-1507.g2d9ecbf 5.3 MB/s | 498 kB 00:00 2024-02-17T00:34:21.498 INFO:teuthology.orchestra.run.smithi032.stdout:(18/176): ceph-osd-19.0.0-1507.g2d9ecbfd.el9.x8 11 MB/s | 17 MB 00:01 2024-02-17T00:34:21.573 INFO:teuthology.orchestra.run.smithi032.stdout:(19/176): librgw2-19.0.0-1507.g2d9ecbfd.el9.x86 10 MB/s | 5.1 MB 00:00 2024-02-17T00:34:21.599 INFO:teuthology.orchestra.run.smithi032.stdout:(20/176): python3-ceph-argparse-19.0.0-1507.g2d 451 kB/s | 45 kB 00:00 2024-02-17T00:34:21.623 INFO:teuthology.orchestra.run.smithi032.stdout:(21/176): python3-ceph-common-19.0.0-1507.g2d9e 2.6 MB/s | 131 kB 00:00 2024-02-17T00:34:21.657 INFO:teuthology.orchestra.run.smithi032.stdout:(22/176): python3-cephfs-19.0.0-1507.g2d9ecbfd. 2.7 MB/s | 162 kB 00:00 2024-02-17T00:34:21.683 INFO:teuthology.orchestra.run.smithi032.stdout:(23/176): python3-rados-19.0.0-1507.g2d9ecbfd.e 5.3 MB/s | 320 kB 00:00 2024-02-17T00:34:21.725 INFO:teuthology.orchestra.run.smithi032.stdout:(24/176): python3-rbd-19.0.0-1507.g2d9ecbfd.el9 4.4 MB/s | 298 kB 00:00 2024-02-17T00:34:21.750 INFO:teuthology.orchestra.run.smithi032.stdout:(25/176): python3-rgw-19.0.0-1507.g2d9ecbfd.el9 1.4 MB/s | 99 kB 00:00 2024-02-17T00:34:21.792 INFO:teuthology.orchestra.run.smithi032.stdout:(26/176): rbd-fuse-19.0.0-1507.g2d9ecbfd.el9.x8 1.2 MB/s | 85 kB 00:00 2024-02-17T00:34:21.884 INFO:teuthology.orchestra.run.smithi032.stdout:(27/176): rbd-nbd-19.0.0-1507.g2d9ecbfd.el9.x86 1.8 MB/s | 171 kB 00:00 2024-02-17T00:34:21.959 INFO:teuthology.orchestra.run.smithi032.stdout:(28/176): rbd-mirror-19.0.0-1507.g2d9ecbfd.el9. 15 MB/s | 3.1 MB 00:00 2024-02-17T00:34:21.976 INFO:teuthology.orchestra.run.smithi032.stdout:(29/176): ceph-grafana-dashboards-19.0.0-1507.g 342 kB/s | 31 kB 00:00 2024-02-17T00:34:22.010 INFO:teuthology.orchestra.run.smithi032.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1507.g2d9ecbf 2.7 MB/s | 138 kB 00:00 2024-02-17T00:34:22.169 INFO:teuthology.orchestra.run.smithi032.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1507.g2d9ec 9.3 MB/s | 1.8 MB 00:00 2024-02-17T00:34:22.260 INFO:teuthology.orchestra.run.smithi032.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1507.g2d 2.6 MB/s | 247 kB 00:00 2024-02-17T00:34:22.336 INFO:teuthology.orchestra.run.smithi032.stdout:(33/176): ceph-mgr-rook-19.0.0-1507.g2d9ecbfd.e 697 kB/s | 52 kB 00:00 2024-02-17T00:34:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:(34/176): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-02-17T00:34:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:(35/176): ceph-prometheus-alerts-19.0.0-1507.g2 108 kB/s | 15 kB 00:00 2024-02-17T00:34:22.528 INFO:teuthology.orchestra.run.smithi032.stdout:(36/176): ceph-volume-19.0.0-1507.g2d9ecbfd.el9 3.9 MB/s | 264 kB 00:00 2024-02-17T00:34:22.562 INFO:teuthology.orchestra.run.smithi032.stdout:(37/176): cephadm-19.0.0-1507.g2d9ecbfd.el9.noa 8.7 MB/s | 748 kB 00:00 2024-02-17T00:34:22.579 INFO:teuthology.orchestra.run.smithi032.stdout:(38/176): cephfs-top-19.0.0-1507.g2d9ecbfd.el9. 362 kB/s | 18 kB 00:00 2024-02-17T00:34:22.737 INFO:teuthology.orchestra.run.smithi032.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2024-02-17T00:34:22.779 INFO:teuthology.orchestra.run.smithi032.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 920 kB 00:00 2024-02-17T00:34:22.805 INFO:teuthology.orchestra.run.smithi032.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-02-17T00:34:22.830 INFO:teuthology.orchestra.run.smithi032.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 408 kB/s | 20 kB 00:00 2024-02-17T00:34:22.855 INFO:teuthology.orchestra.run.smithi032.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-02-17T00:34:22.880 INFO:teuthology.orchestra.run.smithi032.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 638 kB/s | 32 kB 00:00 2024-02-17T00:34:22.956 INFO:teuthology.orchestra.run.smithi032.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-02-17T00:34:22.981 INFO:teuthology.orchestra.run.smithi032.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2024-02-17T00:34:23.006 INFO:teuthology.orchestra.run.smithi032.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-02-17T00:34:23.032 INFO:teuthology.orchestra.run.smithi032.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-02-17T00:34:23.057 INFO:teuthology.orchestra.run.smithi032.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-02-17T00:34:23.090 INFO:teuthology.orchestra.run.smithi032.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-17T00:34:23.124 INFO:teuthology.orchestra.run.smithi032.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-02-17T00:34:23.149 INFO:teuthology.orchestra.run.smithi032.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 424 kB/s | 24 kB 00:00 2024-02-17T00:34:23.198 INFO:teuthology.orchestra.run.smithi032.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 46 kB 00:00 2024-02-17T00:34:23.225 INFO:teuthology.orchestra.run.smithi032.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-02-17T00:34:23.251 INFO:teuthology.orchestra.run.smithi032.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.5 MB/s | 187 kB 00:00 2024-02-17T00:34:23.267 INFO:teuthology.orchestra.run.smithi032.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 828 kB/s | 34 kB 00:00 2024-02-17T00:34:23.385 INFO:teuthology.orchestra.run.smithi032.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-02-17T00:34:23.435 INFO:teuthology.orchestra.run.smithi032.stdout:(58/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-02-17T00:34:23.477 INFO:teuthology.orchestra.run.smithi032.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2024-02-17T00:34:23.510 INFO:teuthology.orchestra.run.smithi032.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-17T00:34:23.535 INFO:teuthology.orchestra.run.smithi032.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-02-17T00:34:23.678 INFO:teuthology.orchestra.run.smithi032.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-02-17T00:34:23.711 INFO:teuthology.orchestra.run.smithi032.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 5.9 MB/s | 1.0 MB 00:00 2024-02-17T00:34:23.736 INFO:teuthology.orchestra.run.smithi032.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-02-17T00:34:23.870 INFO:teuthology.orchestra.run.smithi032.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 5.8 MB 00:00 2024-02-17T00:34:23.895 INFO:teuthology.orchestra.run.smithi032.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.4 MB/s | 227 kB 00:00 2024-02-17T00:34:23.912 INFO:teuthology.orchestra.run.smithi032.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 591 kB/s | 24 kB 00:00 2024-02-17T00:34:23.929 INFO:teuthology.orchestra.run.smithi032.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 540 kB/s | 18 kB 00:00 2024-02-17T00:34:23.954 INFO:teuthology.orchestra.run.smithi032.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-02-17T00:34:23.971 INFO:teuthology.orchestra.run.smithi032.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 759 kB/s | 32 kB 00:00 2024-02-17T00:34:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 217 kB 00:00 2024-02-17T00:34:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:(72/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-02-17T00:34:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 174 kB 00:00 2024-02-17T00:34:24.181 INFO:teuthology.orchestra.run.smithi032.stdout:(74/176): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-02-17T00:34:24.206 INFO:teuthology.orchestra.run.smithi032.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-02-17T00:34:24.248 INFO:teuthology.orchestra.run.smithi032.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-02-17T00:34:24.265 INFO:teuthology.orchestra.run.smithi032.stdout:(77/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-02-17T00:34:24.298 INFO:teuthology.orchestra.run.smithi032.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-02-17T00:34:24.324 INFO:teuthology.orchestra.run.smithi032.stdout:(79/176): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2024-02-17T00:34:24.349 INFO:teuthology.orchestra.run.smithi032.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 859 kB/s | 43 kB 00:00 2024-02-17T00:34:24.466 INFO:teuthology.orchestra.run.smithi032.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 39 kB 00:00 2024-02-17T00:34:24.658 INFO:teuthology.orchestra.run.smithi032.stdout:(82/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-02-17T00:34:24.683 INFO:teuthology.orchestra.run.smithi032.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 191 kB/s | 41 kB 00:00 2024-02-17T00:34:24.800 INFO:teuthology.orchestra.run.smithi032.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 1.5 MB/s | 215 kB 00:00 2024-02-17T00:34:24.859 INFO:teuthology.orchestra.run.smithi032.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 193 kB/s | 34 kB 00:00 2024-02-17T00:34:24.884 INFO:teuthology.orchestra.run.smithi032.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 520 kB/s | 43 kB 00:00 2024-02-17T00:34:24.909 INFO:teuthology.orchestra.run.smithi032.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-02-17T00:34:24.912 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-02-17T00:34:24.935 INFO:teuthology.orchestra.run.smithi032.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-02-17T00:34:24.960 INFO:teuthology.orchestra.run.smithi032.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-02-17T00:34:24.986 INFO:teuthology.orchestra.run.smithi032.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-02-17T00:34:25.011 INFO:teuthology.orchestra.run.smithi032.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-02-17T00:34:25.013 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-17T00:34:25.036 INFO:teuthology.orchestra.run.smithi032.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-02-17T00:34:25.045 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-17T00:34:25.061 INFO:teuthology.orchestra.run.smithi032.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-17T00:34:25.066 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T00:34:25.088 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T00:34:25.095 INFO:teuthology.orchestra.run.smithi032.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-02-17T00:34:25.120 INFO:teuthology.orchestra.run.smithi032.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 194 kB 00:00 2024-02-17T00:34:25.129 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-17T00:34:25.145 INFO:teuthology.orchestra.run.smithi032.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-02-17T00:34:25.167 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-17T00:34:25.171 INFO:teuthology.orchestra.run.smithi032.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-17T00:34:25.213 INFO:teuthology.orchestra.run.smithi032.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-02-17T00:34:25.231 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-17T00:34:25.238 INFO:teuthology.orchestra.run.smithi032.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-02-17T00:34:25.272 INFO:teuthology.orchestra.run.smithi032.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.1 MB/s | 124 kB 00:00 2024-02-17T00:34:25.280 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-17T00:34:25.297 INFO:teuthology.orchestra.run.smithi032.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 1.9 MB/s | 113 kB 00:00 2024-02-17T00:34:25.304 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-17T00:34:25.322 INFO:teuthology.orchestra.run.smithi032.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-17T00:34:25.353 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-17T00:34:25.564 INFO:teuthology.orchestra.run.smithi032.stdout:(103/176): python3-devel-3.9.17-2.el9.x86_64.rp 922 kB/s | 245 kB 00:00 2024-02-17T00:34:25.589 INFO:teuthology.orchestra.run.smithi032.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-02-17T00:34:25.691 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-17T00:34:25.739 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 11/202 2024-02-17T00:34:25.863 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 11/202 2024-02-17T00:34:25.890 INFO:teuthology.orchestra.run.smithi032.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-02-17T00:34:25.890 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 12/202 2024-02-17T00:34:25.966 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 12/202 2024-02-17T00:34:25.981 INFO:teuthology.orchestra.run.smithi032.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-02-17T00:34:26.004 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 13/202 2024-02-17T00:34:26.049 INFO:teuthology.orchestra.run.smithi032.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-02-17T00:34:26.172 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-17T00:34:26.240 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-17T00:34:26.268 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 16/202 2024-02-17T00:34:26.357 INFO:teuthology.orchestra.run.smithi032.stdout:(108/176): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-02-17T00:34:26.363 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 16/202 2024-02-17T00:34:26.382 INFO:teuthology.orchestra.run.smithi032.stdout:(109/176): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-02-17T00:34:26.394 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86 17/202 2024-02-17T00:34:26.433 INFO:teuthology.orchestra.run.smithi032.stdout:(110/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-02-17T00:34:26.459 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86 17/202 2024-02-17T00:34:26.498 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-17T00:34:26.520 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T00:34:26.525 INFO:teuthology.orchestra.run.smithi032.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 735 kB/s | 67 kB 00:00 2024-02-17T00:34:26.536 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T00:34:26.592 INFO:teuthology.orchestra.run.smithi032.stdout:(112/176): liboath-2.6.7-2.el9.x86_64.rpm 232 kB/s | 49 kB 00:00 2024-02-17T00:34:26.617 INFO:teuthology.orchestra.run.smithi032.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-02-17T00:34:26.734 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T00:34:26.751 INFO:teuthology.orchestra.run.smithi032.stdout:(114/176): python3-asyncssh-2.13.2-3.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-02-17T00:34:26.769 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T00:34:26.800 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-17T00:34:26.817 INFO:teuthology.orchestra.run.smithi032.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-02-17T00:34:26.851 INFO:teuthology.orchestra.run.smithi032.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-02-17T00:34:26.885 INFO:teuthology.orchestra.run.smithi032.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-02-17T00:34:26.927 INFO:teuthology.orchestra.run.smithi032.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-02-17T00:34:26.952 INFO:teuthology.orchestra.run.smithi032.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-02-17T00:34:26.980 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-17T00:34:27.019 INFO:teuthology.orchestra.run.smithi032.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-02-17T00:34:27.069 INFO:teuthology.orchestra.run.smithi032.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-02-17T00:34:27.094 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T00:34:27.095 INFO:teuthology.orchestra.run.smithi032.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-02-17T00:34:27.146 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T00:34:27.187 INFO:teuthology.orchestra.run.smithi032.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-02-17T00:34:27.240 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T00:34:27.254 INFO:teuthology.orchestra.run.smithi032.stdout:(124/176): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-02-17T00:34:27.279 INFO:teuthology.orchestra.run.smithi032.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-02-17T00:34:27.281 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T00:34:27.329 INFO:teuthology.orchestra.run.smithi032.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-02-17T00:34:27.354 INFO:teuthology.orchestra.run.smithi032.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-02-17T00:34:27.388 INFO:teuthology.orchestra.run.smithi032.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-02-17T00:34:27.430 INFO:teuthology.orchestra.run.smithi032.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-02-17T00:34:27.455 INFO:teuthology.orchestra.run.smithi032.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-02-17T00:34:27.473 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T00:34:27.580 INFO:teuthology.orchestra.run.smithi032.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-02-17T00:34:27.582 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-17T00:34:27.606 INFO:teuthology.orchestra.run.smithi032.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-02-17T00:34:27.701 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-17T00:34:27.723 INFO:teuthology.orchestra.run.smithi032.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 556 kB/s | 79 kB 00:00 2024-02-17T00:34:27.733 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-17T00:34:27.748 INFO:teuthology.orchestra.run.smithi032.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 407 kB/s | 58 kB 00:00 2024-02-17T00:34:27.805 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-17T00:34:27.823 INFO:teuthology.orchestra.run.smithi032.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-02-17T00:34:27.848 INFO:teuthology.orchestra.run.smithi032.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-02-17T00:34:27.874 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-17T00:34:27.903 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-17T00:34:27.932 INFO:teuthology.orchestra.run.smithi032.stdout:(137/176): python3-pyperclip-1.8.2-2.el9.noarch 339 kB/s | 28 kB 00:00 2024-02-17T00:34:27.939 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-17T00:34:27.957 INFO:teuthology.orchestra.run.smithi032.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 672 kB/s | 90 kB 00:00 2024-02-17T00:34:27.980 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-17T00:34:27.999 INFO:teuthology.orchestra.run.smithi032.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-02-17T00:34:28.033 INFO:teuthology.orchestra.run.smithi032.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-02-17T00:34:28.055 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-17T00:34:28.083 INFO:teuthology.orchestra.run.smithi032.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2024-02-17T00:34:28.095 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-17T00:34:28.100 INFO:teuthology.orchestra.run.smithi032.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-02-17T00:34:28.138 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-17T00:34:28.159 INFO:teuthology.orchestra.run.smithi032.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-02-17T00:34:28.171 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-17T00:34:28.195 INFO:teuthology.orchestra.run.smithi032.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-02-17T00:34:28.201 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-17T00:34:28.251 INFO:teuthology.orchestra.run.smithi032.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 979 kB/s | 90 kB 00:00 2024-02-17T00:34:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-17T00:34:28.277 INFO:teuthology.orchestra.run.smithi032.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-02-17T00:34:28.306 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.0.0-1507.g2d9ecbfd.el9. 39/202 2024-02-17T00:34:28.350 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.0.0-1507.g2d9ecbfd.el 40/202 2024-02-17T00:34:28.369 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 41/202 2024-02-17T00:34:28.402 INFO:teuthology.orchestra.run.smithi032.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 133 kB/s | 20 kB 00:00 2024-02-17T00:34:28.435 INFO:teuthology.orchestra.run.smithi032.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-02-17T00:34:28.444 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-17T00:34:28.501 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-17T00:34:28.536 INFO:teuthology.orchestra.run.smithi032.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-02-17T00:34:28.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-17T00:34:28.716 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-17T00:34:28.780 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-17T00:34:28.878 INFO:teuthology.orchestra.run.smithi032.stdout:(150/176): librbd1-19.0.0-1507.g2d9ecbfd.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-02-17T00:34:28.912 INFO:teuthology.orchestra.run.smithi032.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-17T00:34:28.961 INFO:teuthology.orchestra.run.smithi032.stdout:(152/176): librados2-19.0.0-1507.g2d9ecbfd.el9. 6.4 MB/s | 3.4 MB 00:00 2024-02-17T00:34:29.004 INFO:teuthology.orchestra.run.smithi032.stdout:(153/176): NetworkManager-1.45.91-1.el9.x86_64. 25 MB/s | 2.3 MB 00:00 2024-02-17T00:34:29.046 INFO:teuthology.orchestra.run.smithi032.stdout:(154/176): NetworkManager-libnm-1.45.91-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-02-17T00:34:29.071 INFO:teuthology.orchestra.run.smithi032.stdout:(155/176): NetworkManager-team-1.45.91-1.el9.x8 646 kB/s | 41 kB 00:00 2024-02-17T00:34:29.096 INFO:teuthology.orchestra.run.smithi032.stdout:(156/176): NetworkManager-tui-1.45.91-1.el9.x86 4.8 MB/s | 246 kB 00:00 2024-02-17T00:34:29.121 INFO:teuthology.orchestra.run.smithi032.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-02-17T00:34:29.147 INFO:teuthology.orchestra.run.smithi032.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 705 kB/s | 35 kB 00:00 2024-02-17T00:34:29.172 INFO:teuthology.orchestra.run.smithi032.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-02-17T00:34:29.222 INFO:teuthology.orchestra.run.smithi032.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 254 kB 00:00 2024-02-17T00:34:29.256 INFO:teuthology.orchestra.run.smithi032.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-17T00:34:29.289 INFO:teuthology.orchestra.run.smithi032.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 664 kB/s | 22 kB 00:00 2024-02-17T00:34:29.323 INFO:teuthology.orchestra.run.smithi032.stdout:(163/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 6.3 MB/s | 433 kB 00:00 2024-02-17T00:34:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-17T00:34:29.348 INFO:teuthology.orchestra.run.smithi032.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-02-17T00:34:29.373 INFO:teuthology.orchestra.run.smithi032.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-17T00:34:29.399 INFO:teuthology.orchestra.run.smithi032.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-17T00:34:29.424 INFO:teuthology.orchestra.run.smithi032.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-17T00:34:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-17T00:34:29.449 INFO:teuthology.orchestra.run.smithi032.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 551 kB/s | 28 kB 00:00 2024-02-17T00:34:29.483 INFO:teuthology.orchestra.run.smithi032.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2024-02-17T00:34:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-17T00:34:29.550 INFO:teuthology.orchestra.run.smithi032.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2024-02-17T00:34:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T00:34:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T00:34:29.592 INFO:teuthology.orchestra.run.smithi032.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 21 MB/s | 2.2 MB 00:00 2024-02-17T00:34:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-17T00:34:29.617 INFO:teuthology.orchestra.run.smithi032.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 6.7 MB/s | 438 kB 00:00 2024-02-17T00:34:29.634 INFO:teuthology.orchestra.run.smithi032.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 739 kB/s | 30 kB 00:00 2024-02-17T00:34:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 52/202 2024-02-17T00:34:29.660 INFO:teuthology.orchestra.run.smithi032.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-02-17T00:34:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-17T00:34:29.693 INFO:teuthology.orchestra.run.smithi032.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-02-17T00:34:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-17T00:34:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-17T00:34:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-17T00:34:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-17T00:34:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-17T00:34:30.424 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-17T00:34:30.766 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-17T00:34:30.818 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-17T00:34:30.875 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-17T00:34:30.948 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-17T00:34:30.985 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-17T00:34:31.022 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-17T00:34:31.070 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-17T00:34:31.105 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-17T00:34:31.148 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-17T00:34:31.191 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-17T00:34:31.331 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-17T00:34:31.379 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-17T00:34:31.409 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-17T00:34:31.451 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-17T00:34:31.549 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-17T00:34:31.584 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-17T00:34:31.625 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-17T00:34:31.657 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-17T00:34:31.691 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-17T00:34:31.763 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-17T00:34:31.897 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-17T00:34:32.007 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-17T00:34:32.057 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-17T00:34:32.116 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-17T00:34:32.187 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-17T00:34:32.380 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-17T00:34:32.428 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-17T00:34:32.573 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-17T00:34:32.635 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 88/202 2024-02-17T00:34:32.667 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-17T00:34:32.699 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-17T00:34:32.751 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-17T00:34:32.781 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-17T00:34:32.810 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-17T00:34:32.844 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-17T00:34:32.883 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-17T00:34:32.893 INFO:teuthology.orchestra.run.smithi032.stdout:(176/176): ceph-test-19.0.0-1507.g2d9ecbfd.el9. 3.8 MB/s | 47 MB 00:12 2024-02-17T00:34:32.899 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-02-17T00:34:32.899 INFO:teuthology.orchestra.run.smithi032.stdout:Total 15 MB/s | 223 MB 00:14 2024-02-17T00:34:32.915 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-17T00:34:32.944 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-02-17T00:34:32.945 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-17T00:34:33.024 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-17T00:34:33.055 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-17T00:34:33.088 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-17T00:34:33.130 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-17T00:34:33.156 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-17T00:34:33.250 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-17T00:34:33.266 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-02-17T00:34:33.266 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-02-17T00:34:33.339 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-17T00:34:33.388 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-17T00:34:33.418 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-17T00:34:33.466 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-17T00:34:33.576 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-17T00:34:33.637 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-17T00:34:34.412 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-17T00:34:34.467 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-17T00:34:34.501 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-17T00:34:34.550 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-17T00:34:34.634 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-17T00:34:34.668 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-17T00:34:34.853 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-17T00:34:34.882 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-17T00:34:34.962 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-17T00:34:35.312 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-02-17T00:34:35.313 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-02-17T00:34:35.646 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-17T00:34:35.759 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-17T00:34:37.068 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-17T00:34:37.145 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-17T00:34:37.171 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-17T00:34:37.506 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-17T00:34:37.543 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 125/202 2024-02-17T00:34:37.635 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 125/202 2024-02-17T00:34:37.664 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 126/202 2024-02-17T00:34:37.701 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-17T00:34:38.180 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-17T00:34:38.331 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 129/202 2024-02-17T00:34:38.392 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 129/202 2024-02-17T00:34:38.423 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 130/202 2024-02-17T00:34:40.615 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 131/202 2024-02-17T00:34:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 131/202 2024-02-17T00:34:41.212 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 131/202 2024-02-17T00:34:41.256 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 132/202 2024-02-17T00:34:41.348 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 132/202 2024-02-17T00:34:41.348 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-17T00:34:41.348 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-17T00:34:41.348 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:41.390 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 133/202 2024-02-17T00:34:42.406 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-02-17T00:34:42.506 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-17T00:34:42.540 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-17T00:34:42.570 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T00:34:42.594 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T00:34:42.657 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-17T00:34:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-17T00:34:42.751 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-17T00:34:42.791 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-17T00:34:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-17T00:34:42.974 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-17T00:34:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-17T00:34:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 11/202 2024-02-17T00:34:43.483 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 11/202 2024-02-17T00:34:43.510 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 12/202 2024-02-17T00:34:43.599 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 12/202 2024-02-17T00:34:43.633 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rados-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 13/202 2024-02-17T00:34:43.803 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-17T00:34:43.850 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-17T00:34:43.886 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 16/202 2024-02-17T00:34:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 16/202 2024-02-17T00:34:44.021 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86 17/202 2024-02-17T00:34:44.085 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86 17/202 2024-02-17T00:34:44.116 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-17T00:34:44.139 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T00:34:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T00:34:44.355 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T00:34:44.396 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T00:34:44.435 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-17T00:34:44.601 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-17T00:34:44.721 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T00:34:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T00:34:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T00:34:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T00:34:45.130 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T00:34:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-17T00:34:45.346 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-17T00:34:45.380 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-17T00:34:45.450 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-17T00:34:45.504 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-17T00:34:45.533 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-17T00:34:45.569 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-17T00:34:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-17T00:34:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-17T00:34:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-17T00:34:45.760 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-17T00:34:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-17T00:34:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-17T00:34:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-17T00:34:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-common-2:19.0.0-1507.g2d9ecbfd.el9. 39/202 2024-02-17T00:34:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-argparse-2:19.0.0-1507.g2d9ecbfd.el 40/202 2024-02-17T00:34:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cephfs-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 41/202 2024-02-17T00:34:46.062 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-17T00:34:46.104 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-17T00:34:46.181 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-17T00:34:46.318 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-17T00:34:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-17T00:34:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-17T00:34:47.012 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-17T00:34:47.104 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-17T00:34:47.146 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T00:34:47.154 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T00:34:47.200 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-17T00:34:47.231 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librados-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 52/202 2024-02-17T00:34:47.266 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-17T00:34:47.375 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-17T00:34:47.439 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-17T00:34:47.738 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-17T00:34:47.926 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-17T00:34:48.000 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-17T00:34:48.045 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-17T00:34:48.200 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-17T00:34:48.248 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-17T00:34:48.482 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-17T00:34:48.556 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-17T00:34:48.607 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-17T00:34:48.644 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-17T00:34:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-17T00:34:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-17T00:34:48.770 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-17T00:34:48.812 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-17T00:34:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-17T00:34:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-17T00:34:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-17T00:34:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-17T00:34:49.161 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-17T00:34:49.196 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-17T00:34:49.228 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-17T00:34:49.253 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-17T00:34:49.278 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-17T00:34:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-17T00:34:49.492 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-17T00:34:49.599 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-17T00:34:49.645 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-17T00:34:49.702 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-17T00:34:49.758 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-17T00:34:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-17T00:34:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-17T00:34:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-17T00:34:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 88/202 2024-02-17T00:34:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-17T00:34:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-17T00:34:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-17T00:34:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-17T00:34:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-17T00:34:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-17T00:34:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-17T00:34:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-17T00:34:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-17T00:34:50.569 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-17T00:34:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-17T00:34:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-17T00:34:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-17T00:34:50.709 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-17T00:34:50.802 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-17T00:34:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-17T00:34:50.958 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-17T00:34:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-17T00:34:51.037 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-17T00:34:51.147 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-17T00:34:51.208 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-17T00:34:51.972 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-17T00:34:52.021 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-17T00:34:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-17T00:34:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-17T00:34:52.193 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-17T00:34:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-17T00:34:52.424 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-17T00:34:52.450 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-17T00:34:52.530 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-17T00:34:53.210 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-17T00:34:53.326 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 133/202 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-02-17T00:34:53.560 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-02-17T00:34:53.561 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-02-17T00:34:53.561 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:53.736 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 134/202 2024-02-17T00:34:53.753 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 134/202 2024-02-17T00:34:53.753 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:53.753 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-17T00:34:53.753 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:54.615 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-17T00:34:54.695 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-17T00:34:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-17T00:34:55.046 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-17T00:34:55.085 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 125/202 2024-02-17T00:34:55.176 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 125/202 2024-02-17T00:34:55.206 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 126/202 2024-02-17T00:34:55.243 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-17T00:34:55.273 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 135/202 2024-02-17T00:34:55.299 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 135/202 2024-02-17T00:34:55.299 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:55.299 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-17T00:34:55.299 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T00:34:55.299 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T00:34:55.299 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:55.515 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 136/202 2024-02-17T00:34:55.537 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 136/202 2024-02-17T00:34:55.537 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:55.537 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-17T00:34:55.538 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T00:34:55.538 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T00:34:55.538 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:55.724 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-17T00:34:55.754 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 129/202 2024-02-17T00:34:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 129/202 2024-02-17T00:34:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 130/202 2024-02-17T00:34:55.999 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 137/202 2024-02-17T00:34:56.021 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 137/202 2024-02-17T00:34:56.021 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:56.022 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-17T00:34:56.022 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T00:34:56.022 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T00:34:56.022 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:56.126 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-17T00:34:56.518 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 139/202 2024-02-17T00:34:56.549 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 139/202 2024-02-17T00:34:56.581 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1507.g2d9ecbfd.e 140/202 2024-02-17T00:34:56.643 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1507.g2d9ecbfd. 141/202 2024-02-17T00:34:56.672 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noa 142/202 2024-02-17T00:34:56.913 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noa 142/202 2024-02-17T00:34:56.939 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.n 143/202 2024-02-17T00:34:57.954 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.n 143/202 2024-02-17T00:34:57.973 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9 144/202 2024-02-17T00:34:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 131/202 2024-02-17T00:34:58.080 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9 144/202 2024-02-17T00:34:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 131/202 2024-02-17T00:34:58.252 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1507.g2d9ecbfd.el 145/202 2024-02-17T00:34:58.284 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 146/202 2024-02-17T00:34:58.307 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 146/202 2024-02-17T00:34:58.307 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:58.307 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-17T00:34:58.307 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T00:34:58.307 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T00:34:58.307 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:58.359 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 147/202 2024-02-17T00:34:58.370 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 147/202 2024-02-17T00:34:58.422 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 148/202 2024-02-17T00:34:58.653 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 131/202 2024-02-17T00:34:58.688 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 132/202 2024-02-17T00:34:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 132/202 2024-02-17T00:34:58.788 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-17T00:34:58.788 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-17T00:34:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:34:58.823 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 133/202 2024-02-17T00:34:59.332 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-17T00:34:59.361 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 150/202 2024-02-17T00:34:59.384 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 150/202 2024-02-17T00:34:59.384 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:59.384 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-17T00:34:59.384 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T00:34:59.384 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T00:34:59.384 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:59.429 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1507.g2d9ec 151/202 2024-02-17T00:34:59.451 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1507.g2d9ec 151/202 2024-02-17T00:34:59.451 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:59.451 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-17T00:34:59.451 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:59.504 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 152/202 2024-02-17T00:34:59.526 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 152/202 2024-02-17T00:34:59.526 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:59.527 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-17T00:34:59.527 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T00:34:59.527 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T00:34:59.527 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:34:59.847 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 153/202 2024-02-17T00:34:59.869 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 153/202 2024-02-17T00:34:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:34:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-17T00:34:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T00:34:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T00:34:59.869 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:04.568 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 154/202 2024-02-17T00:35:04.609 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 155/202 2024-02-17T00:35:04.639 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 156/202 2024-02-17T00:35:04.675 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-17T00:35:04.869 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 158/202 2024-02-17T00:35:04.986 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-17T00:35:05.032 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 160/202 2024-02-17T00:35:05.092 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-17T00:35:05.156 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-17T00:35:05.234 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-17T00:35:05.283 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-17T00:35:05.335 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-17T00:35:05.374 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_ 166/202 2024-02-17T00:35:05.404 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-17T00:35:05.485 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-17T00:35:05.531 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-17T00:35:05.585 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-17T00:35:06.209 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T00:35:06.250 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T00:35:06.270 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T00:35:07.162 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.0.0-1507.g2d9ecbfd.el9.noarch 172/202 2024-02-17T00:35:07.237 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-17T00:35:07.279 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-17T00:35:07.373 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-17T00:35:07.407 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-17T00:35:07.432 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-17T00:35:07.457 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-17T00:35:07.484 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-17T00:35:07.484 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T00:35:07.570 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T00:35:07.599 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-17T00:35:07.637 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-17T00:35:07.637 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T00:35:07.730 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T00:35:07.756 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-17T00:35:07.790 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-17T00:35:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-17T00:35:07.851 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-17T00:35:07.891 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-17T00:35:07.926 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-17T00:35:07.975 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-17T00:35:08.004 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-17T00:35:08.029 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-17T00:35:08.055 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-17T00:35:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-17T00:35:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-17T00:35:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T00:35:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T00:35:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T00:35:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T00:35:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T00:35:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-17T00:35:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-17T00:35:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-17T00:35:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-17T00:35:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 133/202 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /sys 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /proc 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /mnt 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /var/tmp 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /home 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /root 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /tmp 2024-02-17T00:35:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:11.285 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 134/202 2024-02-17T00:35:11.300 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 134/202 2024-02-17T00:35:11.300 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:11.301 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-17T00:35:11.301 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:12.821 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 135/202 2024-02-17T00:35:12.846 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 135/202 2024-02-17T00:35:12.847 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:12.847 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-17T00:35:12.847 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T00:35:12.847 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T00:35:12.847 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:13.063 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 136/202 2024-02-17T00:35:13.085 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 136/202 2024-02-17T00:35:13.085 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:13.085 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-17T00:35:13.085 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T00:35:13.085 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T00:35:13.085 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:13.474 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T00:35:13.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 1/202 2024-02-17T00:35:13.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2/202 2024-02-17T00:35:13.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 3/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 4/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1507.g2d9ec 5/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 6/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 7/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 8/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 9/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 10/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 11/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 12/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 13/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 14/202 2024-02-17T00:35:13.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_ 15/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 16/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 17/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 18/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86 19/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 20/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1507.g2d9ecbfd.el 21/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.0.0-1507.g2d9ecbfd.el9. 22/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 23/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 24/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 25/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 26/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 27/202 2024-02-17T00:35:13.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 28/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 29/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1507.g2d9ecbfd. 30/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noa 31/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.n 32/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9 33/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1507.g2d9ecbfd.el 34/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 35/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1507.g2d9ecbfd.e 36/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 37/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 38/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.0.0-1507.g2d9ecbfd.el9.noarch 39/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-17T00:35:13.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-17T00:35:13.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-17T00:35:13.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-17T00:35:13.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-17T00:35:13.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-17T00:35:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-17T00:35:13.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 116/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-17T00:35:13.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-17T00:35:13.485 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 151/202 2024-02-17T00:35:13.486 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 153/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-17T00:35:13.487 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-17T00:35:13.488 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-17T00:35:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-17T00:35:13.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-17T00:35:13.491 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-17T00:35:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 137/202 2024-02-17T00:35:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 137/202 2024-02-17T00:35:13.569 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:13.569 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-17T00:35:13.569 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T00:35:13.569 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T00:35:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-17T00:35:14.101 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 139/202 2024-02-17T00:35:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 139/202 2024-02-17T00:35:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1507.g2d9ecbfd.e 140/202 2024-02-17T00:35:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1507.g2d9ecbfd. 141/202 2024-02-17T00:35:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noa 142/202 2024-02-17T00:35:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noa 142/202 2024-02-17T00:35:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.n 143/202 2024-02-17T00:35:15.534 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.n 143/202 2024-02-17T00:35:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9 144/202 2024-02-17T00:35:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9 144/202 2024-02-17T00:35:15.841 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1507.g2d9ecbfd.el 145/202 2024-02-17T00:35:15.865 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 146/202 2024-02-17T00:35:15.887 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 146/202 2024-02-17T00:35:15.887 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:15.888 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-17T00:35:15.888 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T00:35:15.888 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T00:35:15.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:15.932 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 147/202 2024-02-17T00:35:15.942 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 147/202 2024-02-17T00:35:15.991 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 148/202 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: acl-2.3.1-4.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-17T00:35:16.319 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-17T00:35:16.320 INFO:teuthology.orchestra.run.smithi039.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-17T00:35:16.320 INFO:teuthology.orchestra.run.smithi039.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-17T00:35:16.320 INFO:teuthology.orchestra.run.smithi039.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-17T00:35:16.320 INFO:teuthology.orchestra.run.smithi039.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.323 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.324 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: jq-1.6-16.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-17T00:35:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-17T00:35:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.11-1.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-17T00:35:16.328 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-17T00:35:16.329 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-17T00:35:16.330 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-17T00:35:16.331 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-17T00:35:16.332 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-17T00:35:16.333 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-3.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-17T00:35:16.334 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:16.335 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-02-17T00:35:16.898 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-17T00:35:16.926 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 150/202 2024-02-17T00:35:16.948 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 150/202 2024-02-17T00:35:16.948 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:16.948 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-17T00:35:16.948 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T00:35:16.948 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T00:35:16.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:16.953 DEBUG:teuthology.parallel:result is None 2024-02-17T00:35:16.993 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1507.g2d9ec 151/202 2024-02-17T00:35:17.015 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1507.g2d9ec 151/202 2024-02-17T00:35:17.015 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:17.015 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-17T00:35:17.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:17.069 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 152/202 2024-02-17T00:35:17.091 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 152/202 2024-02-17T00:35:17.091 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:17.091 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-17T00:35:17.091 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T00:35:17.091 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T00:35:17.091 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:17.403 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 153/202 2024-02-17T00:35:17.425 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 153/202 2024-02-17T00:35:17.425 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T00:35:17.425 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-17T00:35:17.425 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T00:35:17.425 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T00:35:17.425 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-test-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 154/202 2024-02-17T00:35:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 155/202 2024-02-17T00:35:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-nbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 156/202 2024-02-17T00:35:22.215 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-17T00:35:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-shell-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 158/202 2024-02-17T00:35:22.526 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-17T00:35:22.570 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 160/202 2024-02-17T00:35:22.624 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-17T00:35:22.670 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-17T00:35:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-17T00:35:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-17T00:35:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-17T00:35:22.854 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_ 166/202 2024-02-17T00:35:22.884 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-17T00:35:22.954 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-17T00:35:23.010 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-17T00:35:23.057 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-17T00:35:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T00:35:23.688 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T00:35:23.708 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T00:35:24.577 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-top-2:19.0.0-1507.g2d9ecbfd.el9.noarch 172/202 2024-02-17T00:35:24.658 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-17T00:35:24.700 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-17T00:35:24.802 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-17T00:35:24.836 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-17T00:35:24.861 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-17T00:35:24.887 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-17T00:35:24.913 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-17T00:35:24.913 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T00:35:24.998 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T00:35:25.026 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-17T00:35:25.056 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-17T00:35:25.056 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T00:35:25.149 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T00:35:25.175 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-17T00:35:25.209 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-17T00:35:25.233 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-17T00:35:25.271 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-17T00:35:25.301 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-17T00:35:25.339 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-17T00:35:25.391 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-17T00:35:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-17T00:35:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-17T00:35:25.473 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-17T00:35:25.498 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-17T00:35:25.524 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-17T00:35:25.531 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T00:35:25.531 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T00:35:25.710 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T00:35:25.710 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T00:35:25.784 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T00:35:25.809 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-17T00:35:25.834 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-17T00:35:25.860 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-17T00:35:25.892 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-17T00:35:25.966 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T00:35:30.846 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 1/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 3/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 4/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1507.g2d9ec 5/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 6/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 7/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 8/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 9/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 10/202 2024-02-17T00:35:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 11/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-test-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 12/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 13/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-shell-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 14/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_ 15/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 16/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 17/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 18/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86 19/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 20/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1507.g2d9ecbfd.el 21/202 2024-02-17T00:35:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-common-2:19.0.0-1507.g2d9ecbfd.el9. 22/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cephfs-2:19.0.0-1507.g2d9ecbfd.el9.x86_6 23/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rados-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 24/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 25/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 26/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 27/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 28/202 2024-02-17T00:35:30.849 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-nbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 29/202 2024-02-17T00:35:30.865 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1507.g2d9ecbfd. 30/202 2024-02-17T00:35:30.865 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noa 31/202 2024-02-17T00:35:30.865 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.n 32/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9 33/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1507.g2d9ecbfd.el 34/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 35/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1507.g2d9ecbfd.e 36/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 37/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 38/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-top-2:19.0.0-1507.g2d9ecbfd.el9.noarch 39/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-17T00:35:30.866 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-17T00:35:30.867 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-17T00:35:30.868 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-17T00:35:30.869 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-17T00:35:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-17T00:35:30.871 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 116/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-17T00:35:30.872 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-17T00:35:30.873 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-17T00:35:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 151/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 153/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-17T00:35:30.875 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-17T00:35:30.876 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-17T00:35:30.877 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-17T00:35:30.878 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-17T00:35:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-17T00:35:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: acl-2.3.1-4.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-17T00:35:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: librados2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-17T00:35:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: automake-1.16.2-8.el9.noarch 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: bison-3.7.4-5.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-shell-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top-2:19.0.0-1507.g2d9ecbfd.el9.noarch 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: flex-2.6.4-9.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: jq-1.6-16.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-17T00:35:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-17T00:35:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: lua-5.4.4-4.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-13.11-1.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-17T00:35:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-17T00:35:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-17T00:35:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-17T00:35:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ply-3.11-14.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-17T00:35:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd-2:19.0.0-1507.g2d9ecbfd.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: re2-1:20211101-3.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-17T00:35:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-17T00:35:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-17T00:35:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-17T00:35:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:33.618 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-02-17T00:35:34.230 DEBUG:teuthology.parallel:result is None 2024-02-17T00:35:34.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2d9ecbfd71ad813d2904991462c430e98ff63b84 2024-02-17T00:35:34.372 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-17T00:35:34.394 INFO:teuthology.orchestra.run.smithi032.stdout:19.0.0-1507.g2d9ecbfd.el9 2024-02-17T00:35:34.394 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1507.g2d9ecbfd.el9 2024-02-17T00:35:34.394 INFO:teuthology.task.install:The correct ceph version 19.0.0-1507.g2d9ecbfd is installed. 2024-02-17T00:35:34.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2d9ecbfd71ad813d2904991462c430e98ff63b84 2024-02-17T00:35:34.535 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-17T00:35:34.561 INFO:teuthology.orchestra.run.smithi039.stdout:19.0.0-1507.g2d9ecbfd.el9 2024-02-17T00:35:34.561 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1507.g2d9ecbfd.el9 2024-02-17T00:35:34.561 INFO:teuthology.task.install:The correct ceph version 19.0.0-1507.g2d9ecbfd is installed. 2024-02-17T00:35:34.563 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-17T00:35:34.563 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:34.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T00:35:34.596 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:34.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T00:35:34.634 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-17T00:35:34.635 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:34.635 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T00:35:34.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T00:35:34.732 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:34.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T00:35:34.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T00:35:34.830 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-17T00:35:34.830 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:34.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T00:35:34.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T00:35:34.925 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:34.925 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T00:35:34.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T00:35:35.022 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-17T00:35:35.022 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:35.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T00:35:35.050 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T00:35:35.116 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:35.117 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T00:35:35.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T00:35:35.210 INFO:teuthology.run_tasks:Running task ceph... 2024-02-17T00:35:35.294 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-17T00:35:35.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-02-17T00:35:35.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2024-02-17T00:35:35.323 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-17T00:35:35.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T00:35:35.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T00:35:35.395 INFO:tasks.ceph:Creating extra log directories... 2024-02-17T00:35:35.395 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T00:35:35.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T00:35:35.468 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-17T00:35:35.468 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-17T00:35:35.468 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-17T00:35:35.468 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:35.468 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T00:35:35.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T00:35:35.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-17T00:35:35.655 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:35.655 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T00:35:35.669 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T00:35:35.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-17T00:35:35.819 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-17T00:35:35.820 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-17T00:35:35.820 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi/7563947', 'branch': 'wip-63945-ranks', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7563947', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-16_23:22:03-fs:functional-wip-63945-ranks-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-63945-ranks'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63945-ranks', 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2522, 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84', 'sleep_before_teardown': 0, 'subset': '740/1024', 'suite': 'fs:functional', 'suite_branch': 'wip-63945-ranks', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2d9ecbfd71ad813d2904991462c430e98ff63b84/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuP5jeEtz5E/zG0lhvvEZhi8dk4QL7Ut3age08Ni0SgoHH07jsRxbeSNiG6zflT6c2LewpRVEuMl//yhIfSjes=', 'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMl7lwzoGwkJScYuyNEXnhTAEauZ5DA4IMzbw3huURzX4L3TR+sqOWK1tvqgjj0RORaWFVez5iWMmnmfALo8s2I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2d9ecbfd71ad813d2904991462c430e98ff63b84', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-16_23:22:03', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-17T00:35:35.820 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T00:35:35.823 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T00:35:35.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T00:35:35.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T00:35:35.934 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:35.934 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T00:35:35.955 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T00:35:35.956 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-02-17 00:35:26.305153069 +0000 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-02-17 00:33:15.403292609 +0000 2024-02-17T00:35:36.010 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-02-17 00:33:15.403292609 +0000 2024-02-17T00:35:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-02-17 00:33:15.403292609 +0000 2024-02-17T00:35:36.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T00:35:36.074 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-02-17T00:35:36.074 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-02-17T00:35:36.074 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 9.551e-05 s, 5.4 MB/s 2024-02-17T00:35:36.075 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T00:35:36.131 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-02-17T00:35:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T00:35:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-02-17 00:35:26.305153069 +0000 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-02-17 00:33:15.744285318 +0000 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-02-17 00:33:15.744285318 +0000 2024-02-17T00:35:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-02-17 00:33:15.744285318 +0000 2024-02-17T00:35:36.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T00:35:36.250 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-02-17T00:35:36.250 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-02-17T00:35:36.251 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 8.0698e-05 s, 6.3 MB/s 2024-02-17T00:35:36.252 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T00:35:36.307 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-02-17 00:35:26.306153047 +0000 2024-02-17T00:35:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-02-17 00:33:16.064278478 +0000 2024-02-17T00:35:36.362 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-02-17 00:33:16.064278478 +0000 2024-02-17T00:35:36.362 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-02-17 00:33:16.064278478 +0000 2024-02-17T00:35:36.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T00:35:36.425 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-02-17T00:35:36.425 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-02-17T00:35:36.425 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 9.4601e-05 s, 5.4 MB/s 2024-02-17T00:35:36.427 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T00:35:36.482 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-02-17 00:35:26.306153047 +0000 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-02-17 00:33:16.386271595 +0000 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-02-17 00:33:16.386271595 +0000 2024-02-17T00:35:36.536 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-02-17 00:33:16.386271595 +0000 2024-02-17T00:35:36.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T00:35:36.600 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-02-17T00:35:36.600 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-02-17T00:35:36.600 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 8.5933e-05 s, 6.0 MB/s 2024-02-17T00:35:36.601 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T00:35:36.657 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:36.657 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:36.657 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T00:35:36.673 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T00:35:36.673 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-02-17 00:35:08.913977639 +0000 2024-02-17T00:35:36.728 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-02-17 00:33:15.423972576 +0000 2024-02-17T00:35:36.729 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-02-17 00:33:15.423972576 +0000 2024-02-17T00:35:36.729 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-02-17 00:33:15.423972576 +0000 2024-02-17T00:35:36.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T00:35:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-02-17T00:35:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-02-17T00:35:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000294122 s, 1.7 MB/s 2024-02-17T00:35:36.795 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T00:35:36.851 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-02-17T00:35:36.905 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-02-17 00:35:08.914977619 +0000 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-02-17 00:33:15.787965061 +0000 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-02-17 00:33:15.787965061 +0000 2024-02-17T00:35:36.906 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-02-17 00:33:15.787965061 +0000 2024-02-17T00:35:36.906 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T00:35:36.971 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-02-17T00:35:36.971 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-02-17T00:35:36.971 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000231668 s, 2.2 MB/s 2024-02-17T00:35:36.972 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T00:35:37.027 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-02-17T00:35:37.081 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-02-17 00:35:08.914977619 +0000 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-02-17 00:33:16.131957957 +0000 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-02-17 00:33:16.131957957 +0000 2024-02-17T00:35:37.082 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-02-17 00:33:16.131957957 +0000 2024-02-17T00:35:37.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T00:35:37.147 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-02-17T00:35:37.147 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-02-17T00:35:37.147 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000251677 s, 2.0 MB/s 2024-02-17T00:35:37.148 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T00:35:37.203 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-02-17T00:35:37.257 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T00:35:37.257 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T00:35:37.257 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-17T00:35:37.257 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T00:35:37.257 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T00:35:37.258 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-02-17 00:35:08.914977619 +0000 2024-02-17T00:35:37.258 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-02-17 00:33:16.472950917 +0000 2024-02-17T00:35:37.258 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-02-17 00:33:16.472950917 +0000 2024-02-17T00:35:37.258 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-02-17 00:33:16.472950917 +0000 2024-02-17T00:35:37.258 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T00:35:37.321 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-02-17T00:35:37.322 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-02-17T00:35:37.322 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000259953 s, 2.0 MB/s 2024-02-17T00:35:37.323 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T00:35:37.378 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:37.378 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T00:35:37.378 INFO:tasks.ceph:Generating config... 2024-02-17T00:35:37.379 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-17T00:35:37.379 INFO:tasks.ceph:[client] debug client = 20 2024-02-17T00:35:37.379 INFO:tasks.ceph:[client] debug ms = 1 2024-02-17T00:35:37.379 INFO:tasks.ceph:[client] pid file = 2024-02-17T00:35:37.380 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-17T00:35:37.380 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-17T00:35:37.380 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-17T00:35:37.380 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-17T00:35:37.381 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-17T00:35:37.381 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-17T00:35:37.381 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-17T00:35:37.381 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-17T00:35:37.381 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-17T00:35:37.381 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-17T00:35:37.382 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-17T00:35:37.382 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-17T00:35:37.382 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-17T00:35:37.382 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-17T00:35:37.382 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-17T00:35:37.382 INFO:tasks.ceph:Setting up mon.a... 2024-02-17T00:35:37.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-17T00:35:37.435 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-02-17T00:35:37.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-17T00:35:37.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T00:35:37.511 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.39'), ('mon.c', '[v2:172.21.15.39:3301,v1:172.21.15.39:6790]')] 2024-02-17T00:35:37.512 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-17T00:35:37.512 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:37.512 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T00:35:37.566 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.39 --addv c '[v2:172.21.15.39:3301,v1:172.21.15.39:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid 2fde0ac4-9f5d-41d6-aea9-1575265f7f65 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = quincy 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:fsid 2fde0ac4-9f5d-41d6-aea9-1575265f7f65 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-02-17T00:35:37.650015+0000 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-02-17T00:35:37.650015+0000 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 17 (quincy) 2024-02-17T00:35:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2024-02-17T00:35:37.653 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-02-17T00:35:37.653 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.b 2024-02-17T00:35:37.653 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-02-17T00:35:37.653 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-17T00:35:37.654 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T00:35:37.668 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2fde0ac4-9f5d-41d6-aea9-1575265f7f65... 2024-02-17T00:35:37.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T00:35:37.710 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-02-17T00:35:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-02-17T00:35:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790]" 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on skipped message = False 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = 2fde0ac4-9f5d-41d6-aea9-1575265f7f65 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-02-17T00:35:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-02-17T00:35:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-02-17T00:35:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 20 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 20 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 10 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-02-17T00:35:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-02-17T00:35:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T00:35:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T00:35:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = "" 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-02-17T00:35:37.768 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-02-17T00:35:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.770 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2024-02-17T00:35:37.771 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T00:35:37.772 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.32,172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790]" 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on skipped message = False 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 2fde0ac4-9f5d-41d6-aea9-1575265f7f65 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2024-02-17T00:35:37.773 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd mclock profile = high_recovery_ops 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug trim objects = true 2024-02-17T00:35:37.774 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2024-02-17T00:35:37.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 20 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 20 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 10 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2024-02-17T00:35:37.776 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.777 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T00:35:37.778 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2024-02-17T00:35:37.779 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = "" 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2024-02-17T00:35:37.780 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds balancer = 20 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2024-02-17T00:35:37.781 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2024-02-17T00:35:37.782 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2024-02-17T00:35:37.782 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2024-02-17T00:35:37.782 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2024-02-17T00:35:37.783 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-17T00:35:37.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-17T00:35:37.877 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-17T00:35:37.877 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:37.877 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-17T00:35:37.892 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:37.892 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-17T00:35:37.946 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:35:37.946 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:37.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T00:35:37.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T00:35:38.024 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:35:38.024 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:38.078 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:35:38.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:38.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T00:35:38.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T00:35:38.118 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:35:38.118 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:38.172 INFO:tasks.ceph:Setting up mon nodes... 2024-02-17T00:35:38.173 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-17T00:35:38.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T00:35:38.227 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T00:35:38.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T00:35:38.292 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T00:35:38.295 INFO:tasks.ceph:Setting up mds nodes... 2024-02-17T00:35:38.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T00:35:38.349 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T00:35:38.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-17T00:35:38.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-17T00:35:38.471 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-17T00:35:38.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-17T00:35:38.499 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T00:35:38.554 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T00:35:38.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-17T00:35:38.583 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-17T00:35:38.677 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-17T00:35:38.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-17T00:35:38.706 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-17T00:35:38.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-17T00:35:38.748 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-17T00:35:38.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-02-17T00:35:38.844 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-02-17T00:35:38.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-17T00:35:38.902 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-17T00:35:38.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-02-17T00:35:38.998 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-02-17T00:35:39.013 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-17T00:35:39.014 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T00:35:39.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-17T00:35:39.040 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:39.040 INFO:tasks.ceph:role: osd.0 2024-02-17T00:35:39.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:35:39.041 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T00:35:39.107 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:39.107 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:39.107 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:39.107 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:39.107 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:39.107 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:39.108 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:39.108 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:39.108 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:39.108 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:39.146 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-02-17T00:35:39.148 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-02-17T00:35:39.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-17T00:35:39.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-17T00:35:39.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-17T00:35:39.356 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:39.356 INFO:tasks.ceph:role: osd.1 2024-02-17T00:35:39.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:35:39.357 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:39.423 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:39.461 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-02-17T00:35:39.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-02-17T00:35:39.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-17T00:35:39.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-17T00:35:39.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-17T00:35:39.671 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:39.671 INFO:tasks.ceph:role: osd.2 2024-02-17T00:35:39.672 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:35:39.672 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:39.738 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:39.776 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-02-17T00:35:39.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-02-17T00:35:39.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-17T00:35:39.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-17T00:35:39.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-17T00:35:39.989 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:39.989 INFO:tasks.ceph:role: osd.3 2024-02-17T00:35:39.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:35:39.990 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T00:35:40.055 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:40.056 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:40.098 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-02-17T00:35:40.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-02-17T00:35:40.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-17T00:35:40.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-17T00:35:40.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:40.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:40.330+0000 7f1bf3e17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-17T00:35:40.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:40.330+0000 7f1bf3e17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-17T00:35:40.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:40.330+0000 7f1bf3e17640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T00:35:40.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:40.330+0000 7f1bf3e17640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T00:35:40.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:40.330+0000 7f1bf3e17640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T00:35:40.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:40.331+0000 7f1bf3e17640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-17T00:35:43.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-17T00:35:43.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:43.308+0000 7fdd9f60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-17T00:35:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:43.308+0000 7fdd9f60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-17T00:35:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:43.308+0000 7fdd9f60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T00:35:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:43.308+0000 7fdd9f60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T00:35:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:43.308+0000 7fdd9f60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T00:35:43.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:43.308+0000 7fdd9f60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-17T00:35:46.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-17T00:35:46.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:46.279+0000 7f6c9ade1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-17T00:35:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:46.280+0000 7f6c9ade1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-17T00:35:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:46.280+0000 7f6c9ade1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T00:35:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:46.280+0000 7f6c9ade1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T00:35:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:46.280+0000 7f6c9ade1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T00:35:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:46.280+0000 7f6c9ade1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-17T00:35:49.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-17T00:35:49.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:49.248+0000 7fb0bde8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-17T00:35:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:49.249+0000 7fb0bde8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-17T00:35:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:49.249+0000 7fb0bde8b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T00:35:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:49.249+0000 7fb0bde8b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T00:35:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:49.249+0000 7fb0bde8b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T00:35:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:35:49.249+0000 7fb0bde8b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-17T00:35:52.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-17T00:35:52.136 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-17T00:35:52.167 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:52.167 INFO:tasks.ceph:role: osd.4 2024-02-17T00:35:52.167 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:35:52.168 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T00:35:52.265 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:52.265 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:52.265 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:52.265 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:52.265 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:52.266 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:52.266 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:52.266 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:52.266 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:52.266 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:53.596 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-02-17T00:35:53.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-02-17T00:35:53.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-17T00:35:53.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-17T00:35:53.710 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-17T00:35:53.779 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:53.779 INFO:tasks.ceph:role: osd.5 2024-02-17T00:35:53.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:35:53.779 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:53.875 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:55.226 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-02-17T00:35:55.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-02-17T00:35:55.228 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-17T00:35:55.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-17T00:35:55.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-17T00:35:55.398 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:55.398 INFO:tasks.ceph:role: osd.6 2024-02-17T00:35:55.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:35:55.399 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T00:35:55.493 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:55.493 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:55.493 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:55.493 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:55.493 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:55.493 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:55.494 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:55.494 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:55.494 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:55.494 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:56.820 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-02-17T00:35:56.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-02-17T00:35:56.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-17T00:35:56.856 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-17T00:35:56.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-17T00:35:56.999 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T00:35:56.999 INFO:tasks.ceph:role: osd.7 2024-02-17T00:35:56.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:35:56.999 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T00:35:57.093 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T00:35:57.094 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T00:35:57.094 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T00:35:58.421 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-02-17T00:35:58.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-02-17T00:35:58.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-17T00:35:58.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-17T00:35:58.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:35:58.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:35:58.666+0000 7f1f92d49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-17T00:35:58.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:35:58.666+0000 7f1f92d49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-17T00:35:58.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:35:58.666+0000 7f1f92d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T00:35:58.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:35:58.666+0000 7f1f92d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T00:35:58.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:35:58.666+0000 7f1f92d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T00:35:58.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:35:58.667+0000 7f1f92d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-17T00:36:01.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T00:36:01.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:36:01.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:01.661+0000 7f070d7ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-17T00:36:01.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:01.661+0000 7f070d7ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-17T00:36:01.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:01.661+0000 7f070d7ac640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T00:36:01.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:01.662+0000 7f070d7ac640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T00:36:01.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:01.662+0000 7f070d7ac640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T00:36:01.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:01.662+0000 7f070d7ac640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-17T00:36:04.538 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T00:36:04.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:36:04.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:04.658+0000 7f1b3481d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-17T00:36:04.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:04.658+0000 7f1b3481d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-17T00:36:04.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:04.658+0000 7f1b3481d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T00:36:04.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:04.658+0000 7f1b3481d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T00:36:04.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:04.658+0000 7f1b3481d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T00:36:04.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:04.659+0000 7f1b3481d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-17T00:36:05.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:36:05.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:36:07.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T00:36:07.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:36:07.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:07.635+0000 7f82d8b0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-17T00:36:07.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:07.635+0000 7f82d8b0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-17T00:36:07.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:07.635+0000 7f82d8b0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T00:36:07.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:07.635+0000 7f82d8b0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T00:36:07.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:07.635+0000 7f82d8b0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T00:36:07.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:07.636+0000 7f82d8b0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-17T00:36:10.514 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T00:36:10.545 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-17T00:36:10.546 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-17T00:36:10.578 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-17T00:36:10.648 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-17T00:36:10.718 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-17T00:36:10.786 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.787 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-17T00:36:10.856 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-17T00:36:10.924 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:10.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-17T00:36:10.993 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:10.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-17T00:36:11.031 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-17T00:36:11.104 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.105 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-17T00:36:11.178 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-17T00:36:11.251 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.251 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-17T00:36:11.321 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-17T00:36:11.390 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-17T00:36:11.460 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:11.460 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-17T00:36:11.478 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:11.478 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-02-17T00:36:11.540 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.540 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-17T00:36:11.555 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:11.555 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-02-17T00:36:11.611 INFO:tasks.ceph:Adding keys to all mons... 2024-02-17T00:36:11.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T00:36:11.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89lvUxrDRAAGRnH8exeUjS90x4Dw/NxWA== 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89luT60FBAACthasFjhnFChyKMSS3MskA== 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89ld438GxAAqW6CSaY9UcKfq38q28NKUg== 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBc/89ltvzDExAACpG/oEDrCrL0/5HkzTt5fQ== 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBf/89lXoNsEhAAfd2thZPGsLN+lfJtUXB5EQ== 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBi/89lTZ/AEBAAOAphY2NxD8gEPkpPlUQ5HQ== 2024-02-17T00:36:11.655 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBl/89ld9TlDhAAJURgbg8EzrWugIZ3+t3/xA== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89lNL1TERAApfb2c4j6nVv+jnjqqjy/zg== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89lHQfuIBAATo9oNCL+tXMzDXjatp213Q== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89lu1FJKBAAb9SXwFLj5s6pwx9oXtutaQ== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBu/89lV1LRJxAASoWYGuHHUbTMJ0pifcA6vg== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBx/89lWMuFJxAAEl+b5NJDQL4e/yZF0L6QYw== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQB0/89ltXtQJxAAN3dwJgmA9VyxB0X7+8VqHA== 2024-02-17T00:36:11.656 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQB3/89lYQr3JRAAXb58aelKNQ5x9LseH/cBrw== 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89lSZN9LBAAKBrV6Z7gz+HGueThsfRO3A== 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout:[client.2] 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89l8cA8MhAAmLEjJVHu/rnY5NGLkqkeaw== 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89liUqxNRAAZbwGTF9WriqsSyimJ3gV6g== 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout:[client.3] 2024-02-17T00:36:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89ljs1sOxAAhLdK2gxRAkddsZAKcJdMXQ== 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89lvUxrDRAAGRnH8exeUjS90x4Dw/NxWA== 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89luT60FBAACthasFjhnFChyKMSS3MskA== 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89ld438GxAAqW6CSaY9UcKfq38q28NKUg== 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2024-02-17T00:36:11.677 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBc/89ltvzDExAACpG/oEDrCrL0/5HkzTt5fQ== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBf/89lXoNsEhAAfd2thZPGsLN+lfJtUXB5EQ== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBi/89lTZ/AEBAAOAphY2NxD8gEPkpPlUQ5HQ== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBl/89ld9TlDhAAJURgbg8EzrWugIZ3+t3/xA== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89lNL1TERAApfb2c4j6nVv+jnjqqjy/zg== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89lHQfuIBAATo9oNCL+tXMzDXjatp213Q== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89lu1FJKBAAb9SXwFLj5s6pwx9oXtutaQ== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBu/89lV1LRJxAASoWYGuHHUbTMJ0pifcA6vg== 2024-02-17T00:36:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBx/89lWMuFJxAAEl+b5NJDQL4e/yZF0L6QYw== 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQB0/89ltXtQJxAAN3dwJgmA9VyxB0X7+8VqHA== 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQB3/89lYQr3JRAAXb58aelKNQ5x9LseH/cBrw== 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89lSZN9LBAAKBrV6Z7gz+HGueThsfRO3A== 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:[client.2] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89l8cA8MhAAmLEjJVHu/rnY5NGLkqkeaw== 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89liUqxNRAAZbwGTF9WriqsSyimJ3gV6g== 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:[client.3] 2024-02-17T00:36:11.679 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBa/89ljs1sOxAAhLdK2gxRAkddsZAKcJdMXQ== 2024-02-17T00:36:11.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T00:36:11.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T00:36:11.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:11.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:11.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:11.834 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:11.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:11.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:11.943 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:11.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:11.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.000 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T00:36:12.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T00:36:12.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:12.159 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:12.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:12.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T00:36:12.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.272 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T00:36:12.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T00:36:12.714 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-17T00:36:12.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-17T00:36:12.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T00:36:12.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-17T00:36:12.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-17T00:36:12.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T00:36:13.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-17T00:36:13.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-17T00:36:13.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T00:36:13.203 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-17T00:36:13.230 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:36:13.232 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T00:36:13.284 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-17T00:36:13.285 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-17T00:36:13.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-17T00:36:13.287 INFO:tasks.ceph.mon.a:Started 2024-02-17T00:36:13.287 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-17T00:36:13.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-17T00:36:13.326 INFO:tasks.ceph.mon.b:Started 2024-02-17T00:36:13.327 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-17T00:36:13.327 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-17T00:36:13.329 INFO:tasks.ceph.mon.c:Started 2024-02-17T00:36:13.329 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-17T00:36:13.329 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-17T00:36:13.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-17T00:36:13.332 INFO:tasks.ceph.mgr.y:Started 2024-02-17T00:36:13.332 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-17T00:36:13.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-17T00:36:13.334 INFO:tasks.ceph.mgr.x:Started 2024-02-17T00:36:13.334 INFO:tasks.ceph:Setting crush tunables to default 2024-02-17T00:36:13.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-02-17T00:36:13.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.433+0000 7f8aa824e640 1 Processor -- start 2024-02-17T00:36:13.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.433+0000 7f8aa824e640 1 -- start start 2024-02-17T00:36:13.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa824e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8aa00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa824e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa015bd80 con 0x7f8aa00b2d40 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa824e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa015ac30 con 0x7f8aa00cd660 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa824e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00ce290 con 0x7f8aa015a850 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa57e9640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8aa00b2d40 0x7f8aa00ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47492/0 (socket says 172.21.15.32:47492) 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa57e9640 1 -- 172.21.15.32:0/4181819662 learned_addr learned my addr 172.21.15.32:0/4181819662 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa5fea640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8aa00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa5fea640 1 -- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 msgr2=0x7f8aa00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa5fea640 1 -- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 msgr2=0x7f8aa00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa5fea640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8aa00b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T00:36:13.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.434+0000 7f8aa5fea640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8aa00b2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T00:36:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19582555 0 0) 0x7f8aa015bd80 con 0x7f8aa00b2d40 2024-02-17T00:36:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a8c003520 con 0x7f8aa00b2d40 2024-02-17T00:36:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925641065 0 0) 0x7f8aa015ac30 con 0x7f8aa00cd660 2024-02-17T00:36:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa015bd80 con 0x7f8aa00cd660 2024-02-17T00:36:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013675390 0 0) 0x7f8aa015bd80 con 0x7f8aa00cd660 2024-02-17T00:36:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 msgr2=0x7f8aa00b2800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8aa00b2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 >> v1:172.21.15.32:6789/0 conn(0x7f8aa00b2d40 legacy=0x7f8aa00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00ce570 con 0x7f8aa00cd660 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.632+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f8a980019f0 con 0x7f8aa00cd660 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 >> v1:172.21.15.39:6789/0 conn(0x7f8aa00cd660 legacy=0x7f8aa00cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8a8c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a8c004060 0x7f8a8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004d00 0x7f8a8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00ce290 con 0x7f8a8c004060 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c00bae0 con 0x7f8a8c004d00 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c00bca0 con 0x7f8aa015a850 2024-02-17T00:36:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa57e9640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a8c004060 0x7f8a8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa67eb640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004d00 0x7f8a8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa5fea640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8a8c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa57e9640 1 -- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 msgr2=0x7f8a8c003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa57e9640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa015a850 0x7f8a8c003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa57e9640 1 -- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004d00 msgr2=0x7f8a8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa57e9640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004d00 0x7f8a8c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.633+0000 7f8aa57e9640 1 -- 172.21.15.32:0/4181819662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa015bd80 con 0x7f8a8c004060 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.634+0000 7f8aa57e9640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a8c004060 0x7f8a8c0047c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8a900019c0 tx=0x7f8a8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d657c900e38cda server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.635+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90004aa0 con 0x7f8a8c004060 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.635+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90004c00 con 0x7f8a8c004060 2024-02-17T00:36:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.635+0000 7f8aa4fe8640 1 -- 172.21.15.32:0/4181819662 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007070 con 0x7f8a8c004060 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa824e640 1 -- 172.21.15.32:0/4181819662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a8c004060 msgr2=0x7f8a8c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa824e640 1 --2- 172.21.15.32:0/4181819662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a8c004060 0x7f8a8c0047c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8a900019c0 tx=0x7f8a8c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa67eb640 1 -- 172.21.15.32:0/4181819662 reap_dead start 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa824e640 1 -- 172.21.15.32:0/4181819662 shutdown_connections 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa824e640 1 -- 172.21.15.32:0/4181819662 >> 172.21.15.32:0/4181819662 conn(0x7f8aa00999f0 msgr2=0x7f8aa00b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa824e640 1 -- 172.21.15.32:0/4181819662 shutdown_connections 2024-02-17T00:36:13.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.636+0000 7f8aa824e640 1 -- 172.21.15.32:0/4181819662 wait complete. 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.637+0000 7f8aa824e640 1 Processor -- start 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.637+0000 7f8aa824e640 1 -- start start 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa824e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004060 0x7f8aa00b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa824e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 0x7f8aa01e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa824e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa00b5700 0x7f8aa01e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa824e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00b5c80 con 0x7f8aa0153b50 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa824e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00b5f60 con 0x7f8a8c004060 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa824e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00c7610 con 0x7f8aa00b5700 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa57e9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 0x7f8aa01e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa57e9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 0x7f8aa01e2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33706/0 (socket says 172.21.15.32:33706) 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa5fea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004060 0x7f8aa00b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa57e9640 1 -- 172.21.15.32:0/1574009130 learned_addr learned my addr 172.21.15.32:0/1574009130 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:13.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.638+0000 7f8aa67eb640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa00b5700 0x7f8aa01e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa67eb640 1 -- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004060 msgr2=0x7f8aa00b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa67eb640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004060 0x7f8aa00b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa67eb640 1 -- 172.21.15.32:0/1574009130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 msgr2=0x7f8aa01e2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa67eb640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 0x7f8aa01e2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa67eb640 1 -- 172.21.15.32:0/1574009130 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00c78f0 con 0x7f8aa00b5700 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa57e9640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 0x7f8aa01e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.639+0000 7f8aa67eb640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa00b5700 0x7f8aa01e3500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00be30 tx=0x7f8a98001ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98015040 con 0x7f8aa00b5700 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa00c7bd0 con 0x7f8aa00b5700 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa01537c0 con 0x7f8aa00b5700 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a98006e20 con 0x7f8aa00b5700 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98013ee0 con 0x7f8aa00b5700 2024-02-17T00:36:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8a98003d00 con 0x7f8aa00b5700 2024-02-17T00:36:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.640+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8a98007660 con 0x7f8aa00b5700 2024-02-17T00:36:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.641+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa00cff60 con 0x7f8aa00b5700 2024-02-17T00:36:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.643+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8a98007870 con 0x7f8aa00b5700 2024-02-17T00:36:13.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.754+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8aa0068f60 con 0x7f8aa00b5700 2024-02-17T00:36:13.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.759+0000 7f8a967fc640 1 -- 172.21.15.32:0/1574009130 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8a98007a10 con 0x7f8aa00b5700 2024-02-17T00:36:13.763 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-02-17T00:36:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa00b5700 msgr2=0x7f8aa01e3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa00b5700 0x7f8aa01e3500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00be30 tx=0x7f8a98001ae0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 shutdown_connections 2024-02-17T00:36:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8aa00b5700 0x7f8aa01e3500 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa0153b50 0x7f8aa01e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 --2- 172.21.15.32:0/1574009130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c004060 0x7f8aa00b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:13.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 >> 172.21.15.32:0/1574009130 conn(0x7f8aa00999f0 msgr2=0x7f8aa015afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:13.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 shutdown_connections 2024-02-17T00:36:13.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:13.760+0000 7f8aa824e640 1 -- 172.21.15.32:0/1574009130 wait complete. 2024-02-17T00:36:13.774 INFO:tasks.ceph:check_enable_crimson: False 2024-02-17T00:36:13.774 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-17T00:36:13.774 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:13.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-17T00:36:13.800 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:13.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-17T00:36:13.867 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:13.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-17T00:36:13.933 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:13.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-17T00:36:14.001 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:14.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-17T00:36:14.028 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:14.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-17T00:36:14.095 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:14.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-17T00:36:14.114 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.110+0000 7f6cd8846040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T00:36:14.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:36:14.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-17T00:36:14.153 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.150+0000 7f4867df1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T00:36:14.171 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.167+0000 7f6cd8846040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T00:36:14.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new bfb4a088-5364-41fe-906d-67bc52745b4d 0 2024-02-17T00:36:14.209 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.206+0000 7f4867df1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T00:36:14.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.336+0000 7fc5b8bf4640 1 Processor -- start 2024-02-17T00:36:14.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.336+0000 7fc5b8bf4640 1 -- start start 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b8bf4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc5b40d0210 0x7fc5b40999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b8bf4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b8bf4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b40cf200 con 0x7fc5b415ba40 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b8bf4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b409a3c0 con 0x7fc5b40d0210 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b8bf4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40d0650 con 0x7fc5b4099f30 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33508/0 (socket says 172.21.15.39:33508) 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 -- 172.21.15.39:0/4115379044 learned_addr learned my addr 172.21.15.39:0/4115379044 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b1d9b640 1 --2- 172.21.15.39:0/4115379044 >> v2:172.21.15.32:3300/0 conn(0x7fc5b40d0210 0x7fc5b40999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 -- 172.21.15.39:0/4115379044 >> v2:172.21.15.32:3300/0 conn(0x7fc5b40d0210 msgr2=0x7fc5b40999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:14.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 --2- 172.21.15.39:0/4115379044 >> v2:172.21.15.32:3300/0 conn(0x7fc5b40d0210 0x7fc5b40999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 -- 172.21.15.39:0/4115379044 >> v1:172.21.15.32:6789/0 conn(0x7fc5b415ba40 legacy=0x7fc5b40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.337+0000 7fc5b2d9d640 1 -- 172.21.15.39:0/4115379044 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40cf450 con 0x7fc5b4099f30 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.338+0000 7fc5b2d9d640 1 --2- 172.21.15.39:0/4115379044 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b0f90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009e50 tx=0x7fc5ac02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b759d67ff8e12a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.338+0000 7fc5b159a640 1 -- 172.21.15.39:0/4115379044 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac02cb00 con 0x7fc5b4099f30 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.338+0000 7fc5b159a640 1 -- 172.21.15.39:0/4115379044 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac02cc60 con 0x7fc5b4099f30 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.338+0000 7fc5b159a640 1 -- 172.21.15.39:0/4115379044 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac0343f0 con 0x7fc5b4099f30 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/4115379044 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 msgr2=0x7fc5b40b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/4115379044 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b0f90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009e50 tx=0x7fc5ac02bf60 comp rx=0 tx=0).stop 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/4115379044 shutdown_connections 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/4115379044 >> v2:172.21.15.32:3300/0 conn(0x7fc5b40d0210 0x7fc5b40999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/4115379044 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b0f90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/4115379044 >> 172.21.15.39:0/4115379044 conn(0x7fc5b40b3120 msgr2=0x7fc5b40b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/4115379044 shutdown_connections 2024-02-17T00:36:14.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.339+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/4115379044 wait complete. 2024-02-17T00:36:14.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.340+0000 7fc5b8bf4640 1 Processor -- start 2024-02-17T00:36:14.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.340+0000 7fc5b8bf4640 1 -- start start 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b8bf4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b8bf4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b40d0210 0x7fc5b414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b8bf4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b415ba40 0x7fc5b40af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b8bf4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40c6330 con 0x7fc5b40d0210 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b8bf4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40b7300 con 0x7fc5b415ba40 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b8bf4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b415c220 con 0x7fc5b4099f30 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33514/0 (socket says 172.21.15.39:33514) 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 -- 172.21.15.39:0/2640313661 learned_addr learned my addr 172.21.15.39:0/2640313661 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b2d9d640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b415ba40 0x7fc5b40af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b1d9b640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b40d0210 0x7fc5b414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 -- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b415ba40 msgr2=0x7fc5b40af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b415ba40 0x7fc5b40af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 -- 172.21.15.39:0/2640313661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b40d0210 msgr2=0x7fc5b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b40d0210 0x7fc5b414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 -- 172.21.15.39:0/2640313661 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009b30 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b2d9d640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b415ba40 0x7fc5b40af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5b259c640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b4250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c3c0 tx=0x7fc5a400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.341+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40052d0 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.342+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4005450 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.342+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b415c500 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.342+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4007260 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.342+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b415cac0 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.342+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc5a40073c0 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.342+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc5a40039d0 con 0x7fc5b4099f30 2024-02-17T00:36:14.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.343+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b4068f60 con 0x7fc5b4099f30 2024-02-17T00:36:14.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.345+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc5a4020060 con 0x7fc5b4099f30 2024-02-17T00:36:14.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.418+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bfb4a088-5364-41fe-906d-67bc52745b4d", "id": 0} v 0) v1 -- 0x7fc5b40d0960 con 0x7fc5b4099f30 2024-02-17T00:36:14.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.423+0000 7fc5a2ffd640 1 -- 172.21.15.39:0/2640313661 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfb4a088-5364-41fe-906d-67bc52745b4d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5a4003be0 con 0x7fc5b4099f30 2024-02-17T00:36:14.427 INFO:teuthology.orchestra.run.smithi039.stdout:0 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 msgr2=0x7fc5b40b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b4250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c3c0 tx=0x7fc5a400c880 comp rx=0 tx=0).stop 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 shutdown_connections 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b415ba40 0x7fc5b40af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b40d0210 0x7fc5b414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 --2- 172.21.15.39:0/2640313661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc5b4099f30 0x7fc5b40b4250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 >> 172.21.15.39:0/2640313661 conn(0x7fc5b40b3120 msgr2=0x7fc5b415f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 shutdown_connections 2024-02-17T00:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.424+0000 7fc5b8bf4640 1 -- 172.21.15.39:0/2640313661 wait complete. 2024-02-17T00:36:14.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new 16bdb24b-1c4a-47f7-874c-3d6fd0655717 1 2024-02-17T00:36:14.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.536+0000 7ff075d2e640 1 Processor -- start 2024-02-17T00:36:14.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.536+0000 7ff075d2e640 1 -- start start 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff075d2e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff0700cf760 0x7ff0700ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff075d2e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0700cdc60 0x7ff0700ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff075d2e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07006ab60 con 0x7ff07015b820 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff075d2e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07006c560 con 0x7ff0700cdc60 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff075d2e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff070066d70 con 0x7ff0700cf760 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff0700cf760 0x7ff0700ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff0700cf760 0x7ff0700ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36394/0 (socket says 172.21.15.39:36394) 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 -- 172.21.15.39:0/356927280 learned_addr learned my addr 172.21.15.39:0/356927280 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06ffff640 1 --2- 172.21.15.39:0/356927280 >> v2:172.21.15.32:3300/0 conn(0x7ff0700cdc60 0x7ff0700ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 -- 172.21.15.39:0/356927280 >> v2:172.21.15.32:3300/0 conn(0x7ff0700cdc60 msgr2=0x7ff0700ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:14.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 --2- 172.21.15.39:0/356927280 >> v2:172.21.15.32:3300/0 conn(0x7ff0700cdc60 0x7ff0700ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 -- 172.21.15.39:0/356927280 >> v1:172.21.15.32:6789/0 conn(0x7ff07015b820 legacy=0x7ff07006be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06effd640 1 -- 172.21.15.39:0/356927280 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07006adb0 con 0x7ff0700cf760 2024-02-17T00:36:14.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.537+0000 7ff06ffff640 1 --2- 172.21.15.39:0/356927280 >> v2:172.21.15.32:3300/0 conn(0x7ff0700cdc60 0x7ff0700ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.538+0000 7ff06effd640 1 --2- 172.21.15.39:0/356927280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cf760 0x7ff0700ca440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff0700d0e20 tx=0x7ff06002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e3851dcce33b23 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.538+0000 7ff06e7fc640 1 -- 172.21.15.39:0/356927280 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060030860 con 0x7ff0700cf760 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.538+0000 7ff06e7fc640 1 -- 172.21.15.39:0/356927280 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0600309c0 con 0x7ff0700cf760 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.538+0000 7ff06e7fc640 1 -- 172.21.15.39:0/356927280 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060030d50 con 0x7ff0700cf760 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 -- 172.21.15.39:0/356927280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cf760 msgr2=0x7ff0700ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 --2- 172.21.15.39:0/356927280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cf760 0x7ff0700ca440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff0700d0e20 tx=0x7ff06002b9a0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 -- 172.21.15.39:0/356927280 shutdown_connections 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 --2- 172.21.15.39:0/356927280 >> v2:172.21.15.32:3300/0 conn(0x7ff0700cdc60 0x7ff0700ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 --2- 172.21.15.39:0/356927280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cf760 0x7ff0700ca440 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 -- 172.21.15.39:0/356927280 >> 172.21.15.39:0/356927280 conn(0x7ff0700cc870 msgr2=0x7ff0700ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 -- 172.21.15.39:0/356927280 shutdown_connections 2024-02-17T00:36:14.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.539+0000 7ff075d2e640 1 -- 172.21.15.39:0/356927280 wait complete. 2024-02-17T00:36:14.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.540+0000 7ff075d2e640 1 Processor -- start 2024-02-17T00:36:14.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.540+0000 7ff075d2e640 1 -- start start 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.541+0000 7ff075d2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 0x7ff07014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.541+0000 7ff075d2e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0700cf760 0x7ff070153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff075d2e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff07015b820 0x7ff0700ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff075d2e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700b4400 con 0x7ff07015b820 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff075d2e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700b4600 con 0x7ff0700cdc60 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff075d2e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700b48e0 con 0x7ff0700cf760 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 0x7ff07014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06effd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0700cf760 0x7ff070153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 0x7ff07014f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36396/0 (socket says 172.21.15.39:36396) 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 -- 172.21.15.39:0/3921567848 learned_addr learned my addr 172.21.15.39:0/3921567848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06ffff640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff07015b820 0x7ff0700ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 -- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0700cf760 msgr2=0x7ff070153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0700cf760 0x7ff070153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 -- 172.21.15.39:0/3921567848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff07015b820 msgr2=0x7ff0700ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff07015b820 0x7ff0700ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 -- 172.21.15.39:0/3921567848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094d0 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06effd640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0700cf760 0x7ff070153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06ffff640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff07015b820 0x7ff0700ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff06f7fe640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 0x7ff07014f790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c3c0 tx=0x7ff06400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640052d0 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff064005450 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff064007260 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0700b4bc0 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.542+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07014fcd0 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.543+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff0640073c0 con 0x7ff0700cdc60 2024-02-17T00:36:14.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.543+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff064003a20 con 0x7ff0700cdc60 2024-02-17T00:36:14.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.544+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff070068f60 con 0x7ff0700cdc60 2024-02-17T00:36:14.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.546+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff064020060 con 0x7ff0700cdc60 2024-02-17T00:36:14.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.620+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16bdb24b-1c4a-47f7-874c-3d6fd0655717", "id": 1} v 0) v1 -- 0x7ff070066f60 con 0x7ff0700cdc60 2024-02-17T00:36:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.625+0000 7ff057fff640 1 -- 172.21.15.39:0/3921567848 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16bdb24b-1c4a-47f7-874c-3d6fd0655717", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff064003c30 con 0x7ff0700cdc60 2024-02-17T00:36:14.629 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 msgr2=0x7ff07014f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 0x7ff07014f790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c3c0 tx=0x7ff06400c880 comp rx=0 tx=0).stop 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 shutdown_connections 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff07015b820 0x7ff0700ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0700cf760 0x7ff070153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 --2- 172.21.15.39:0/3921567848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0700cdc60 0x7ff07014f790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 >> 172.21.15.39:0/3921567848 conn(0x7ff0700cc870 msgr2=0x7ff0700aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 shutdown_connections 2024-02-17T00:36:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.626+0000 7ff075d2e640 1 -- 172.21.15.39:0/3921567848 wait complete. 2024-02-17T00:36:14.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new e95aff5e-d74f-4f24-97ff-7d37a50e73db 2 2024-02-17T00:36:14.734 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.731+0000 7f6cd8846040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T00:36:14.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.738+0000 7f38671b6640 1 Processor -- start 2024-02-17T00:36:14.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.738+0000 7f38671b6640 1 -- start start 2024-02-17T00:36:14.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f38671b6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 0x7f386015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f38671b6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f38600cdf80 0x7f38600ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f38671b6640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600cdaf0 con 0x7f386015a880 2024-02-17T00:36:14.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f38671b6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386015ac60 con 0x7f38600cdf80 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f38671b6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386006e580 con 0x7f386006e120 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f385ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 0x7f386015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f3865753640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f38600cdf80 0x7f38600ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f385ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 0x7f386015eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33532/0 (socket says 172.21.15.39:33532) 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f385ffff640 1 -- 172.21.15.39:0/1026983117 learned_addr learned my addr 172.21.15.39:0/1026983117 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.739+0000 7f3865753640 1 --2- 172.21.15.39:0/1026983117 >> v2:172.21.15.39:3300/0 conn(0x7f38600cdf80 0x7f38600ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36412/0 (socket says 172.21.15.39:36412) 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.740+0000 7f385ffff640 1 -- 172.21.15.39:0/1026983117 >> v2:172.21.15.39:3300/0 conn(0x7f38600cdf80 msgr2=0x7f38600ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.740+0000 7f385ffff640 1 --2- 172.21.15.39:0/1026983117 >> v2:172.21.15.39:3300/0 conn(0x7f38600cdf80 0x7f38600ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.740+0000 7f385ffff640 1 -- 172.21.15.39:0/1026983117 >> v1:172.21.15.32:6789/0 conn(0x7f386015a880 legacy=0x7f386015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.740+0000 7f385ffff640 1 -- 172.21.15.39:0/1026983117 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386006c280 con 0x7f386006e120 2024-02-17T00:36:14.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.740+0000 7f385ffff640 1 --2- 172.21.15.39:0/1026983117 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 0x7f386015eab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f384c009870 tx=0x7f384c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ddfb5acbcbf760 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f385f7fe640 1 -- 172.21.15.39:0/1026983117 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c030840 con 0x7f386006e120 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f385f7fe640 1 -- 172.21.15.39:0/1026983117 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c0309a0 con 0x7f386006e120 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f385f7fe640 1 -- 172.21.15.39:0/1026983117 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c030d30 con 0x7f386006e120 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 -- 172.21.15.39:0/1026983117 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 msgr2=0x7f386015eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 --2- 172.21.15.39:0/1026983117 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 0x7f386015eab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f384c009870 tx=0x7f384c02b980 comp rx=0 tx=0).stop 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 -- 172.21.15.39:0/1026983117 shutdown_connections 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 --2- 172.21.15.39:0/1026983117 >> v2:172.21.15.39:3300/0 conn(0x7f38600cdf80 0x7f38600ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 --2- 172.21.15.39:0/1026983117 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386006e120 0x7f386015eab0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 -- 172.21.15.39:0/1026983117 >> 172.21.15.39:0/1026983117 conn(0x7f38600cc870 msgr2=0x7f38600ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 -- 172.21.15.39:0/1026983117 shutdown_connections 2024-02-17T00:36:14.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.741+0000 7f38671b6640 1 -- 172.21.15.39:0/1026983117 wait complete. 2024-02-17T00:36:14.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.743+0000 7f38671b6640 1 Processor -- start 2024-02-17T00:36:14.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.743+0000 7f38671b6640 1 -- start start 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.744+0000 7f38671b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 0x7f386015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38600cdf80 0x7f386014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386015a880 0x7f386014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860143170 con 0x7f38600cdf80 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386014b6d0 con 0x7f386006e120 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386015dc20 con 0x7f386015a880 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 0x7f386015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3865753640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386015a880 0x7f386014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 0x7f386015d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36424/0 (socket says 172.21.15.39:36424) 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3865753640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386015a880 0x7f386014a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33544/0 (socket says 172.21.15.39:33544) 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 -- 172.21.15.39:0/3169712864 learned_addr learned my addr 172.21.15.39:0/3169712864 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f385ffff640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38600cdf80 0x7f386014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 -- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386015a880 msgr2=0x7f386014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386015a880 0x7f386014a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 -- 172.21.15.39:0/3169712864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38600cdf80 msgr2=0x7f386014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38600cdf80 0x7f386014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 -- 172.21.15.39:0/3169712864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0094d0 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f3864f52640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 0x7f386015d6e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f385400c450 tx=0x7f385400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540052d0 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854005430 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386014b110 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854012870 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.745+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386014ba00 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.746+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f38540129d0 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.746+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f385401b820 con 0x7f386006e120 2024-02-17T00:36:14.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.746+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860068f60 con 0x7f386006e120 2024-02-17T00:36:14.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.748+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f385401b400 con 0x7f386006e120 2024-02-17T00:36:14.757 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.753+0000 7f4867df1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T00:36:14.794 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.790+0000 7f6cd8846040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T00:36:14.812 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.810+0000 7f4867df1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T00:36:14.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.822+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e95aff5e-d74f-4f24-97ff-7d37a50e73db", "id": 2} v 0) v1 -- 0x7f386009ddd0 con 0x7f386006e120 2024-02-17T00:36:14.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.827+0000 7f385d7fa640 1 -- 172.21.15.39:0/3169712864 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e95aff5e-d74f-4f24-97ff-7d37a50e73db", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f385401ba80 con 0x7f386006e120 2024-02-17T00:36:14.831 INFO:teuthology.orchestra.run.smithi039.stdout:2 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 msgr2=0x7f386015d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 0x7f386015d6e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f385400c450 tx=0x7f385400c910 comp rx=0 tx=0).stop 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 shutdown_connections 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f386015a880 0x7f386014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38600cdf80 0x7f386014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 --2- 172.21.15.39:0/3169712864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006e120 0x7f386015d6e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 >> 172.21.15.39:0/3169712864 conn(0x7f38600cc870 msgr2=0x7f386006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 shutdown_connections 2024-02-17T00:36:14.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.828+0000 7f38671b6640 1 -- 172.21.15.39:0/3169712864 wait complete. 2024-02-17T00:36:14.841 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.838+0000 7f6cd8846040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T00:36:14.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new cc8ea2aa-625a-4dd0-9b00-5d24308065c0 3 2024-02-17T00:36:14.859 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.856+0000 7f4867df1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T00:36:14.899 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.895+0000 7f6cd8846040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T00:36:14.914 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.911+0000 7f4867df1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T00:36:14.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.939+0000 7f6423af1640 1 Processor -- start 2024-02-17T00:36:14.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.940+0000 7f6423af1640 1 -- start start 2024-02-17T00:36:14.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.940+0000 7f6423af1640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f641c0b2800 0x7f641c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.940+0000 7f6423af1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.940+0000 7f6423af1640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c0ccac0 con 0x7f641c15dc40 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.940+0000 7f6423af1640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c15e020 con 0x7f641c0b2800 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.940+0000 7f6423af1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0cc7e0 con 0x7f641c0af710 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33558/0 (socket says 172.21.15.39:33558) 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 -- 172.21.15.39:0/152955477 learned_addr learned my addr 172.21.15.39:0/152955477 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642108c640 1 --2- 172.21.15.39:0/152955477 >> v2:172.21.15.32:3300/0 conn(0x7f641c0b2800 0x7f641c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 -- 172.21.15.39:0/152955477 >> v2:172.21.15.32:3300/0 conn(0x7f641c0b2800 msgr2=0x7f641c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:14.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 --2- 172.21.15.39:0/152955477 >> v2:172.21.15.32:3300/0 conn(0x7f641c0b2800 0x7f641c0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.946 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f6cd8846040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T00:36:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 -- 172.21.15.39:0/152955477 >> v1:172.21.15.32:6789/0 conn(0x7f641c15dc40 legacy=0x7f641c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.941+0000 7f642208e640 1 -- 172.21.15.39:0/152955477 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c06f840 con 0x7f641c0af710 2024-02-17T00:36:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f642208e640 1 --2- 172.21.15.39:0/152955477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cd240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6414009e50 tx=0x7f641402be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fceee0095d7b35 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f642088b640 1 -- 172.21.15.39:0/152955477 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641402c9e0 con 0x7f641c0af710 2024-02-17T00:36:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f642088b640 1 -- 172.21.15.39:0/152955477 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641402cb40 con 0x7f641c0af710 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f642088b640 1 -- 172.21.15.39:0/152955477 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140343f0 con 0x7f641c0af710 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f6423af1640 1 -- 172.21.15.39:0/152955477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 msgr2=0x7f641c0cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f6423af1640 1 --2- 172.21.15.39:0/152955477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cd240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6414009e50 tx=0x7f641402be40 comp rx=0 tx=0).stop 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f6423af1640 1 -- 172.21.15.39:0/152955477 shutdown_connections 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f6423af1640 1 --2- 172.21.15.39:0/152955477 >> v2:172.21.15.32:3300/0 conn(0x7f641c0b2800 0x7f641c0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f6423af1640 1 --2- 172.21.15.39:0/152955477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cd240 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.942+0000 7f6423af1640 1 -- 172.21.15.39:0/152955477 >> 172.21.15.39:0/152955477 conn(0x7f641c0999f0 msgr2=0x7f641c0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.943+0000 7f6423af1640 1 -- 172.21.15.39:0/152955477 shutdown_connections 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.943+0000 7f6423af1640 1 -- 172.21.15.39:0/152955477 wait complete. 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.944+0000 7f6423af1640 1 Processor -- start 2024-02-17T00:36:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.944+0000 7f6423af1640 1 -- start start 2024-02-17T00:36:14.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.944+0000 7f6423af1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.944+0000 7f6423af1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f641c0b2800 0x7f641c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f6423af1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f641c15dc40 0x7f641c15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f6423af1640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c09d470 con 0x7f641c15dc40 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f6423af1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0b5aa0 con 0x7f641c0b2800 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f6423af1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c09c7f0 con 0x7f641c0af710 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33574/0 (socket says 172.21.15.39:33574) 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 -- 172.21.15.39:0/925782277 learned_addr learned my addr 172.21.15.39:0/925782277 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642108c640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f641c0b2800 0x7f641c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642208e640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f641c15dc40 0x7f641c15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 -- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f641c0b2800 msgr2=0x7f641c15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f641c0b2800 0x7f641c15aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 -- 172.21.15.39:0/925782277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f641c15dc40 msgr2=0x7f641c15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f641c15dc40 0x7f641c15afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 -- 172.21.15.39:0/925782277 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6414009b30 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f642188d640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cb0c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f641800c3c0 tx=0x7f641800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64180052d0 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418005450 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c09cad0 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418007260 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c09d090 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.945+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f64180073c0 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.946+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6418003da0 con 0x7f641c0af710 2024-02-17T00:36:14.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.946+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c09d5b0 con 0x7f641c0af710 2024-02-17T00:36:14.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:14.948+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f641c09d5b0 con 0x7f641c0af710 2024-02-17T00:36:14.958 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:14.956+0000 7f4867df1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T00:36:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.022+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cc8ea2aa-625a-4dd0-9b00-5d24308065c0", "id": 3} v 0) v1 -- 0x7f641c068f60 con 0x7f641c0af710 2024-02-17T00:36:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.027+0000 7f64127fc640 1 -- 172.21.15.39:0/925782277 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc8ea2aa-625a-4dd0-9b00-5d24308065c0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6418020060 con 0x7f641c0af710 2024-02-17T00:36:15.031 INFO:teuthology.orchestra.run.smithi039.stdout:3 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 msgr2=0x7f641c0cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cb0c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f641800c3c0 tx=0x7f641800c880 comp rx=0 tx=0).stop 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 shutdown_connections 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f641c15dc40 0x7f641c15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f641c0b2800 0x7f641c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 --2- 172.21.15.39:0/925782277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f641c0af710 0x7f641c0cb0c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 >> 172.21.15.39:0/925782277 conn(0x7f641c0999f0 msgr2=0x7f641c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 shutdown_connections 2024-02-17T00:36:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.028+0000 7f6423af1640 1 -- 172.21.15.39:0/925782277 wait complete. 2024-02-17T00:36:15.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new f9860253-5a7b-4e91-8c2e-d5aa82cbd515 4 2024-02-17T00:36:15.070 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.066+0000 7f6cd8846040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-17T00:36:15.078 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.076+0000 7f4867df1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-17T00:36:15.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.139+0000 7fd23a6a7640 1 Processor -- start 2024-02-17T00:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.139+0000 7fd23a6a7640 1 -- start start 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd23a6a7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd23415a880 0x7fd23406e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd23a6a7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd23415e3a0 0x7fd23415e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd23a6a7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2340cdaf0 con 0x7fd23415ed40 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd23a6a7640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23415ac60 con 0x7fd23415e3a0 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd23a6a7640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23415f1d0 con 0x7fd23415a880 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd23415a880 0x7fd23406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd23415a880 0x7fd23406e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36438/0 (socket says 172.21.15.39:36438) 2024-02-17T00:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 -- 172.21.15.39:0/1479917655 learned_addr learned my addr 172.21.15.39:0/1479917655 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd238c44640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd23415ed40 0x7fd2340cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60304/0 (socket says 172.21.15.39:60304) 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd2337fe640 1 --2- 172.21.15.39:0/1479917655 >> v2:172.21.15.32:3300/0 conn(0x7fd23415e3a0 0x7fd23415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 -- 172.21.15.39:0/1479917655 >> v2:172.21.15.32:3300/0 conn(0x7fd23415e3a0 msgr2=0x7fd23415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 --2- 172.21.15.39:0/1479917655 >> v2:172.21.15.32:3300/0 conn(0x7fd23415e3a0 0x7fd23415e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 -- 172.21.15.39:0/1479917655 >> v1:172.21.15.39:6789/0 conn(0x7fd23415ed40 legacy=0x7fd2340cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd233fff640 1 -- 172.21.15.39:0/1479917655 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23406c280 con 0x7fd23415a880 2024-02-17T00:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.140+0000 7fd232ffd640 1 -- 172.21.15.39:0/1479917655 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283892699 0 0) 0x7fd2340cdaf0 con 0x7fd23415ed40 2024-02-17T00:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.141+0000 7fd233fff640 1 --2- 172.21.15.39:0/1479917655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415a880 0x7fd23406e120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2340cc7d0 tx=0x7fd22402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a68077bfde8533c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.141+0000 7fd232ffd640 1 -- 172.21.15.39:0/1479917655 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224030860 con 0x7fd23415a880 2024-02-17T00:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.141+0000 7fd232ffd640 1 -- 172.21.15.39:0/1479917655 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2240309c0 con 0x7fd23415a880 2024-02-17T00:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.141+0000 7fd232ffd640 1 -- 172.21.15.39:0/1479917655 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224030d50 con 0x7fd23415a880 2024-02-17T00:36:15.146 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.141+0000 7f6cd8846040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T00:36:15.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 -- 172.21.15.39:0/1479917655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415a880 msgr2=0x7fd23406e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/1479917655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415a880 0x7fd23406e120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2340cc7d0 tx=0x7fd22402b9a0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 -- 172.21.15.39:0/1479917655 shutdown_connections 2024-02-17T00:36:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/1479917655 >> v2:172.21.15.32:3300/0 conn(0x7fd23415e3a0 0x7fd23415e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/1479917655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415a880 0x7fd23406e120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 -- 172.21.15.39:0/1479917655 >> 172.21.15.39:0/1479917655 conn(0x7fd2340cc870 msgr2=0x7fd2340ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 -- 172.21.15.39:0/1479917655 shutdown_connections 2024-02-17T00:36:15.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.142+0000 7fd23a6a7640 1 -- 172.21.15.39:0/1479917655 wait complete. 2024-02-17T00:36:15.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.143+0000 7fd23a6a7640 1 Processor -- start 2024-02-17T00:36:15.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.143+0000 7fd23a6a7640 1 -- start start 2024-02-17T00:36:15.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd23a6a7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd23415a880 0x7fd2340b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd23a6a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 0x7fd23415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd23a6a7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd23415ed40 0x7fd2341431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd23a6a7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340cef50 con 0x7fd23415ed40 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd23a6a7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2341554e0 con 0x7fd23415e3a0 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd23a6a7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340b4510 con 0x7fd23415a880 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 0x7fd23415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd233fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd23415a880 0x7fd2340b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 0x7fd23415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36440/0 (socket says 172.21.15.39:36440) 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 -- 172.21.15.39:0/3807032607 learned_addr learned my addr 172.21.15.39:0/3807032607 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd238c44640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd23415ed40 0x7fd2341431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 -- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd23415a880 msgr2=0x7fd2340b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd23415a880 0x7fd2340b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 -- 172.21.15.39:0/3807032607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd23415ed40 msgr2=0x7fd2341431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd23415ed40 0x7fd2341431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 -- 172.21.15.39:0/3807032607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240094d0 con 0x7fd23415e3a0 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd233fff640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd23415a880 0x7fd2340b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.144+0000 7fd2337fe640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 0x7fd23415d7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00e870 tx=0x7fd21c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0094f0 con 0x7fd23415e3a0 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00c940 con 0x7fd23415e3a0 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2340ce990 con 0x7fd23415e3a0 2024-02-17T00:36:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00ccf0 con 0x7fd23415e3a0 2024-02-17T00:36:15.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2340b47b0 con 0x7fd23415e3a0 2024-02-17T00:36:15.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd21c005990 con 0x7fd23415e3a0 2024-02-17T00:36:15.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.145+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd21c0067f0 con 0x7fd23415e3a0 2024-02-17T00:36:15.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.146+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd234073ce0 con 0x7fd23415e3a0 2024-02-17T00:36:15.154 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.148+0000 7f4867df1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T00:36:15.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.149+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd21c021060 con 0x7fd23415e3a0 2024-02-17T00:36:15.195 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.192+0000 7f6cd8846040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T00:36:15.199 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.196+0000 7f4867df1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T00:36:15.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.224+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9860253-5a7b-4e91-8c2e-d5aa82cbd515", "id": 4} v 0) v1 -- 0x7fd234068f60 con 0x7fd23415e3a0 2024-02-17T00:36:15.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.231+0000 7fd230ff9640 1 -- 172.21.15.39:0/3807032607 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9860253-5a7b-4e91-8c2e-d5aa82cbd515", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd21c017070 con 0x7fd23415e3a0 2024-02-17T00:36:15.235 INFO:teuthology.orchestra.run.smithi039.stdout:4 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 msgr2=0x7fd23415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 0x7fd23415d7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00e870 tx=0x7fd21c00ed30 comp rx=0 tx=0).stop 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 shutdown_connections 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd23415ed40 0x7fd2341431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd23415e3a0 0x7fd23415d7b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 --2- 172.21.15.39:0/3807032607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd23415a880 0x7fd2340b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 >> 172.21.15.39:0/3807032607 conn(0x7fd2340cc870 msgr2=0x7fd2340afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 shutdown_connections 2024-02-17T00:36:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.232+0000 7fd23a6a7640 1 -- 172.21.15.39:0/3807032607 wait complete. 2024-02-17T00:36:15.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new 66b2d2e5-9c10-4735-b890-fa7991e3c008 5 2024-02-17T00:36:15.252 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.248+0000 7f6cd8846040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T00:36:15.253 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.250+0000 7f4867df1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T00:36:15.302 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.299+0000 7f4867df1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T00:36:15.302 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.299+0000 7f6cd8846040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T00:36:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.348+0000 7f14b6cc3640 1 Processor -- start 2024-02-17T00:36:15.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b6cc3640 1 -- start start 2024-02-17T00:36:15.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b6cc3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f14b015a940 0x7f14b00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b6cc3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 0x7f14b00cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b6cc3640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00cb0d0 con 0x7f14b015f040 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b6cc3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b00cd960 con 0x7f14b015a940 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b6cc3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00b3030 con 0x7f14b00ccfd0 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b5260640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 0x7f14b00cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b4a5f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f14b015a940 0x7f14b00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b5260640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 0x7f14b00cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33602/0 (socket says 172.21.15.39:33602) 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.349+0000 7f14b5260640 1 -- 172.21.15.39:0/511484463 learned_addr learned my addr 172.21.15.39:0/511484463 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.350+0000 7f14b4a5f640 1 -- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 msgr2=0x7f14b00cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.350+0000 7f14b4a5f640 1 --2- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 0x7f14b00cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.350+0000 7f14b4a5f640 1 -- 172.21.15.39:0/511484463 >> v1:172.21.15.32:6789/0 conn(0x7f14b015f040 legacy=0x7f14b00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.350+0000 7f14b4a5f640 1 -- 172.21.15.39:0/511484463 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b015ad20 con 0x7f14b015a940 2024-02-17T00:36:15.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.350+0000 7f14b5260640 1 --2- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 0x7f14b00cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.350+0000 7f14b4a5f640 1 --2- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b00cc0c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ba40 tx=0x7f14a402dff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b59f885f25602b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14af7fe640 1 -- 172.21.15.39:0/511484463 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a402eda0 con 0x7f14b015a940 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14af7fe640 1 -- 172.21.15.39:0/511484463 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4036440 con 0x7f14b015a940 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14af7fe640 1 -- 172.21.15.39:0/511484463 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40367d0 con 0x7f14b015a940 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 -- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 msgr2=0x7f14b00cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b00cc0c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ba40 tx=0x7f14a402dff0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 -- 172.21.15.39:0/511484463 shutdown_connections 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b00ccfd0 0x7f14b00cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/511484463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b00cc0c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 -- 172.21.15.39:0/511484463 >> 172.21.15.39:0/511484463 conn(0x7f14b00999f0 msgr2=0x7f14b00b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 -- 172.21.15.39:0/511484463 shutdown_connections 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.351+0000 7f14b6cc3640 1 -- 172.21.15.39:0/511484463 wait complete. 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.352+0000 7f14b6cc3640 1 Processor -- start 2024-02-17T00:36:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.352+0000 7f14b6cc3640 1 -- start start 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b6cc3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14b00ccfd0 0x7f14b00b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b6cc3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b01f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b6cc3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 0x7f14b00b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b6cc3640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00ad570 con 0x7f14b00ccfd0 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b6cc3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00ad850 con 0x7f14b015a940 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b6cc3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00adb30 con 0x7f14b015f040 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b5260640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 0x7f14b00b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14affff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b01f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b5260640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 0x7f14b00b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33614/0 (socket says 172.21.15.39:33614) 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14affff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b01f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36454/0 (socket says 172.21.15.39:36454) 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b4a5f640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14b00ccfd0 0x7f14b00b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.353+0000 7f14b5260640 1 -- 172.21.15.39:0/3666319870 learned_addr learned my addr 172.21.15.39:0/3666319870 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b5260640 1 -- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 msgr2=0x7f14b01f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b5260640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b01f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b5260640 1 -- 172.21.15.39:0/3666319870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14b00ccfd0 msgr2=0x7f14b00b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b5260640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14b00ccfd0 0x7f14b00b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b5260640 1 -- 172.21.15.39:0/3666319870 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009b30 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b4a5f640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14b00ccfd0 0x7f14b00b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b5260640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 0x7f14b00b0020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14a800efc0 tx=0x7f14a800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8018070 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a800f040 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a400b6a0 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a800ce00 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b00ae0f0 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f14a8003d20 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.354+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f14a8014cf0 con 0x7f14b015f040 2024-02-17T00:36:15.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.355+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b0068f60 con 0x7f14b015f040 2024-02-17T00:36:15.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.357+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f14a8009330 con 0x7f14b015f040 2024-02-17T00:36:15.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.430+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd new", "uuid": "66b2d2e5-9c10-4735-b890-fa7991e3c008", "id": 5} v 0) v1 -- 0x7f14b00d03a0 con 0x7f14b015f040 2024-02-17T00:36:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.435+0000 7f14ad7fa640 1 -- 172.21.15.39:0/3666319870 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "66b2d2e5-9c10-4735-b890-fa7991e3c008", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14a802b0b0 con 0x7f14b015f040 2024-02-17T00:36:15.439 INFO:teuthology.orchestra.run.smithi039.stdout:5 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 msgr2=0x7f14b00b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 0x7f14b00b0020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14a800efc0 tx=0x7f14a800c490 comp rx=0 tx=0).stop 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 shutdown_connections 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f14b015f040 0x7f14b00b0020 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b015a940 0x7f14b01f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 --2- 172.21.15.39:0/3666319870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14b00ccfd0 0x7f14b00b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 >> 172.21.15.39:0/3666319870 conn(0x7f14b00999f0 msgr2=0x7f14b015e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 shutdown_connections 2024-02-17T00:36:15.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.436+0000 7f14b6cc3640 1 -- 172.21.15.39:0/3666319870 wait complete. 2024-02-17T00:36:15.450 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new 38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8 6 2024-02-17T00:36:15.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.548+0000 7fd29ec9a640 1 Processor -- start 2024-02-17T00:36:15.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.548+0000 7fd29ec9a640 1 -- start start 2024-02-17T00:36:15.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29ec9a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2980b2370 0x7fd2980b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29ec9a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980cfab0 con 0x7fd29806be80 2024-02-17T00:36:15.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29ec9a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29806d370 con 0x7fd2980999f0 2024-02-17T00:36:15.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29ec9a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2980d1280 con 0x7fd2980b2370 2024-02-17T00:36:15.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29ca36640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd2980999f0 0x7fd298099dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60308/0 (socket says 172.21.15.39:60308) 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29ca36640 1 -- 172.21.15.39:0/1019357338 learned_addr learned my addr 172.21.15.39:0/1019357338 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd29d237640 1 --2- 172.21.15.39:0/1019357338 >> v2:172.21.15.32:3300/0 conn(0x7fd2980b2370 0x7fd2980b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.549+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154745033 0 0) 0x7fd29806d370 con 0x7fd2980999f0 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd288003520 con 0x7fd2980999f0 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157475747 0 0) 0x7fd2980cfab0 con 0x7fd29806be80 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd29806d370 con 0x7fd29806be80 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3997471920 0 0) 0x7fd288003520 con 0x7fd2980999f0 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 >> v2:172.21.15.32:3300/0 conn(0x7fd2980b2370 msgr2=0x7fd2980b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 --2- 172.21.15.39:0/1019357338 >> v2:172.21.15.32:3300/0 conn(0x7fd2980b2370 0x7fd2980b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 >> v1:172.21.15.32:6789/0 conn(0x7fd29806be80 legacy=0x7fd29806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29806cad0 con 0x7fd2980999f0 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fd28c001670 con 0x7fd2980999f0 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 >> v1:172.21.15.39:6789/0 conn(0x7fd2980999f0 legacy=0x7fd298099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd288003b00 0x7fd288003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd2880047c0 0x7fd288004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd288005180 0x7fd28800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980d1280 con 0x7fd288005180 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28800c000 con 0x7fd288003b00 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28800c1c0 con 0x7fd2880047c0 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd29ca36640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd288003b00 0x7fd288003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd297fff640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd2880047c0 0x7fd288004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd29d237640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd288005180 0x7fd28800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd297fff640 1 -- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd288003b00 msgr2=0x7fd288003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd297fff640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd288003b00 0x7fd288003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd297fff640 1 -- 172.21.15.39:0/1019357338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd288005180 msgr2=0x7fd28800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd297fff640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd288005180 0x7fd28800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd297fff640 1 -- 172.21.15.39:0/1019357338 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288003520 con 0x7fd2880047c0 2024-02-17T00:36:15.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd29d237640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd288005180 0x7fd28800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.550+0000 7fd29d237640 1 -- 172.21.15.39:0/1019357338 reap_dead start 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.551+0000 7fd297fff640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd2880047c0 0x7fd288004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2840018d0 tx=0x7fd2880057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a38ae6e75d2241 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.551+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840052d0 con 0x7fd2880047c0 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.551+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284005430 con 0x7fd2880047c0 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.551+0000 7fd2977fe640 1 -- 172.21.15.39:0/1019357338 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284003810 con 0x7fd2880047c0 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 -- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd2880047c0 msgr2=0x7fd288004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd2880047c0 0x7fd288004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2840018d0 tx=0x7fd2880057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 -- 172.21.15.39:0/1019357338 shutdown_connections 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 --2- 172.21.15.39:0/1019357338 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd2880047c0 0x7fd288004c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 -- 172.21.15.39:0/1019357338 >> 172.21.15.39:0/1019357338 conn(0x7fd2980b3230 msgr2=0x7fd2980b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 -- 172.21.15.39:0/1019357338 shutdown_connections 2024-02-17T00:36:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.552+0000 7fd29ec9a640 1 -- 172.21.15.39:0/1019357338 wait complete. 2024-02-17T00:36:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.553+0000 7fd29ec9a640 1 Processor -- start 2024-02-17T00:36:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.553+0000 7fd29ec9a640 1 -- start start 2024-02-17T00:36:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ec9a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2880047c0 0x7fd29809be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ec9a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd29809cf40 0x7fd2981f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ec9a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 0x7fd2981f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ec9a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981f3510 con 0x7fd2880047c0 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ec9a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981f7b10 con 0x7fd29809cf40 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ec9a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29809c340 con 0x7fd29809d3a0 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29d237640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 0x7fd2981f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29d237640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 0x7fd2981f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33634/0 (socket says 172.21.15.39:33634) 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd297fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd29809cf40 0x7fd2981f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29d237640 1 -- 172.21.15.39:0/291463739 learned_addr learned my addr 172.21.15.39:0/291463739 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.554+0000 7fd29ca36640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2880047c0 0x7fd29809be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29d237640 1 -- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd29809cf40 msgr2=0x7fd2981f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29d237640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd29809cf40 0x7fd2981f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29d237640 1 -- 172.21.15.39:0/291463739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2880047c0 msgr2=0x7fd29809be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29d237640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2880047c0 0x7fd29809be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29d237640 1 -- 172.21.15.39:0/291463739 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2981f6f00 con 0x7fd29809d3a0 2024-02-17T00:36:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd297fff640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd29809cf40 0x7fd2981f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29d237640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 0x7fd2981f2fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd2980b3f20 tx=0x7fd29000f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29001c070 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000f040 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2981f71e0 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000e040 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2981f77a0 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd290003d20 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.555+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd290015cf0 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.556+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2980b4360 con 0x7fd29809d3a0 2024-02-17T00:36:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.558+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd2980b4360 con 0x7fd29809d3a0 2024-02-17T00:36:15.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.632+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd new", "uuid": "38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8", "id": 6} v 0) v1 -- 0x7fd298068f60 con 0x7fd29809d3a0 2024-02-17T00:36:15.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.643+0000 7fd2957fa640 1 -- 172.21.15.39:0/291463739 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd290009c10 con 0x7fd29809d3a0 2024-02-17T00:36:15.647 INFO:teuthology.orchestra.run.smithi039.stdout:6 2024-02-17T00:36:15.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 msgr2=0x7fd2981f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 0x7fd2981f2fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd2980b3f20 tx=0x7fd29000f580 comp rx=0 tx=0).stop 2024-02-17T00:36:15.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 shutdown_connections 2024-02-17T00:36:15.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd29809d3a0 0x7fd2981f2fd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd29809cf40 0x7fd2981f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 --2- 172.21.15.39:0/291463739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2880047c0 0x7fd29809be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 >> 172.21.15.39:0/291463739 conn(0x7fd2980b3230 msgr2=0x7fd298099dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 shutdown_connections 2024-02-17T00:36:15.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.644+0000 7fd29ec9a640 1 -- 172.21.15.39:0/291463739 wait complete. 2024-02-17T00:36:15.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd new a1292a63-a671-4fda-b897-a67d5ffdfe89 7 2024-02-17T00:36:15.700 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.697+0000 7f4867df1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T00:36:15.712 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.709+0000 7f6cd8846040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T00:36:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.755+0000 7f8817fb6640 1 Processor -- start 2024-02-17T00:36:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8817fb6640 1 -- start start 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8817fb6640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88100b2800 0x7f88100ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8817fb6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88100af710 0x7f88100cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8817fb6640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100ccac0 con 0x7f881015dc40 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8817fb6640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881015e020 con 0x7f88100b2800 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8817fb6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88100cc7e0 con 0x7f88100af710 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.756+0000 7f8816553640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88100af710 0x7f88100cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8816553640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88100af710 0x7f88100cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36480/0 (socket says 172.21.15.39:36480) 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8816553640 1 -- 172.21.15.39:0/3612677412 learned_addr learned my addr 172.21.15.39:0/3612677412 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8815551640 1 --2- 172.21.15.39:0/3612677412 >> v2:172.21.15.32:3300/0 conn(0x7f88100b2800 0x7f88100ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8816553640 1 -- 172.21.15.39:0/3612677412 >> v2:172.21.15.32:3300/0 conn(0x7f88100b2800 msgr2=0x7f88100ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8816553640 1 --2- 172.21.15.39:0/3612677412 >> v2:172.21.15.32:3300/0 conn(0x7f88100b2800 0x7f88100ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8816553640 1 -- 172.21.15.39:0/3612677412 >> v1:172.21.15.32:6789/0 conn(0x7f881015dc40 legacy=0x7f88100cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.757+0000 7f8816553640 1 -- 172.21.15.39:0/3612677412 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881006f840 con 0x7f88100af710 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.758+0000 7f8816553640 1 --2- 172.21.15.39:0/3612677412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88100cd240 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8810072460 tx=0x7f880802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb9fa7926ee9357e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.758+0000 7f8814d50640 1 -- 172.21.15.39:0/3612677412 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880802c9f0 con 0x7f88100af710 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.758+0000 7f8814d50640 1 -- 172.21.15.39:0/3612677412 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880802cb50 con 0x7f88100af710 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.758+0000 7f8814d50640 1 -- 172.21.15.39:0/3612677412 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88080343f0 con 0x7f88100af710 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 -- 172.21.15.39:0/3612677412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 msgr2=0x7f88100cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3612677412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88100cd240 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8810072460 tx=0x7f880802be50 comp rx=0 tx=0).stop 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 -- 172.21.15.39:0/3612677412 shutdown_connections 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3612677412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88100cd240 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3612677412 >> v2:172.21.15.32:3300/0 conn(0x7f88100b2800 0x7f88100ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 -- 172.21.15.39:0/3612677412 >> 172.21.15.39:0/3612677412 conn(0x7f88100999f0 msgr2=0x7f88100b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 -- 172.21.15.39:0/3612677412 shutdown_connections 2024-02-17T00:36:15.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.759+0000 7f8817fb6640 1 -- 172.21.15.39:0/3612677412 wait complete. 2024-02-17T00:36:15.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.761+0000 7f8817fb6640 1 Processor -- start 2024-02-17T00:36:15.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.761+0000 7f8817fb6640 1 -- start start 2024-02-17T00:36:15.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8817fb6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88101f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8817fb6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88100b2800 0x7f88100c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8817fb6640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f881015dc40 0x7f88101f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8817fb6640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881009a960 con 0x7f881015dc40 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8817fb6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88100cbfd0 con 0x7f88100af710 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8817fb6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881009abb0 con 0x7f88100b2800 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815d52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88101f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88100b2800 0x7f88100c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815d52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88101f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36488/0 (socket says 172.21.15.39:36488) 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815d52640 1 -- 172.21.15.39:0/3418238945 learned_addr learned my addr 172.21.15.39:0/3418238945 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8816553640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f881015dc40 0x7f88101f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 -- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 msgr2=0x7f88101f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88101f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 -- 172.21.15.39:0/3418238945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f881015dc40 msgr2=0x7f88101f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f881015dc40 0x7f88101f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 -- 172.21.15.39:0/3418238945 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808009b30 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8816553640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f881015dc40 0x7f88101f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815d52640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88101f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.762+0000 7f8815551640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88100b2800 0x7f88100c9110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88100d04a0 tx=0x7f880400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400c730 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880400c890 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400cc40 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881009ae90 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88100c9650 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8804005990 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.763+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8804006750 con 0x7f88100b2800 2024-02-17T00:36:15.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.764+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8810068f60 con 0x7f88100b2800 2024-02-17T00:36:15.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.766+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8804021060 con 0x7f88100b2800 2024-02-17T00:36:15.840 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.837+0000 7f4867df1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T00:36:15.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.839+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a1292a63-a671-4fda-b897-a67d5ffdfe89", "id": 7} v 0) v1 -- 0x7f881006b7b0 con 0x7f88100b2800 2024-02-17T00:36:15.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.849+0000 7f88027fc640 1 -- 172.21.15.39:0/3418238945 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1292a63-a671-4fda-b897-a67d5ffdfe89", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f880402a0b0 con 0x7f88100b2800 2024-02-17T00:36:15.852 INFO:teuthology.orchestra.run.smithi039.stdout:7 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88100b2800 msgr2=0x7f88100c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88100b2800 0x7f88100c9110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88100d04a0 tx=0x7f880400ecd0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 shutdown_connections 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f881015dc40 0x7f88101f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88100b2800 0x7f88100c9110 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 --2- 172.21.15.39:0/3418238945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88100af710 0x7f88101f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 >> 172.21.15.39:0/3418238945 conn(0x7f88100999f0 msgr2=0x7f88100b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 shutdown_connections 2024-02-17T00:36:15.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-02-17T00:36:15.850+0000 7f8817fb6640 1 -- 172.21.15.39:0/3418238945 wait complete. 2024-02-17T00:36:15.858 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.854+0000 7f6cd8846040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T00:36:15.863 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-17T00:36:15.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-17T00:36:15.866 INFO:tasks.ceph.osd.0:Started 2024-02-17T00:36:15.866 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-17T00:36:15.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-17T00:36:15.868 INFO:tasks.ceph.osd.1:Started 2024-02-17T00:36:15.868 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-17T00:36:15.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-17T00:36:15.871 INFO:tasks.ceph.osd.2:Started 2024-02-17T00:36:15.871 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-17T00:36:15.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-17T00:36:15.873 INFO:tasks.ceph.osd.3:Started 2024-02-17T00:36:15.873 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-17T00:36:15.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-17T00:36:15.875 INFO:tasks.ceph.osd.4:Started 2024-02-17T00:36:15.875 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-17T00:36:15.875 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-17T00:36:15.877 INFO:tasks.ceph.osd.5:Started 2024-02-17T00:36:15.877 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-17T00:36:15.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-17T00:36:15.879 INFO:tasks.ceph.osd.6:Started 2024-02-17T00:36:15.880 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-17T00:36:15.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-17T00:36:15.882 INFO:tasks.ceph.osd.7:Started 2024-02-17T00:36:15.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:15.994 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:15.991+0000 7f6cd8846040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T00:36:15.996 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:15.993+0000 7f4867df1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T00:36:16.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.998+0000 7f836bbb5640 1 Processor -- start 2024-02-17T00:36:16.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.998+0000 7f836bbb5640 1 -- start start 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f836bbb5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 0x7f83640af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f836bbb5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f836406b270 0x7f83640b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f836bbb5640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83640d1470 con 0x7f83640d1010 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f836bbb5640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83641616c0 con 0x7f836406b270 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f836bbb5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83641619a0 con 0x7f836415dad0 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f8369951640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 0x7f83640af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f836a152640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f836406b270 0x7f83640b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f8369951640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 0x7f83640af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:43450/0 (socket says 172.21.15.32:43450) 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f8369951640 1 -- 172.21.15.32:0/2042079657 learned_addr learned my addr 172.21.15.32:0/2042079657 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:15.999+0000 7f8369150640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f83640d1010 0x7f836406ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:45640/0 (socket says 172.21.15.32:45640) 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.000+0000 7f836a152640 1 -- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 msgr2=0x7f83640af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.000+0000 7f836a152640 1 --2- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 0x7f83640af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.000+0000 7f836a152640 1 -- 172.21.15.32:0/2042079657 >> v1:172.21.15.39:6789/0 conn(0x7f83640d1010 legacy=0x7f836406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.000+0000 7f836a152640 1 -- 172.21.15.32:0/2042079657 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364161c80 con 0x7f836406b270 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.000+0000 7f8369951640 1 --2- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 0x7f83640af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.000+0000 7f836a152640 1 --2- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f83640b3700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f835c009d90 tx=0x7f835c02bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b2ad622a620ade server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836894f640 1 -- 172.21.15.32:0/2042079657 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c02c980 con 0x7f836406b270 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836894f640 1 -- 172.21.15.32:0/2042079657 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c02cae0 con 0x7f836406b270 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836894f640 1 -- 172.21.15.32:0/2042079657 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c02ce70 con 0x7f836406b270 2024-02-17T00:36:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 -- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 msgr2=0x7f83640b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 --2- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f83640b3700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f835c009d90 tx=0x7f835c02bc50 comp rx=0 tx=0).stop 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 -- 172.21.15.32:0/2042079657 shutdown_connections 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 --2- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f83640b3700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 --2- 172.21.15.32:0/2042079657 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f836415dad0 0x7f83640af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 -- 172.21.15.32:0/2042079657 >> 172.21.15.32:0/2042079657 conn(0x7f83640b2400 msgr2=0x7f83640b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 -- 172.21.15.32:0/2042079657 shutdown_connections 2024-02-17T00:36:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.001+0000 7f836bbb5640 1 -- 172.21.15.32:0/2042079657 wait complete. 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.003+0000 7f836bbb5640 1 Processor -- start 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.003+0000 7f836bbb5640 1 -- start start 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836bbb5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f836414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836bbb5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 0x7f83640ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836bbb5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f836415dad0 0x7f8364153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836bbb5640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83640cc430 con 0x7f836415dad0 2024-02-17T00:36:16.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836bbb5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83640cc710 con 0x7f836406b270 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836bbb5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83640cc9f0 con 0x7f83640d1010 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 0x7f83640ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 0x7f83640ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:43462/0 (socket says 172.21.15.32:43462) 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 -- 172.21.15.32:0/1806738361 learned_addr learned my addr 172.21.15.32:0/1806738361 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f836a152640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f836415dad0 0x7f8364153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369951640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f836414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 -- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 msgr2=0x7f836414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f836414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 -- 172.21.15.32:0/1806738361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f836415dad0 msgr2=0x7f8364153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f836415dad0 0x7f8364153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 -- 172.21.15.32:0/1806738361 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540094d0 con 0x7f83640d1010 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369951640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f836414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.004+0000 7f8369150640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 0x7f83640ca390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f836000c780 tx=0x7f836000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83600072d0 con 0x7f83640d1010 2024-02-17T00:36:16.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360007430 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83600047e0 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c009a70 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83640cd630 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8360004940 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.005+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8360012560 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.006+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83640b5190 con 0x7f83640d1010 2024-02-17T00:36:16.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.008+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8360021060 con 0x7f83640d1010 2024-02-17T00:36:16.042 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:16.039+0000 7f6cd8846040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T00:36:16.045 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:16.042+0000 7f4867df1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T00:36:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.070+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83640cd840 con 0x7f83640d1010 2024-02-17T00:36:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.070+0000 7f835a7fc640 1 -- 172.21.15.32:0/1806738361 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f8360018070 con 0x7f83640d1010 2024-02-17T00:36:16.074 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:16.074 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:15.842113+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 msgr2=0x7f83640ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 0x7f83640ca390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f836000c780 tx=0x7f836000cc40 comp rx=0 tx=0).stop 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 shutdown_connections 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f836415dad0 0x7f8364153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f83640d1010 0x7f83640ca390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 --2- 172.21.15.32:0/1806738361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836406b270 0x7f836414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 >> 172.21.15.32:0/1806738361 conn(0x7f83640b2400 msgr2=0x7f83640700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 shutdown_connections 2024-02-17T00:36:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:16.071+0000 7f836bbb5640 1 -- 172.21.15.32:0/1806738361 wait complete. 2024-02-17T00:36:16.085 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-17T00:36:16.085 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-17T00:36:16.158 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:16.155+0000 7f6cd8846040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T00:36:16.162 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:16.159+0000 7f4867df1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T00:36:16.257 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:16.254+0000 7f6cd8846040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T00:36:16.261 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:16.258+0000 7f4867df1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T00:36:16.418 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:16.414+0000 7f6cd8846040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T00:36:16.421 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:16.418+0000 7f4867df1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T00:36:16.462 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:16.458+0000 7f6cd8846040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T00:36:16.465 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:16.462+0000 7f4867df1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T00:36:16.478 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T00:36:16.474+0000 7fec8a419640 -1 Falling back to public interface 2024-02-17T00:36:16.481 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T00:36:16.477+0000 7f77aca0f640 -1 Falling back to public interface 2024-02-17T00:36:16.484 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T00:36:16.481+0000 7f02e061c640 -1 Falling back to public interface 2024-02-17T00:36:16.487 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T00:36:16.484+0000 7f2788973640 -1 Falling back to public interface 2024-02-17T00:36:16.497 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T00:36:16.494+0000 7f22a9019640 -1 Falling back to public interface 2024-02-17T00:36:16.498 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T00:36:16.495+0000 7f8b9fc15640 -1 Falling back to public interface 2024-02-17T00:36:16.503 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T00:36:16.500+0000 7fa79b00c640 -1 Falling back to public interface 2024-02-17T00:36:16.503 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T00:36:16.500+0000 7f0f18a24640 -1 Falling back to public interface 2024-02-17T00:36:16.625 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:16.622+0000 7f6cd8846040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T00:36:16.629 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:16.626+0000 7f4867df1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T00:36:16.890 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:16.980 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.976+0000 7f26a582e640 1 Processor -- start 2024-02-17T00:36:16.980 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f26a582e640 1 -- start start 2024-02-17T00:36:16.981 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f26a582e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f26a015ba00 0x7f26a00cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.981 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f26a582e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26a00acce0 0x7f26a00cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.981 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f26a582e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a006eff0 con 0x7f26a00af1a0 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f26a582e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a006f2d0 con 0x7f26a00acce0 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f26a582e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a006ac00 con 0x7f26a015ba00 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.977+0000 7f2697fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26a00acce0 0x7f26a00cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f2697fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26a00acce0 0x7f26a00cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33772/0 (socket says 172.21.15.32:33772) 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f2697fff640 1 -- 172.21.15.32:0/130072529 learned_addr learned my addr 172.21.15.32:0/130072529 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f269effd640 1 --2- 172.21.15.32:0/130072529 >> v2:172.21.15.39:3300/0 conn(0x7f26a015ba00 0x7f26a00cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f2697fff640 1 -- 172.21.15.32:0/130072529 >> v2:172.21.15.39:3300/0 conn(0x7f26a015ba00 msgr2=0x7f26a00cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f2697fff640 1 --2- 172.21.15.32:0/130072529 >> v2:172.21.15.39:3300/0 conn(0x7f26a015ba00 0x7f26a00cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f2697fff640 1 -- 172.21.15.32:0/130072529 >> v1:172.21.15.39:6789/0 conn(0x7f26a00af1a0 legacy=0x7f26a015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.982 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.978+0000 7f2697fff640 1 -- 172.21.15.32:0/130072529 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a006aee0 con 0x7f26a00acce0 2024-02-17T00:36:16.983 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.979+0000 7f2697fff640 1 --2- 172.21.15.32:0/130072529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a00acce0 0x7f26a00cdee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26a00719b0 tx=0x7f268802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753765de3b260e4c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.979+0000 7f269e7fc640 1 -- 172.21.15.32:0/130072529 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688030860 con 0x7f26a00acce0 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.979+0000 7f269e7fc640 1 -- 172.21.15.32:0/130072529 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26880309c0 con 0x7f26a00acce0 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.979+0000 7f269e7fc640 1 -- 172.21.15.32:0/130072529 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688030d50 con 0x7f26a00acce0 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 -- 172.21.15.32:0/130072529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a00acce0 msgr2=0x7f26a00cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 --2- 172.21.15.32:0/130072529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a00acce0 0x7f26a00cdee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26a00719b0 tx=0x7f268802b9a0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 -- 172.21.15.32:0/130072529 shutdown_connections 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 --2- 172.21.15.32:0/130072529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a00acce0 0x7f26a00cdee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 --2- 172.21.15.32:0/130072529 >> v2:172.21.15.39:3300/0 conn(0x7f26a015ba00 0x7f26a00cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 -- 172.21.15.32:0/130072529 >> 172.21.15.32:0/130072529 conn(0x7f26a00cc850 msgr2=0x7f26a00ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 -- 172.21.15.32:0/130072529 shutdown_connections 2024-02-17T00:36:16.984 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.980+0000 7f26a582e640 1 -- 172.21.15.32:0/130072529 wait complete. 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.981+0000 7f26a582e640 1 Processor -- start 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.981+0000 7f26a582e640 1 -- start start 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26a00acce0 0x7f26a014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26a00af1a0 0x7f26a009bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 0x7f26a009c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a01f1930 con 0x7f26a015ba00 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015d160 con 0x7f26a00af1a0 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015ce30 con 0x7f26a00acce0 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 0x7f26a009c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.987 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 0x7f26a009c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33788/0 (socket says 172.21.15.32:33788) 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 -- 172.21.15.32:0/589931113 learned_addr learned my addr 172.21.15.32:0/589931113 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269effd640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26a00acce0 0x7f26a014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f2697fff640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26a00af1a0 0x7f26a009bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 -- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26a00acce0 msgr2=0x7f26a014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26a00acce0 0x7f26a014fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 -- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26a00af1a0 msgr2=0x7f26a009bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26a00af1a0 0x7f26a009bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 -- 172.21.15.32:0/589931113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880094d0 con 0x7f26a015ba00 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269f7fe640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 0x7f26a009c310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f269800c7a0 tx=0x7f269800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698003b70 con 0x7f26a015ba00 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698003cf0 con 0x7f26a015ba00 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a009af30 con 0x7f26a015ba00 2024-02-17T00:36:16.988 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698003ea0 con 0x7f26a015ba00 2024-02-17T00:36:16.989 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.982+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a009b4f0 con 0x7f26a015ba00 2024-02-17T00:36:16.989 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.983+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f269800aa90 con 0x7f26a015ba00 2024-02-17T00:36:16.989 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.983+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2698012b90 con 0x7f26a015ba00 2024-02-17T00:36:16.989 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.983+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a015d2d0 con 0x7f26a015ba00 2024-02-17T00:36:16.989 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:16.985+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2698012e10 con 0x7f26a015ba00 2024-02-17T00:36:17.051 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.048+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26a004ef20 con 0x7f26a015ba00 2024-02-17T00:36:17.052 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.049+0000 7f269cff9640 1 -- 172.21.15.32:0/589931113 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f26980124c0 con 0x7f26a015ba00 2024-02-17T00:36:17.052 INFO:teuthology.misc.health.smithi032.stdout: 2024-02-17T00:36:17.053 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:15.842113+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 msgr2=0x7f26a009c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 0x7f26a009c310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f269800c7a0 tx=0x7f269800cc60 comp rx=0 tx=0).stop 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 shutdown_connections 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26a015ba00 0x7f26a009c310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26a00af1a0 0x7f26a009bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 --2- 172.21.15.32:0/589931113 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26a00acce0 0x7f26a014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 >> 172.21.15.32:0/589931113 conn(0x7f26a00cc850 msgr2=0x7f26a00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 shutdown_connections 2024-02-17T00:36:17.054 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:17.050+0000 7f26a582e640 1 -- 172.21.15.32:0/589931113 wait complete. 2024-02-17T00:36:17.063 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-17T00:36:17.458 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:17.454+0000 7f6cd8846040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T00:36:17.480 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:17.477+0000 7f4867df1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T00:36:17.750 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:17.746+0000 7f6cd8846040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T00:36:17.768 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:17.765+0000 7f4867df1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T00:36:17.803 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:17.800+0000 7f6cd8846040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T00:36:17.821 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:17.818+0000 7f4867df1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T00:36:17.924 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:17.921+0000 7f6cd8846040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T00:36:17.940 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-02-17T00:36:17.937+0000 7f4867df1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T00:36:18.952 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:18.949+0000 7f6c794c2640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-17T00:36:18.953 INFO:tasks.ceph.mgr.x.smithi039.stderr:2024-02-17T00:36:18.949+0000 7f6c794c2640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-17T00:36:19.941 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T00:36:19.937+0000 7f77aca0f640 -1 osd.7 0 log_to_monitors true 2024-02-17T00:36:19.991 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T00:36:19.987+0000 7fec8a419640 -1 osd.5 0 log_to_monitors true 2024-02-17T00:36:19.991 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T00:36:19.989+0000 7f02e061c640 -1 osd.3 0 log_to_monitors true 2024-02-17T00:36:19.996 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T00:36:19.992+0000 7f0f18a24640 -1 osd.6 0 log_to_monitors true 2024-02-17T00:36:20.019 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T00:36:20.016+0000 7fa79b00c640 -1 osd.4 0 log_to_monitors true 2024-02-17T00:36:20.026 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T00:36:20.024+0000 7f22a9019640 -1 osd.1 0 log_to_monitors true 2024-02-17T00:36:20.027 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T00:36:20.025+0000 7f8b9fc15640 -1 osd.0 0 log_to_monitors true 2024-02-17T00:36:20.029 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T00:36:20.027+0000 7f2788973640 -1 osd.2 0 log_to_monitors true 2024-02-17T00:36:21.824 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T00:36:21.820+0000 7f77a8495640 -1 osd.7 0 waiting for initial osdmap 2024-02-17T00:36:21.834 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T00:36:21.831+0000 7f77a02b5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.634 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T00:36:23.631+0000 7f22a5291640 -1 osd.1 0 waiting for initial osdmap 2024-02-17T00:36:23.640 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T00:36:23.636+0000 7f2784909640 -1 osd.2 0 waiting for initial osdmap 2024-02-17T00:36:23.648 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T00:36:23.645+0000 7f02dc00c640 -1 osd.3 0 waiting for initial osdmap 2024-02-17T00:36:23.651 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T00:36:23.648+0000 7f229c89d640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.651 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T00:36:23.648+0000 7f277c729640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.661 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T00:36:23.658+0000 7f02d3e2c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.680 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T00:36:23.677+0000 7f8b9b67d640 -1 osd.0 0 waiting for initial osdmap 2024-02-17T00:36:23.694 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T00:36:23.691+0000 7f8b9349d640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.836 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T00:36:23.833+0000 7fec85dec640 -1 osd.5 0 waiting for initial osdmap 2024-02-17T00:36:23.845 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T00:36:23.841+0000 7f0f1441a640 -1 osd.6 0 waiting for initial osdmap 2024-02-17T00:36:23.850 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T00:36:23.847+0000 7fec7dc0c640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.856 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T00:36:23.853+0000 7f0f0c23a640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.870 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:23.874 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T00:36:23.870+0000 7fa7969d3640 -1 osd.4 0 waiting for initial osdmap 2024-02-17T00:36:23.883 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T00:36:23.881+0000 7fa78e7f3640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T00:36:23.959 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.956+0000 7f068556c640 1 Processor -- start 2024-02-17T00:36:23.960 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.956+0000 7f068556c640 1 -- start start 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f068556c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f06800b38b0 0x7f0680072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f068556c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800b3d60 con 0x7f0680158390 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f068556c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0680072930 con 0x7f0680157fb0 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f068556c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800731d0 con 0x7f06800b38b0 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f067e7fc640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0680158390 0x7f06801616c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41534/0 (socket says 172.21.15.32:41534) 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f067e7fc640 1 -- 172.21.15.32:0/1700980494 learned_addr learned my addr 172.21.15.32:0/1700980494 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.957+0000 7f067f7fe640 1 --2- 172.21.15.32:0/1700980494 >> v2:172.21.15.39:3300/0 conn(0x7f06800b38b0 0x7f0680072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:23.961 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.958+0000 7f067dffb640 1 -- 172.21.15.32:0/1700980494 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579078331 0 0) 0x7f06800b3d60 con 0x7f0680158390 2024-02-17T00:36:23.962 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.958+0000 7f067dffb640 1 -- 172.21.15.32:0/1700980494 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c003520 con 0x7f0680158390 2024-02-17T00:36:23.962 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.958+0000 7f067f7fe640 1 -- 172.21.15.32:0/1700980494 >> v1:172.21.15.39:6789/0 conn(0x7f0680157fb0 legacy=0x7f068015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:23.962 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.958+0000 7f067f7fe640 1 -- 172.21.15.32:0/1700980494 >> v1:172.21.15.32:6789/0 conn(0x7f0680158390 legacy=0x7f06801616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:23.962 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.958+0000 7f067f7fe640 1 -- 172.21.15.32:0/1700980494 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680072c10 con 0x7f06800b38b0 2024-02-17T00:36:23.963 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.958+0000 7f067f7fe640 1 --2- 172.21.15.32:0/1700980494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06800b38b0 0x7f0680072220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0670009d90 tx=0x7f067002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24b9f703c7b53 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:23.963 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f067dffb640 1 -- 172.21.15.32:0/1700980494 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067002cc60 con 0x7f06800b38b0 2024-02-17T00:36:23.963 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f067dffb640 1 -- 172.21.15.32:0/1700980494 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067002cdc0 con 0x7f06800b38b0 2024-02-17T00:36:23.963 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f067dffb640 1 -- 172.21.15.32:0/1700980494 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670034640 con 0x7f06800b38b0 2024-02-17T00:36:23.963 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 -- 172.21.15.32:0/1700980494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06800b38b0 msgr2=0x7f0680072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 --2- 172.21.15.32:0/1700980494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06800b38b0 0x7f0680072220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0670009d90 tx=0x7f067002beb0 comp rx=0 tx=0).stop 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 -- 172.21.15.32:0/1700980494 shutdown_connections 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 --2- 172.21.15.32:0/1700980494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06800b38b0 0x7f0680072220 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 -- 172.21.15.32:0/1700980494 >> 172.21.15.32:0/1700980494 conn(0x7f0680066a40 msgr2=0x7f0680066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 -- 172.21.15.32:0/1700980494 shutdown_connections 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.959+0000 7f068556c640 1 -- 172.21.15.32:0/1700980494 wait complete. 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.960+0000 7f068556c640 1 Processor -- start 2024-02-17T00:36:23.964 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.960+0000 7f068556c640 1 -- start start 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f068556c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06800b38b0 0x7f06800cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f068556c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 0x7f0680156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f068556c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0680158390 0x7f06800caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f068556c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800c9e30 con 0x7f0680157fb0 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f068556c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800ca110 con 0x7f0680158390 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f068556c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800ca3f0 con 0x7f06800b38b0 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 0x7f0680156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 0x7f0680156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58366/0 (socket says 172.21.15.32:58366) 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 -- 172.21.15.32:0/4138414737 learned_addr learned my addr 172.21.15.32:0/4138414737 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:23.967 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067f7fe640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0680158390 0x7f06800caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067effd640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06800b38b0 0x7f06800cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 -- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06800b38b0 msgr2=0x7f06800cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06800b38b0 0x7f06800cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 -- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0680158390 msgr2=0x7f06800caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0680158390 0x7f06800caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.961+0000 7f067e7fc640 1 -- 172.21.15.32:0/4138414737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0670009a70 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.962+0000 7f067e7fc640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 0x7f0680156690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f066800c3c0 tx=0x7f066800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.962+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668005ce0 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.962+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668005e60 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.962+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800ca6d0 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.962+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06680072f0 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.962+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06800cffe0 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.963+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06800cabf0 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.963+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f0668007470 con 0x7f0680157fb0 2024-02-17T00:36:23.968 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.963+0000 7f06777fe640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f066006b780 0x7f066006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:23.969 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.963+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f0668088a80 con 0x7f0680157fb0 2024-02-17T00:36:23.969 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.963+0000 7f067effd640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f066006b780 0x7f066006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:23.969 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.964+0000 7f067effd640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f066006b780 0x7f066006dc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:23.971 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:23.968+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06800cabf0 con 0x7f0680157fb0 2024-02-17T00:36:24.155 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.152+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06800cabf0 con 0x7f0680157fb0 2024-02-17T00:36:24.156 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.153+0000 7f06777fe640 1 -- 172.21.15.32:0/4138414737 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7578 (secure 0 0 0) 0x7f06800cabf0 con 0x7f0680157fb0 2024-02-17T00:36:24.156 INFO:teuthology.misc.health.smithi032.stdout: 2024-02-17T00:36:24.157 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":14,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:22.996529+0000","last_up_change":"2024-02-17T00:36:21.995038+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f066006b780 msgr2=0x7f066006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f066006b780 0x7f066006dc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678009040 comp rx=0 tx=0).stop 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 msgr2=0x7f0680156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 0x7f0680156690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f066800c3c0 tx=0x7f066800c880 comp rx=0 tx=0).stop 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 shutdown_connections 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0680158390 0x7f06800caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:24.159 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0680157fb0 0x7f0680156690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:24.160 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f066006b780 0x7f066006dc40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:24.160 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 --2- 172.21.15.32:0/4138414737 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06800b38b0 0x7f06800cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:24.160 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.155+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 >> 172.21.15.32:0/4138414737 conn(0x7f0680066a40 msgr2=0x7f0680160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:24.160 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.156+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 shutdown_connections 2024-02-17T00:36:24.160 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:24.156+0000 7f068556c640 1 -- 172.21.15.32:0/4138414737 wait complete. 2024-02-17T00:36:24.169 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-02-17T00:36:30.976 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:31.077 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.074+0000 7f31d1f8c640 1 Processor -- start 2024-02-17T00:36:31.077 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.074+0000 7f31d1f8c640 1 -- start start 2024-02-17T00:36:31.079 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31d1f8c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0b53f0 0x7f31cc06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.079 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31d1f8c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31cc0ce240 0x7f31cc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.079 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31d1f8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc0d1f20 con 0x7f31cc161720 2024-02-17T00:36:31.079 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31d1f8c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc0d1bf0 con 0x7f31cc0ce240 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31d1f8c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc06cf30 con 0x7f31cc0b53f0 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31cc0ce240 0x7f31cc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31cc0ce240 0x7f31cc0b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58378/0 (socket says 172.21.15.32:58378) 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 -- 172.21.15.32:0/1423800942 learned_addr learned my addr 172.21.15.32:0/1423800942 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31cb7fe640 1 --2- 172.21.15.32:0/1423800942 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0b53f0 0x7f31cc06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 -- 172.21.15.32:0/1423800942 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0b53f0 msgr2=0x7f31cc06c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 --2- 172.21.15.32:0/1423800942 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0b53f0 0x7f31cc06c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 -- 172.21.15.32:0/1423800942 >> v1:172.21.15.39:6789/0 conn(0x7f31cc161720 legacy=0x7f31cc161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.075+0000 7f31caffd640 1 -- 172.21.15.32:0/1423800942 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0b5d10 con 0x7f31cc0ce240 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.076+0000 7f31caffd640 1 --2- 172.21.15.32:0/1423800942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0ce240 0x7f31cc0b57d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6430aed95f8d44bd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.080 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.076+0000 7f31ca7fc640 1 -- 172.21.15.32:0/1423800942 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0031640 con 0x7f31cc0ce240 2024-02-17T00:36:31.081 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.076+0000 7f31ca7fc640 1 -- 172.21.15.32:0/1423800942 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00317a0 con 0x7f31cc0ce240 2024-02-17T00:36:31.081 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.076+0000 7f31ca7fc640 1 -- 172.21.15.32:0/1423800942 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0031b30 con 0x7f31cc0ce240 2024-02-17T00:36:31.084 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 -- 172.21.15.32:0/1423800942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0ce240 msgr2=0x7f31cc0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.084 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/1423800942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0ce240 0x7f31cc0b57d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c002b8f0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 -- 172.21.15.32:0/1423800942 shutdown_connections 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/1423800942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0ce240 0x7f31cc0b57d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/1423800942 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0b53f0 0x7f31cc06c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 -- 172.21.15.32:0/1423800942 >> 172.21.15.32:0/1423800942 conn(0x7f31cc0d03f0 msgr2=0x7f31cc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 -- 172.21.15.32:0/1423800942 shutdown_connections 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.077+0000 7f31d1f8c640 1 -- 172.21.15.32:0/1423800942 wait complete. 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.078+0000 7f31d1f8c640 1 Processor -- start 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.078+0000 7f31d1f8c640 1 -- start start 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31d1f8c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 0x7f31cc14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31d1f8c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0ce240 0x7f31cc1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.085 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31d1f8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31cc161720 0x7f31cc0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31d1f8c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1560d0 con 0x7f31cc0b53f0 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31d1f8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1563b0 con 0x7f31cc161720 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31d1f8c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc156690 con 0x7f31cc0ce240 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 0x7f31cc14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 0x7f31cc14ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58390/0 (socket says 172.21.15.32:58390) 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 -- 172.21.15.32:0/884264322 learned_addr learned my addr 172.21.15.32:0/884264322 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cbfff640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31cc161720 0x7f31cc0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31caffd640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0ce240 0x7f31cc1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 -- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0ce240 msgr2=0x7f31cc1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.086 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0ce240 0x7f31cc1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 -- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31cc161720 msgr2=0x7f31cc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31cc161720 0x7f31cc0c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.079+0000 7f31cb7fe640 1 -- 172.21.15.32:0/884264322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00094d0 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.080+0000 7f31cb7fe640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 0x7f31cc14ac50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e9b0 tx=0x7f31bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.080+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009670 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.080+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00c9a0 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.080+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc156970 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.080+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00cd50 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.080+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc14b190 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.081+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc04ef20 con 0x7f31cc0b53f0 2024-02-17T00:36:31.087 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.081+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f31bc013470 con 0x7f31cc0b53f0 2024-02-17T00:36:31.088 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.082+0000 7f31b3fff640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f31b806b810 0x7f31b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.088 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.082+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31bc08a150 con 0x7f31cc0b53f0 2024-02-17T00:36:31.088 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.082+0000 7f31caffd640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f31b806b810 0x7f31b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.089 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.082+0000 7f31caffd640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f31b806b810 0x7f31b806dcd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31c0036000 tx=0x7f31c003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.089 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.086+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f31bc054e40 con 0x7f31cc0b53f0 2024-02-17T00:36:31.269 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.266+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31cc0ca2d0 con 0x7f31cc0b53f0 2024-02-17T00:36:31.270 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.267+0000 7f31b3fff640 1 -- 172.21.15.32:0/884264322 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12836 (secure 0 0 0) 0x7f31bc058500 con 0x7f31cc0b53f0 2024-02-17T00:36:31.270 INFO:teuthology.misc.health.smithi032.stdout: 2024-02-17T00:36:31.270 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":19,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:28.931164+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:31.272 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f31b806b810 msgr2=0x7f31b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.272 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f31b806b810 0x7f31b806dcd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31c0036000 tx=0x7f31c003c040 comp rx=0 tx=0).stop 2024-02-17T00:36:31.272 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 msgr2=0x7f31cc14ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.272 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 0x7f31cc14ac50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e9b0 tx=0x7f31bc00ee70 comp rx=0 tx=0).stop 2024-02-17T00:36:31.272 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 shutdown_connections 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31cc161720 0x7f31cc0c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f31b806b810 0x7f31b806dcd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f31cc0ce240 0x7f31cc1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 --2- 172.21.15.32:0/884264322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31cc0b53f0 0x7f31cc14ac50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.268+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 >> 172.21.15.32:0/884264322 conn(0x7f31cc0d03f0 msgr2=0x7f31cc06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.269+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 shutdown_connections 2024-02-17T00:36:31.273 INFO:teuthology.misc.health.smithi032.stderr:2024-02-17T00:36:31.269+0000 7f31d1f8c640 1 -- 172.21.15.32:0/884264322 wait complete. 2024-02-17T00:36:31.282 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-17T00:36:31.282 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-17T00:36:31.282 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T00:36:31.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T00:36:31.285 INFO:tasks.ceph.mds.a:Started 2024-02-17T00:36:31.285 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T00:36:31.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-17T00:36:31.287 INFO:tasks.ceph.mds.c:Started 2024-02-17T00:36:31.287 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T00:36:31.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T00:36:31.290 INFO:tasks.ceph.mds.b:Started 2024-02-17T00:36:31.290 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T00:36:31.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-17T00:36:31.292 INFO:tasks.ceph.mds.d:Started 2024-02-17T00:36:31.292 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-17T00:36:31.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:31.360 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-02-17T00:36:31.360 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-02-17T00:36:31.376 INFO:tasks.ceph.mds.b.smithi039.stdout:starting mds.b at 2024-02-17T00:36:31.376 INFO:tasks.ceph.mds.d.smithi039.stdout:starting mds.d at 2024-02-17T00:36:31.377 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T00:36:31.374+0000 7ff23a3b3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-02-17T00:36:31.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.396+0000 7fa806f13640 1 Processor -- start 2024-02-17T00:36:31.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.396+0000 7fa806f13640 1 -- start start 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.396+0000 7fa806f13640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa80015db00 0x7fa8000d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.396+0000 7fa806f13640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000d1e80 con 0x7fa8000ce2b0 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.396+0000 7fa806f13640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa800162490 con 0x7fa8000b53b0 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.396+0000 7fa806f13640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000b5930 con 0x7fa80015db00 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa804caf640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa80015db00 0x7fa8000d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa8054b0640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8000ce2b0 0x7fa800161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41560/0 (socket says 172.21.15.32:41560) 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa8054b0640 1 -- 172.21.15.32:0/742293255 learned_addr learned my addr 172.21.15.32:0/742293255 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa804caf640 1 -- 172.21.15.32:0/742293255 >> v1:172.21.15.39:6789/0 conn(0x7fa8000b53b0 legacy=0x7fa800161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa804caf640 1 -- 172.21.15.32:0/742293255 >> v1:172.21.15.32:6789/0 conn(0x7fa8000ce2b0 legacy=0x7fa800161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa7ff7fe640 1 -- 172.21.15.32:0/742293255 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281174140 0 0) 0x7fa8000d1e80 con 0x7fa8000ce2b0 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.397+0000 7fa804caf640 1 -- 172.21.15.32:0/742293255 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000b5c10 con 0x7fa80015db00 2024-02-17T00:36:31.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa804caf640 1 --2- 172.21.15.32:0/742293255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa80015db00 0x7fa8000d0340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40097a0 tx=0x7fa7f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931979360e660e0a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa7ff7fe640 1 -- 172.21.15.32:0/742293255 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4030610 con 0x7fa80015db00 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa7ff7fe640 1 -- 172.21.15.32:0/742293255 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4030770 con 0x7fa80015db00 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa7ff7fe640 1 -- 172.21.15.32:0/742293255 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4030b00 con 0x7fa80015db00 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 -- 172.21.15.32:0/742293255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa80015db00 msgr2=0x7fa8000d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 --2- 172.21.15.32:0/742293255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa80015db00 0x7fa8000d0340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40097a0 tx=0x7fa7f402b960 comp rx=0 tx=0).stop 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 -- 172.21.15.32:0/742293255 shutdown_connections 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 --2- 172.21.15.32:0/742293255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa80015db00 0x7fa8000d0340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 -- 172.21.15.32:0/742293255 >> 172.21.15.32:0/742293255 conn(0x7fa800072290 msgr2=0x7fa8000726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 -- 172.21.15.32:0/742293255 shutdown_connections 2024-02-17T00:36:31.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.398+0000 7fa806f13640 1 -- 172.21.15.32:0/742293255 wait complete. 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.399+0000 7fa806f13640 1 Processor -- start 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.399+0000 7fa806f13640 1 -- start start 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa806f13640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8000b53b0 0x7fa8000b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa806f13640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 0x7fa8000c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa806f13640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa80015db00 0x7fa8000c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa806f13640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000cc9d0 con 0x7fa8000ce2b0 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa806f13640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000cb6f0 con 0x7fa80015db00 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa806f13640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000ccc20 con 0x7fa8000b53b0 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa7fffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 0x7fa8000c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa7fffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 0x7fa8000c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58416/0 (socket says 172.21.15.32:58416) 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa7fffff640 1 -- 172.21.15.32:0/2758669895 learned_addr learned my addr 172.21.15.32:0/2758669895 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa804caf640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8000b53b0 0x7fa8000b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.400+0000 7fa8054b0640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa80015db00 0x7fa8000c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fffff640 1 -- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8000b53b0 msgr2=0x7fa8000b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fffff640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8000b53b0 0x7fa8000b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fffff640 1 -- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa80015db00 msgr2=0x7fa8000c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fffff640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa80015db00 0x7fa8000c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fffff640 1 -- 172.21.15.32:0/2758669895 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009400 con 0x7fa8000ce2b0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fffff640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 0x7fa8000c6070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00c400 tx=0x7fa7ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0052d0 con 0x7fa8000ce2b0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec005430 con 0x7fa8000ce2b0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec003830 con 0x7fa8000ce2b0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8000ccf00 con 0x7fa8000ce2b0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.401+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000cd700 con 0x7fa8000ce2b0 2024-02-17T00:36:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.402+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8000cd420 con 0x7fa8000ce2b0 2024-02-17T00:36:31.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.402+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa7ec003990 con 0x7fa8000ce2b0 2024-02-17T00:36:31.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.403+0000 7fa7fd7fa640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa7e406b810 0x7fa7e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.403+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7ec0892c0 con 0x7fa8000ce2b0 2024-02-17T00:36:31.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.403+0000 7fa804caf640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa7e406b810 0x7fa7e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.404+0000 7fa804caf640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa7e406b810 0x7fa7e406dcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4036000 tx=0x7fa7f403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.407+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8000cd420 con 0x7fa8000ce2b0 2024-02-17T00:36:31.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.591+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8000cd420 con 0x7fa8000ce2b0 2024-02-17T00:36:31.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.592+0000 7fa7fd7fa640 1 -- 172.21.15.32:0/2758669895 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12836 (secure 0 0 0) 0x7fa8000cd420 con 0x7fa8000ce2b0 2024-02-17T00:36:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:31.596 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:28.931164+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa7e406b810 msgr2=0x7fa7e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa7e406b810 0x7fa7e406dcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4036000 tx=0x7fa7f403b040 comp rx=0 tx=0).stop 2024-02-17T00:36:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 msgr2=0x7fa8000c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 0x7fa8000c6070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00c400 tx=0x7fa7ec00c8c0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 shutdown_connections 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa80015db00 0x7fa8000c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8000ce2b0 0x7fa8000c6070 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa7e406b810 0x7fa7e406dcd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 --2- 172.21.15.32:0/2758669895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8000b53b0 0x7fa8000b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 >> 172.21.15.32:0/2758669895 conn(0x7fa800072290 msgr2=0x7fa8000b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 shutdown_connections 2024-02-17T00:36:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.594+0000 7fa806f13640 1 -- 172.21.15.32:0/2758669895 wait complete. 2024-02-17T00:36:31.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T00:36:31.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:36:31.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 Processor -- start 2024-02-17T00:36:31.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 -- start start 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9be00d3760 0x7f9be015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 0x7f9be00b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be00ce380 con 0x7f9be015f1c0 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be00ceff0 con 0x7f9be00d3760 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.709+0000 7f9be4b8c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be015f000 con 0x7f9be00ce830 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bd7fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9be015f1c0 0x7f9be00d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41564/0 (socket says 172.21.15.32:41564) 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bd7fff640 1 -- 172.21.15.32:0/4017478848 learned_addr learned my addr 172.21.15.32:0/4017478848 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 --2- 172.21.15.32:0/4017478848 >> v2:172.21.15.39:3300/0 conn(0x7f9be00d3760 0x7f9be015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290784207 0 0) 0x7f9be00ce380 con 0x7f9be015f1c0 2024-02-17T00:36:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bcc003520 con 0x7f9be015f1c0 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bded9d640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 0x7f9be00b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2114691389 0 0) 0x7f9bcc003520 con 0x7f9be015f1c0 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 msgr2=0x7f9be00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 0x7f9be00b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 >> v2:172.21.15.39:3300/0 conn(0x7f9be00d3760 msgr2=0x7f9be015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 --2- 172.21.15.32:0/4017478848 >> v2:172.21.15.39:3300/0 conn(0x7f9be00d3760 0x7f9be015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00d2190 con 0x7f9be015f1c0 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f9bc8001670 con 0x7f9be015f1c0 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 >> v1:172.21.15.32:6789/0 conn(0x7f9be015f1c0 legacy=0x7f9be00d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bcc003970 0x7f9bcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 0x7f9bcc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bcc004d00 0x7f9bcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00ceff0 con 0x7f9bcc003970 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be015f000 con 0x7f9bcc004d00 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc00b980 con 0x7f9be00ce830 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bcc003970 0x7f9bcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bd7fff640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 0x7f9bcc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bded9d640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bcc004d00 0x7f9bcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 -- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 msgr2=0x7f9bcc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9be00ce830 0x7f9bcc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 -- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bcc004d00 msgr2=0x7f9bcc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bcc004d00 0x7f9bcc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.710+0000 7f9bde59c640 1 -- 172.21.15.32:0/4017478848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc003520 con 0x7f9bcc003970 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.711+0000 7f9bde59c640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bcc003970 0x7f9bcc003d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009ac0 tx=0x7f9bcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0d7c3b767ab8f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.711+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd002c710 con 0x7f9bcc003970 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.711+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd002c870 con 0x7f9bcc003970 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.711+0000 7f9bddd9b640 1 -- 172.21.15.32:0/4017478848 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd002cc00 con 0x7f9bcc003970 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9be4b8c640 1 -- 172.21.15.32:0/4017478848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bcc003970 msgr2=0x7f9bcc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/4017478848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bcc003970 0x7f9bcc003d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009ac0 tx=0x7f9bcc0057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9bded9d640 1 -- 172.21.15.32:0/4017478848 reap_dead start 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9be4b8c640 1 -- 172.21.15.32:0/4017478848 shutdown_connections 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9be4b8c640 1 -- 172.21.15.32:0/4017478848 >> 172.21.15.32:0/4017478848 conn(0x7f9be0072680 msgr2=0x7f9be0072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9be4b8c640 1 -- 172.21.15.32:0/4017478848 shutdown_connections 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.712+0000 7f9be4b8c640 1 -- 172.21.15.32:0/4017478848 wait complete. 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.713+0000 7f9be4b8c640 1 Processor -- start 2024-02-17T00:36:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.713+0000 7f9be4b8c640 1 -- start start 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9be4b8c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9bcc003970 0x7f9be01576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9be4b8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9be0158e40 0x7f9be01f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9be4b8c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 0x7f9be00cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9be4b8c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be01f13b0 con 0x7f9be01f43e0 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9be4b8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0157da0 con 0x7f9be0158e40 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9be4b8c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0158080 con 0x7f9bcc003970 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 0x7f9be00cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 0x7f9be00cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58432/0 (socket says 172.21.15.32:58432) 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 -- 172.21.15.32:0/3868180660 learned_addr learned my addr 172.21.15.32:0/3868180660 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bde59c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9bcc003970 0x7f9be01576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bd7fff640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9be0158e40 0x7f9be01f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 -- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9bcc003970 msgr2=0x7f9be01576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9bcc003970 0x7f9be01576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 -- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9be0158e40 msgr2=0x7f9be01f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9be0158e40 0x7f9be01f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 -- 172.21.15.32:0/3868180660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0158360 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.714+0000 7f9bded9d640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 0x7f9be00cc6c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9be00b92e0 tx=0x7f9bd80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.715+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800e070 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.715+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd8011e10 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.715+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be0158640 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.715+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8003990 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.715+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be01f4860 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.716+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be0158b60 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.716+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9bd8003af0 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.716+0000 7f9bd6ffd640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9bc006b810 0x7f9bc006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.716+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9bd808a430 con 0x7f9be01f43e0 2024-02-17T00:36:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.716+0000 7f9bde59c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9bc006b810 0x7f9bc006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.717+0000 7f9bde59c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9bc006b810 0x7f9bc006dcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0036000 tx=0x7f9bd0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.721+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9be0158b60 con 0x7f9be01f43e0 2024-02-17T00:36:31.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.899+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9be0158b60 con 0x7f9be01f43e0 2024-02-17T00:36:31.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.900+0000 7f9bd6ffd640 1 -- 172.21.15.32:0/3868180660 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9be0158b60 con 0x7f9be01f43e0 2024-02-17T00:36:31.903 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:36:31.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.901+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9bc006b810 msgr2=0x7f9bc006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.901+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9bc006b810 0x7f9bc006dcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0036000 tx=0x7f9bd0030000 comp rx=0 tx=0).stop 2024-02-17T00:36:31.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.901+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 msgr2=0x7f9be00cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:31.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.901+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 0x7f9be00cc6c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9be00b92e0 tx=0x7f9bd80115a0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 shutdown_connections 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9be01f43e0 0x7f9be00cc6c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9be0158e40 0x7f9be01f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9bc006b810 0x7f9bc006dcd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 --2- 172.21.15.32:0/3868180660 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9bcc003970 0x7f9be01576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 >> 172.21.15.32:0/3868180660 conn(0x7f9be0072680 msgr2=0x7f9be00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 shutdown_connections 2024-02-17T00:36:31.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:31.902+0000 7f9be4b8c640 1 -- 172.21.15.32:0/3868180660 wait complete. 2024-02-17T00:36:31.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:36:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 Processor -- start 2024-02-17T00:36:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 -- start start 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0dc4145260 0x7f0dc40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc406b270 0x7f0dc415d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc4160110 con 0x7f0dc415c8f0 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc415cd80 con 0x7f0dc4145260 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dcaaa7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc415f500 con 0x7f0dc406b270 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.014+0000 7f0dc8843640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0dc4145260 0x7f0dc40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0dc4145260 0x7f0dc40726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58440/0 (socket says 172.21.15.32:58440) 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 -- 172.21.15.32:0/2409798491 learned_addr learned my addr 172.21.15.32:0/2409798491 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 -- 172.21.15.32:0/2409798491 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc406b270 msgr2=0x7f0dc415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 --2- 172.21.15.32:0/2409798491 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc406b270 0x7f0dc415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 -- 172.21.15.32:0/2409798491 >> v1:172.21.15.39:6789/0 conn(0x7f0dc415c8f0 legacy=0x7f0dc406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 -- 172.21.15.32:0/2409798491 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc415f7e0 con 0x7f0dc4145260 2024-02-17T00:36:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.015+0000 7f0dc8843640 1 --2- 172.21.15.32:0/2409798491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc4145260 0x7f0dc40726e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009870 tx=0x7f0dc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29e8adea2e7ba68 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dbb7fe640 1 -- 172.21.15.32:0/2409798491 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0031640 con 0x7f0dc4145260 2024-02-17T00:36:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dbb7fe640 1 -- 172.21.15.32:0/2409798491 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc00317a0 con 0x7f0dc4145260 2024-02-17T00:36:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dbb7fe640 1 -- 172.21.15.32:0/2409798491 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0031b30 con 0x7f0dc4145260 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/2409798491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc4145260 msgr2=0x7f0dc40726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/2409798491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc4145260 0x7f0dc40726e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009870 tx=0x7f0dc002b8f0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/2409798491 shutdown_connections 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/2409798491 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc406b270 0x7f0dc415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/2409798491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc4145260 0x7f0dc40726e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/2409798491 >> 172.21.15.32:0/2409798491 conn(0x7f0dc40b5c30 msgr2=0x7f0dc40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/2409798491 shutdown_connections 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.016+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/2409798491 wait complete. 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.017+0000 7f0dcaaa7640 1 Processor -- start 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.017+0000 7f0dcaaa7640 1 -- start start 2024-02-17T00:36:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dcaaa7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dc406b270 0x7f0dc4140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dcaaa7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc4145260 0x7f0dc409df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dcaaa7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 0x7f0dc40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dcaaa7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4140d70 con 0x7f0dc415c8f0 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dcaaa7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc409e440 con 0x7f0dc406b270 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dcaaa7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc414db10 con 0x7f0dc4145260 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dc9044640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 0x7f0dc40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dc9044640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 0x7f0dc40ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58442/0 (socket says 172.21.15.32:58442) 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dc9044640 1 -- 172.21.15.32:0/4100930388 learned_addr learned my addr 172.21.15.32:0/4100930388 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dbbfff640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc4145260 0x7f0dc409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.018+0000 7f0dc8843640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dc406b270 0x7f0dc4140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dc9044640 1 -- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc4145260 msgr2=0x7f0dc409df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dc9044640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc4145260 0x7f0dc409df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dc9044640 1 -- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dc406b270 msgr2=0x7f0dc4140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dc9044640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dc406b270 0x7f0dc4140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dc9044640 1 -- 172.21.15.32:0/4100930388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00094d0 con 0x7f0dc415c8f0 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dc9044640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 0x7f0dc40ce5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00b9a0 tx=0x7f0dbc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00cba0 con 0x7f0dc415c8f0 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00cd20 con 0x7f0dc415c8f0 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc414ddb0 con 0x7f0dc415c8f0 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc014680 con 0x7f0dc415c8f0 2024-02-17T00:36:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.019+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc414e370 con 0x7f0dc415c8f0 2024-02-17T00:36:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.020+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc4068fd0 con 0x7f0dc415c8f0 2024-02-17T00:36:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.020+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0dbc01d3b0 con 0x7f0dc415c8f0 2024-02-17T00:36:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.021+0000 7f0db97fa640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0db006b840 0x7f0db006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.021+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0dbc089c20 con 0x7f0dc415c8f0 2024-02-17T00:36:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.021+0000 7f0dc8843640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0db006b840 0x7f0db006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.022+0000 7f0dc8843640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0db006b840 0x7f0db006dd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0036000 tx=0x7f0dc003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:32.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.025+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0dbc054ad0 con 0x7f0dc415c8f0 2024-02-17T00:36:32.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.243+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc4070a20 con 0x7f0dc415c8f0 2024-02-17T00:36:32.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.243+0000 7f0db97fa640 1 -- 172.21.15.32:0/4100930388 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f0dbc019020 con 0x7f0dc415c8f0 2024-02-17T00:36:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:32.247 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-17T00:36:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 2 2024-02-17T00:36:32.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0db006b840 msgr2=0x7f0db006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:32.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0db006b840 0x7f0db006dd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0036000 tx=0x7f0dc003c040 comp rx=0 tx=0).stop 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 msgr2=0x7f0dc40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 0x7f0dc40ce5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00b9a0 tx=0x7f0dbc00be60 comp rx=0 tx=0).stop 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 shutdown_connections 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dc415c8f0 0x7f0dc40ce5e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0db006b840 0x7f0db006dd00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0dc4145260 0x7f0dc409df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 --2- 172.21.15.32:0/4100930388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dc406b270 0x7f0dc4140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 >> 172.21.15.32:0/4100930388 conn(0x7f0dc40b5c30 msgr2=0x7f0dc406e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 shutdown_connections 2024-02-17T00:36:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:32.245+0000 7f0dcaaa7640 1 -- 172.21.15.32:0/4100930388 wait complete. 2024-02-17T00:36:34.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:36:34.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.369+0000 7ffb0ea64640 1 Processor -- start 2024-02-17T00:36:34.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.369+0000 7ffb0ea64640 1 -- start start 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0ea64640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 0x7ffb081615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0ea64640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0ea64640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb080d1d90 con 0x7ffb08161b30 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0ea64640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080d23c0 con 0x7ffb0815dc10 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0ea64640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08162040 con 0x7ffb080d0950 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0c800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 0x7ffb081615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb07fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ffb08161b30 0x7ffb080d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:48426/0 (socket says 172.21.15.32:48426) 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb07fff640 1 -- 172.21.15.32:0/917143687 learned_addr learned my addr 172.21.15.32:0/917143687 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:34.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0c800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 0x7ffb081615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:53168/0 (socket says 172.21.15.32:53168) 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.370+0000 7ffb0d001640 1 --2- 172.21.15.32:0/917143687 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb0d001640 1 -- 172.21.15.32:0/917143687 >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 msgr2=0x7ffb081615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb0d001640 1 --2- 172.21.15.32:0/917143687 >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 0x7ffb081615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb0d001640 1 -- 172.21.15.32:0/917143687 >> v1:172.21.15.39:6789/0 conn(0x7ffb08161b30 legacy=0x7ffb080d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb0d001640 1 -- 172.21.15.32:0/917143687 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08162320 con 0x7ffb080d0950 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb077fe640 1 -- 172.21.15.32:0/917143687 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921647799 0 0) 0x7ffb080d1d90 con 0x7ffb08161b30 2024-02-17T00:36:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb0c800640 1 --2- 172.21.15.32:0/917143687 >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 0x7ffb081615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.371+0000 7ffb0d001640 1 --2- 172.21.15.32:0/917143687 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080d27e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009d90 tx=0x7ffb0002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c8d53133291bdd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb077fe640 1 -- 172.21.15.32:0/917143687 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0002cb30 con 0x7ffb080d0950 2024-02-17T00:36:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb077fe640 1 -- 172.21.15.32:0/917143687 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0002cc90 con 0x7ffb080d0950 2024-02-17T00:36:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb077fe640 1 -- 172.21.15.32:0/917143687 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00034440 con 0x7ffb080d0950 2024-02-17T00:36:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 -- 172.21.15.32:0/917143687 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 msgr2=0x7ffb080d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/917143687 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080d27e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009d90 tx=0x7ffb0002bd80 comp rx=0 tx=0).stop 2024-02-17T00:36:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 -- 172.21.15.32:0/917143687 shutdown_connections 2024-02-17T00:36:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/917143687 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080d27e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/917143687 >> v2:172.21.15.39:3300/0 conn(0x7ffb0815dc10 0x7ffb081615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 -- 172.21.15.32:0/917143687 >> 172.21.15.32:0/917143687 conn(0x7ffb08072290 msgr2=0x7ffb080726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 -- 172.21.15.32:0/917143687 shutdown_connections 2024-02-17T00:36:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.372+0000 7ffb0ea64640 1 -- 172.21.15.32:0/917143687 wait complete. 2024-02-17T00:36:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.373+0000 7ffb0ea64640 1 Processor -- start 2024-02-17T00:36:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 -- start start 2024-02-17T00:36:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb0815dc10 0x7ffb080c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 0x7ffb080c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815f6b0 con 0x7ffb08161b30 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815eaa0 con 0x7ffb0815dc10 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0ea64640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815ed80 con 0x7ffb080d0950 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.374+0000 7ffb0d001640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 0x7ffb080c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 0x7ffb080c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42782/0 (socket says 172.21.15.32:42782) 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 -- 172.21.15.32:0/1724680989 learned_addr learned my addr 172.21.15.32:0/1724680989 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb07fff640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb0815dc10 0x7ffb080c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0c800640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 -- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 msgr2=0x7ffb080b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 -- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb0815dc10 msgr2=0x7ffb080c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb0815dc10 0x7ffb080c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 -- 172.21.15.32:0/1724680989 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc009400 con 0x7ffb08161b30 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0d001640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 0x7ffb080c8970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb00037040 tx=0x7ffb00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00009450 con 0x7ffb08161b30 2024-02-17T00:36:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00003990 con 0x7ffb08161b30 2024-02-17T00:36:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb00009a70 con 0x7ffb08161b30 2024-02-17T00:36:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00003b20 con 0x7ffb08161b30 2024-02-17T00:36:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.375+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0815f340 con 0x7ffb08161b30 2024-02-17T00:36:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.376+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0815f820 con 0x7ffb08161b30 2024-02-17T00:36:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.377+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ffb00049460 con 0x7ffb08161b30 2024-02-17T00:36:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.377+0000 7ffb057fa640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffaec06b810 0x7ffaec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.378+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb000ac3f0 con 0x7ffb08161b30 2024-02-17T00:36:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.378+0000 7ffb0c800640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffaec06b810 0x7ffaec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.378+0000 7ffb0c800640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffaec06b810 0x7ffaec06dcd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009c60 tx=0x7ffafc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.382+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb000770c0 con 0x7ffb08161b30 2024-02-17T00:36:34.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.605+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb08068fd0 con 0x7ffb08161b30 2024-02-17T00:36:34.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.605+0000 7ffb057fa640 1 -- 172.21.15.32:0/1724680989 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7ffb00039e80 con 0x7ffb08161b30 2024-02-17T00:36:34.609 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:34.609 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-17T00:36:34.609 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffaec06b810 msgr2=0x7ffaec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffaec06b810 0x7ffaec06dcd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009c60 tx=0x7ffafc008040 comp rx=0 tx=0).stop 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 msgr2=0x7ffb080c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 0x7ffb080c8970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb00037040 tx=0x7ffb00004a40 comp rx=0 tx=0).stop 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 shutdown_connections 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb08161b30 0x7ffb080c8970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb0815dc10 0x7ffb080c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffaec06b810 0x7ffaec06dcd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 --2- 172.21.15.32:0/1724680989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffb080d0950 0x7ffb080b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 >> 172.21.15.32:0/1724680989 conn(0x7ffb08072290 msgr2=0x7ffb080cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:34.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 shutdown_connections 2024-02-17T00:36:34.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.607+0000 7ffb0ea64640 1 -- 172.21.15.32:0/1724680989 wait complete. 2024-02-17T00:36:34.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.721+0000 7f4ebd148640 1 Processor -- start 2024-02-17T00:36:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.721+0000 7f4ebd148640 1 -- start start 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4ebd148640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4eb815d920 0x7f4eb8161630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4ebd148640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb80d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4ebd148640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb80d1de0 con 0x7f4eb80b9250 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4ebd148640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb8162560 con 0x7f4eb815d920 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4ebd148640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8161fa0 con 0x7f4eb80ced30 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb80d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb6d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4eb815d920 0x7f4eb8161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb80d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:38594/0 (socket says 172.21.15.32:38594) 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 -- 172.21.15.32:0/2824238323 learned_addr learned my addr 172.21.15.32:0/2824238323 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eaffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4eb80b9250 0x7f4eb80ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:48436/0 (socket says 172.21.15.32:48436) 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 -- 172.21.15.32:0/2824238323 >> v2:172.21.15.39:3300/0 conn(0x7f4eb815d920 msgr2=0x7f4eb8161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 --2- 172.21.15.32:0/2824238323 >> v2:172.21.15.39:3300/0 conn(0x7f4eb815d920 0x7f4eb8161630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 -- 172.21.15.32:0/2824238323 >> v1:172.21.15.39:6789/0 conn(0x7f4eb80b9250 legacy=0x7f4eb80ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.722+0000 7f4eb759e640 1 -- 172.21.15.32:0/2824238323 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8162280 con 0x7f4eb80ced30 2024-02-17T00:36:34.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.723+0000 7f4eb759e640 1 --2- 172.21.15.32:0/2824238323 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb80d2270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009e50 tx=0x7f4eb002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13645058701cd8a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:34.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.723+0000 7f4eb659c640 1 -- 172.21.15.32:0/2824238323 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb002ca70 con 0x7f4eb80ced30 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.723+0000 7f4eb659c640 1 -- 172.21.15.32:0/2824238323 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb002cbd0 con 0x7f4eb80ced30 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.723+0000 7f4eb659c640 1 -- 172.21.15.32:0/2824238323 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00343f0 con 0x7f4eb80ced30 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 -- 172.21.15.32:0/2824238323 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 msgr2=0x7f4eb80d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 --2- 172.21.15.32:0/2824238323 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb80d2270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009e50 tx=0x7f4eb002bed0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 -- 172.21.15.32:0/2824238323 shutdown_connections 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 --2- 172.21.15.32:0/2824238323 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb80d2270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 --2- 172.21.15.32:0/2824238323 >> v2:172.21.15.39:3300/0 conn(0x7f4eb815d920 0x7f4eb8161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 -- 172.21.15.32:0/2824238323 >> 172.21.15.32:0/2824238323 conn(0x7f4eb806bfe0 msgr2=0x7f4eb806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 -- 172.21.15.32:0/2824238323 shutdown_connections 2024-02-17T00:36:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.724+0000 7f4ebd148640 1 -- 172.21.15.32:0/2824238323 wait complete. 2024-02-17T00:36:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.725+0000 7f4ebd148640 1 Processor -- start 2024-02-17T00:36:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.725+0000 7f4ebd148640 1 -- start start 2024-02-17T00:36:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4ebd148640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 0x7f4eb814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4ebd148640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb81f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4ebd148640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb815d920 0x7f4eb815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4ebd148640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb815a5e0 con 0x7f4eb80b9250 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4ebd148640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8159680 con 0x7f4eb815d920 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4ebd148640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8159960 con 0x7f4eb80ced30 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 0x7f4eb814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 0x7f4eb814d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42788/0 (socket says 172.21.15.32:42788) 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 -- 172.21.15.32:0/3734816284 learned_addr learned my addr 172.21.15.32:0/3734816284 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eaffff640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb81f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb759e640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb815d920 0x7f4eb815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 -- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 msgr2=0x7f4eb81f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb81f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 -- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb815d920 msgr2=0x7f4eb815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb815d920 0x7f4eb815bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb6d9d640 1 -- 172.21.15.32:0/3734816284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb0009b30 con 0x7f4eb80b9250 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eaffff640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb81f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.726+0000 7f4eb759e640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb815d920 0x7f4eb815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.727+0000 7f4eb6d9d640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 0x7f4eb814d1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800e870 tx=0x7f4ea800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.727+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80094f0 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.727+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea800c940 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.727+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb8159c40 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.727+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800ccf0 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.727+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb815a200 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.728+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb8068fd0 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.728+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4ea8013470 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.728+0000 7f4eaf7fe640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e9806b810 0x7f4e9806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.729+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ea8089fc0 con 0x7f4eb80b9250 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.729+0000 7f4eaffff640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e9806b810 0x7f4e9806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.729+0000 7f4eaffff640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e9806b810 0x7f4e9806dcd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80d4870 tx=0x7f4ea0007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.733+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ea8054d40 con 0x7f4eb80b9250 2024-02-17T00:36:34.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.914+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eb80d14f0 con 0x7f4eb80b9250 2024-02-17T00:36:34.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.915+0000 7f4eaf7fe640 1 -- 172.21.15.32:0/3734816284 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12836 (secure 0 0 0) 0x7f4ea8017090 con 0x7f4eb80b9250 2024-02-17T00:36:34.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:34.918 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:28.931164+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:34.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e9806b810 msgr2=0x7f4e9806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e9806b810 0x7f4e9806dcd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80d4870 tx=0x7f4ea0007e80 comp rx=0 tx=0).stop 2024-02-17T00:36:34.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 msgr2=0x7f4eb814d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:34.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 0x7f4eb814d1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800e870 tx=0x7f4ea800ed30 comp rx=0 tx=0).stop 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 shutdown_connections 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb815d920 0x7f4eb815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e9806b810 0x7f4e9806dcd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4eb80ced30 0x7f4eb81f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 --2- 172.21.15.32:0/3734816284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4eb80b9250 0x7f4eb814d1d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.916+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 >> 172.21.15.32:0/3734816284 conn(0x7f4eb806bfe0 msgr2=0x7f4eb80c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.917+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 shutdown_connections 2024-02-17T00:36:34.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:34.917+0000 7f4ebd148640 1 -- 172.21.15.32:0/3734816284 wait complete. 2024-02-17T00:36:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T00:36:34.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:36:35.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.032+0000 7f16a9415640 1 Processor -- start 2024-02-17T00:36:35.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.032+0000 7f16a9415640 1 -- start start 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a9415640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f16a415f1c0 0x7f16a415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a9415640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a40ce830 0x7f16a40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a9415640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a40ce380 con 0x7f16a40d3760 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a9415640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40ceff0 con 0x7f16a415f1c0 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a9415640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a415f000 con 0x7f16a40ce830 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f169bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f16a415f1c0 0x7f16a415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a2ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f16a40d3760 0x7f16a40d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:48440/0 (socket says 172.21.15.32:48440) 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a37fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a40ce830 0x7f16a40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a2ffd640 1 -- 172.21.15.32:0/1767704434 learned_addr learned my addr 172.21.15.32:0/1767704434 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f169bfff640 1 -- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a40ce830 msgr2=0x7f16a40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f169bfff640 1 --2- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a40ce830 0x7f16a40b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f169bfff640 1 -- 172.21.15.32:0/1767704434 >> v1:172.21.15.39:6789/0 conn(0x7f16a40d3760 legacy=0x7f16a40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f169bfff640 1 -- 172.21.15.32:0/1767704434 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40d2190 con 0x7f16a415f1c0 2024-02-17T00:36:35.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.033+0000 7f16a37fe640 1 --2- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a40ce830 0x7f16a40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:35.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.034+0000 7f169bfff640 1 --2- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a415f1c0 0x7f16a415eac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e466f67bb5e82e9e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.034+0000 7f16a27fc640 1 -- 172.21.15.32:0/1767704434 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c031830 con 0x7f16a415f1c0 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.034+0000 7f16a27fc640 1 -- 172.21.15.32:0/1767704434 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c031990 con 0x7f16a415f1c0 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.034+0000 7f16a27fc640 1 -- 172.21.15.32:0/1767704434 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c031d20 con 0x7f16a415f1c0 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 -- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a415f1c0 msgr2=0x7f16a415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 --2- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a415f1c0 0x7f16a415eac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 -- 172.21.15.32:0/1767704434 shutdown_connections 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 --2- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a40ce830 0x7f16a40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 --2- 172.21.15.32:0/1767704434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a415f1c0 0x7f16a415eac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 -- 172.21.15.32:0/1767704434 >> 172.21.15.32:0/1767704434 conn(0x7f16a4072680 msgr2=0x7f16a4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 -- 172.21.15.32:0/1767704434 shutdown_connections 2024-02-17T00:36:35.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.035+0000 7f16a9415640 1 -- 172.21.15.32:0/1767704434 wait complete. 2024-02-17T00:36:35.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.036+0000 7f16a9415640 1 Processor -- start 2024-02-17T00:36:35.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.036+0000 7f16a9415640 1 -- start start 2024-02-17T00:36:35.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a9415640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40ce830 0x7f16a40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a9415640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 0x7f16a40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a9415640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a415f1c0 0x7f16a40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a9415640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40aa1c0 con 0x7f16a40d3760 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a9415640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40b6180 con 0x7f16a40ce830 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a9415640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40ca8a0 con 0x7f16a415f1c0 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 0x7f16a40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 0x7f16a40c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42790/0 (socket says 172.21.15.32:42790) 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 -- 172.21.15.32:0/3016529263 learned_addr learned my addr 172.21.15.32:0/3016529263 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a2ffd640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40ce830 0x7f16a40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f16a37fe640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a415f1c0 0x7f16a40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 -- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a415f1c0 msgr2=0x7f16a40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a415f1c0 0x7f16a40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 -- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40ce830 msgr2=0x7f16a40b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40ce830 0x7f16a40b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 -- 172.21.15.32:0/3016529263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c009a70 con 0x7f16a40d3760 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.037+0000 7f169bfff640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 0x7f16a40c92f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f168c034040 tx=0x7f168c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.038+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c03a830 con 0x7f16a40d3760 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.038+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c03a9b0 con 0x7f16a40d3760 2024-02-17T00:36:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.038+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c03ad60 con 0x7f16a40d3760 2024-02-17T00:36:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.038+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c009400 con 0x7f16a40d3760 2024-02-17T00:36:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.038+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a40cadd0 con 0x7f16a40d3760 2024-02-17T00:36:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.039+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4068f60 con 0x7f16a40d3760 2024-02-17T00:36:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.039+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f168c04d440 con 0x7f16a40d3760 2024-02-17T00:36:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.039+0000 7f169b7fe640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f168406b810 0x7f168406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.040+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f168c0abde0 con 0x7f16a40d3760 2024-02-17T00:36:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.040+0000 7f16a2ffd640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f168406b810 0x7f168406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.040+0000 7f16a2ffd640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f168406b810 0x7f168406dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1694007fd0 tx=0x7f1694007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.044+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f168c076b40 con 0x7f16a40d3760 2024-02-17T00:36:35.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.223+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16a40ce610 con 0x7f16a40d3760 2024-02-17T00:36:35.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.223+0000 7f169b7fe640 1 -- 172.21.15.32:0/3016529263 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f168c035020 con 0x7f16a40d3760 2024-02-17T00:36:35.227 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f168406b810 msgr2=0x7f168406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f168406b810 0x7f168406dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1694007fd0 tx=0x7f1694007e80 comp rx=0 tx=0).stop 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 msgr2=0x7f16a40c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 0x7f16a40c92f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f168c034040 tx=0x7f168c0046c0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 shutdown_connections 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f168406b810 0x7f168406dcd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f16a415f1c0 0x7f16a40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16a40d3760 0x7f16a40c92f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 --2- 172.21.15.32:0/3016529263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40ce830 0x7f16a40b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 >> 172.21.15.32:0/3016529263 conn(0x7f16a4072680 msgr2=0x7f16a40b72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 shutdown_connections 2024-02-17T00:36:35.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.225+0000 7f16a9415640 1 -- 172.21.15.32:0/3016529263 wait complete. 2024-02-17T00:36:35.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T00:36:35.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.337+0000 7fe3da8df640 1 Processor -- start 2024-02-17T00:36:35.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.338+0000 7fe3da8df640 1 -- start start 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.338+0000 7fe3da8df640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe3d4145260 0x7fe3d40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.338+0000 7fe3da8df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 0x7fe3d406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.338+0000 7fe3da8df640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d4160110 con 0x7fe3d406b0a0 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.338+0000 7fe3da8df640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d406b530 con 0x7fe3d4145260 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.338+0000 7fe3da8df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d415cd50 con 0x7fe3d415c8f0 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 0x7fe3d406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d3fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe3d4145260 0x7fe3d40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 0x7fe3d406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:38616/0 (socket says 172.21.15.32:38616) 2024-02-17T00:36:35.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 -- 172.21.15.32:0/2772814268 learned_addr learned my addr 172.21.15.32:0/2772814268 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:35.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d8e7c640 1 --1- 172.21.15.32:0/2772814268 >> v1:172.21.15.39:6789/0 conn(0x7fe3d406b0a0 0x7fe3d40d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:48444/0 (socket says 172.21.15.32:48444) 2024-02-17T00:36:35.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 -- 172.21.15.32:0/2772814268 >> v2:172.21.15.39:3300/0 conn(0x7fe3d4145260 msgr2=0x7fe3d40726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:35.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 --2- 172.21.15.32:0/2772814268 >> v2:172.21.15.39:3300/0 conn(0x7fe3d4145260 0x7fe3d40726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 -- 172.21.15.32:0/2772814268 >> v1:172.21.15.39:6789/0 conn(0x7fe3d406b0a0 legacy=0x7fe3d40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d2ffd640 1 -- 172.21.15.32:0/2772814268 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397401753 0 0) 0x7fe3d4160110 con 0x7fe3d406b0a0 2024-02-17T00:36:35.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.339+0000 7fe3d37fe640 1 -- 172.21.15.32:0/2772814268 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d415f500 con 0x7fe3d415c8f0 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.340+0000 7fe3d37fe640 1 --2- 172.21.15.32:0/2772814268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 0x7fe3d406ab60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009870 tx=0x7fe3c802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c16df8e3304a449 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.340+0000 7fe3d2ffd640 1 -- 172.21.15.32:0/2772814268 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8030840 con 0x7fe3d415c8f0 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.340+0000 7fe3d2ffd640 1 -- 172.21.15.32:0/2772814268 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c80309a0 con 0x7fe3d415c8f0 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.340+0000 7fe3d2ffd640 1 -- 172.21.15.32:0/2772814268 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8030d30 con 0x7fe3d415c8f0 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.340+0000 7fe3da8df640 1 -- 172.21.15.32:0/2772814268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 msgr2=0x7fe3d406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.340+0000 7fe3da8df640 1 --2- 172.21.15.32:0/2772814268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 0x7fe3d406ab60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009870 tx=0x7fe3c802b980 comp rx=0 tx=0).stop 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.341+0000 7fe3da8df640 1 -- 172.21.15.32:0/2772814268 shutdown_connections 2024-02-17T00:36:35.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.341+0000 7fe3da8df640 1 --2- 172.21.15.32:0/2772814268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d415c8f0 0x7fe3d406ab60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.341+0000 7fe3da8df640 1 --2- 172.21.15.32:0/2772814268 >> v2:172.21.15.39:3300/0 conn(0x7fe3d4145260 0x7fe3d40726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.341+0000 7fe3da8df640 1 -- 172.21.15.32:0/2772814268 >> 172.21.15.32:0/2772814268 conn(0x7fe3d40b5c30 msgr2=0x7fe3d40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:35.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.341+0000 7fe3da8df640 1 -- 172.21.15.32:0/2772814268 shutdown_connections 2024-02-17T00:36:35.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.341+0000 7fe3da8df640 1 -- 172.21.15.32:0/2772814268 wait complete. 2024-02-17T00:36:35.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.342+0000 7fe3da8df640 1 Processor -- start 2024-02-17T00:36:35.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.342+0000 7fe3da8df640 1 -- start start 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d406b0a0 0x7fe3d4141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d4145260 0x7fe3d40b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 0x7fe3d409c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40b0440 con 0x7fe3d415c8f0 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40af7c0 con 0x7fe3d4145260 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40afaa0 con 0x7fe3d406b0a0 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 0x7fe3d409c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 0x7fe3d409c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42792/0 (socket says 172.21.15.32:42792) 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 -- 172.21.15.32:0/3347855287 learned_addr learned my addr 172.21.15.32:0/3347855287 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:35.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d37fe640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d4145260 0x7fe3d40b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d3fff640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d406b0a0 0x7fe3d4141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 -- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d406b0a0 msgr2=0x7fe3d4141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d406b0a0 0x7fe3d4141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 -- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d4145260 msgr2=0x7fe3d40b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d4145260 0x7fe3d40b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 -- 172.21.15.32:0/3347855287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80094d0 con 0x7fe3d415c8f0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d3fff640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d406b0a0 0x7fe3d4141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d37fe640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d4145260 0x7fe3d40b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d8e7c640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 0x7fe3d409c520 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c7a0 tx=0x7fe3cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00a640 con 0x7fe3d415c8f0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00a7a0 con 0x7fe3d415c8f0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40afd80 con 0x7fe3d415c8f0 2024-02-17T00:36:35.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00abd0 con 0x7fe3d415c8f0 2024-02-17T00:36:35.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.343+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d4141fe0 con 0x7fe3d415c8f0 2024-02-17T00:36:35.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.344+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d40b0580 con 0x7fe3d415c8f0 2024-02-17T00:36:35.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.345+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe3cc00ad30 con 0x7fe3d415c8f0 2024-02-17T00:36:35.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.345+0000 7fe3d0ff9640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe3c006b810 0x7fe3c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.345+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe3cc0896e0 con 0x7fe3d415c8f0 2024-02-17T00:36:35.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.345+0000 7fe3d3fff640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe3c006b810 0x7fe3c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.346+0000 7fe3d3fff640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe3c006b810 0x7fe3c006dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009b90 tx=0x7fe3c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.349+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3d40b0580 con 0x7fe3d415c8f0 2024-02-17T00:36:35.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.529+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe3d40b0580 con 0x7fe3d415c8f0 2024-02-17T00:36:35.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.530+0000 7fe3d0ff9640 1 -- 172.21.15.32:0/3347855287 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe3d40b0580 con 0x7fe3d415c8f0 2024-02-17T00:36:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:35.533 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-02-17T00:36:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:36:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-02-17T00:36:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-02-17T00:36:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:36:35.534 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-02-17T00:36:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe3c006b810 msgr2=0x7fe3c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe3c006b810 0x7fe3c006dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009b90 tx=0x7fe3c4008040 comp rx=0 tx=0).stop 2024-02-17T00:36:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 msgr2=0x7fe3d409c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 0x7fe3d409c520 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c7a0 tx=0x7fe3cc00cc60 comp rx=0 tx=0).stop 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 shutdown_connections 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3d415c8f0 0x7fe3d409c520 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d4145260 0x7fe3d40b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe3c006b810 0x7fe3c006dcd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 --2- 172.21.15.32:0/3347855287 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe3d406b0a0 0x7fe3d4141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.531+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 >> 172.21.15.32:0/3347855287 conn(0x7fe3d40b5c30 msgr2=0x7fe3d4143cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.532+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 shutdown_connections 2024-02-17T00:36:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.532+0000 7fe3da8df640 1 -- 172.21.15.32:0/3347855287 wait complete. 2024-02-17T00:36:35.546 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T00:36:35.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T00:36:35.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.648+0000 7fa3b3bf4640 1 Processor -- start 2024-02-17T00:36:35.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.648+0000 7fa3b3bf4640 1 -- start start 2024-02-17T00:36:35.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b3bf4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 0x7fa3ac0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b3bf4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa3ac0b9240 0x7fa3ac0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b3bf4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0b7500 con 0x7fa3ac0ce900 2024-02-17T00:36:35.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b3bf4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac0cee00 con 0x7fa3ac0b9240 2024-02-17T00:36:35.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b3bf4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0b7750 con 0x7fa3ac15d9b0 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b1990640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 0x7fa3ac0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b1990640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 0x7fa3ac0d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:38636/0 (socket says 172.21.15.32:38636) 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b1990640 1 -- 172.21.15.32:0/3850627601 learned_addr learned my addr 172.21.15.32:0/3850627601 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b2191640 1 --2- 172.21.15.32:0/3850627601 >> v2:172.21.15.39:3300/0 conn(0x7fa3ac0b9240 0x7fa3ac0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.649+0000 7fa3b118f640 1 --1- 172.21.15.32:0/3850627601 >> v1:172.21.15.39:6789/0 conn(0x7fa3ac0ce900 0x7fa3ac161520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:48460/0 (socket says 172.21.15.32:48460) 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b2191640 1 -- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 msgr2=0x7fa3ac0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b2191640 1 --2- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 0x7fa3ac0d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b2191640 1 -- 172.21.15.32:0/3850627601 >> v1:172.21.15.39:6789/0 conn(0x7fa3ac0ce900 legacy=0x7fa3ac161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b2191640 1 -- 172.21.15.32:0/3850627601 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0b7a30 con 0x7fa3ac0b9240 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b098e640 1 -- 172.21.15.32:0/3850627601 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569380530 0 0) 0x7fa3ac0b7500 con 0x7fa3ac0ce900 2024-02-17T00:36:35.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b1990640 1 --2- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 0x7fa3ac0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.650+0000 7fa3b2191640 1 --2- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac0d0d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d90 tx=0x7fa39c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4425af8bfbbaaef8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b098e640 1 -- 172.21.15.32:0/3850627601 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c02cc50 con 0x7fa3ac0b9240 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b098e640 1 -- 172.21.15.32:0/3850627601 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c02cdb0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b098e640 1 -- 172.21.15.32:0/3850627601 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c034660 con 0x7fa3ac0b9240 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac0b9240 msgr2=0x7fa3ac0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac0d0d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d90 tx=0x7fa39c02bea0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/3850627601 shutdown_connections 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac0d0d50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/3850627601 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac15d9b0 0x7fa3ac0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/3850627601 >> 172.21.15.32:0/3850627601 conn(0x7fa3ac0726b0 msgr2=0x7fa3ac072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:35.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/3850627601 shutdown_connections 2024-02-17T00:36:35.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.651+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/3850627601 wait complete. 2024-02-17T00:36:35.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.652+0000 7fa3b3bf4640 1 Processor -- start 2024-02-17T00:36:35.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.652+0000 7fa3b3bf4640 1 -- start start 2024-02-17T00:36:35.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b3bf4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b3bf4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac0ce900 0x7fa3ac0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b3bf4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac15d9b0 0x7fa3ac0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b3bf4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac158600 con 0x7fa3ac0b9240 2024-02-17T00:36:35.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b3bf4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0cad50 con 0x7fa3ac15d9b0 2024-02-17T00:36:35.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b3bf4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0cb030 con 0x7fa3ac0ce900 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac1580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42804/0 (socket says 172.21.15.32:42804) 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 -- 172.21.15.32:0/2484100991 learned_addr learned my addr 172.21.15.32:0/2484100991 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b118f640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac0ce900 0x7fa3ac0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b2191640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac15d9b0 0x7fa3ac0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 -- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac0ce900 msgr2=0x7fa3ac0cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac0ce900 0x7fa3ac0cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 -- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac15d9b0 msgr2=0x7fa3ac0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac15d9b0 0x7fa3ac0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.653+0000 7fa3b1990640 1 -- 172.21.15.32:0/2484100991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40094d0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3b2191640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac15d9b0 0x7fa3ac0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3b1990640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac1580c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400e9d0 tx=0x7fa3a400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400ca60 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400cbc0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c009a70 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4013470 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.654+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac0cb5f0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.655+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac0680c0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.655+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa3a40135d0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.655+0000 7fa3aa7fc640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa39806b810 0x7fa39806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.656+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3a408a1c0 con 0x7fa3ac0b9240 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.656+0000 7fa3b118f640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa39806b810 0x7fa39806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:35.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.656+0000 7fa3b118f640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa39806b810 0x7fa39806dcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac068090 tx=0x7fa3a0007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:35.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.660+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3a4054f30 con 0x7fa3ac0b9240 2024-02-17T00:36:35.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:35.838+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa3ac069040 con 0x7fa3ac0b9240 2024-02-17T00:36:35.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:36:35.903 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:36:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.007+0000 7fa3aa7fc640 1 -- 172.21.15.32:0/2484100991 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa3a4088e60 con 0x7fa3ac0b9240 2024-02-17T00:36:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-02-17T00:36:36.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa39806b810 msgr2=0x7fa39806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:36.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa39806b810 0x7fa39806dcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac068090 tx=0x7fa3a0007b50 comp rx=0 tx=0).stop 2024-02-17T00:36:36.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 msgr2=0x7fa3ac1580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac1580c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400e9d0 tx=0x7fa3a400ee90 comp rx=0 tx=0).stop 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 shutdown_connections 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3ac15d9b0 0x7fa3ac0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa39806b810 0x7fa39806dcd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa3ac0ce900 0x7fa3ac0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 --2- 172.21.15.32:0/2484100991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3ac0b9240 0x7fa3ac1580c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 >> 172.21.15.32:0/2484100991 conn(0x7fa3ac0726b0 msgr2=0x7fa3ac0d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 shutdown_connections 2024-02-17T00:36:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.009+0000 7fa3b3bf4640 1 -- 172.21.15.32:0/2484100991 wait complete. 2024-02-17T00:36:36.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-02-17T00:36:36.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.170+0000 7f93f84c0640 1 Processor -- start 2024-02-17T00:36:36.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.171+0000 7f93f84c0640 1 -- start start 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.171+0000 7f93f84c0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f93f015eba0 0x7f93f006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.171+0000 7f93f84c0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f93f006ab60 0x7f93f006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.171+0000 7f93f84c0640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f006b4b0 con 0x7f93f015d7b0 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.171+0000 7f93f84c0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f01618f0 con 0x7f93f015eba0 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.171+0000 7f93f84c0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f0161bd0 con 0x7f93f006ab60 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f625c640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f93f015d7b0 0x7f93f00b53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48062/0 (socket says 172.21.15.32:48062) 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f625c640 1 -- 172.21.15.32:0/2899084211 learned_addr learned my addr 172.21.15.32:0/2899084211 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f5a5b640 1 --2- 172.21.15.32:0/2899084211 >> v2:172.21.15.32:3300/0 conn(0x7f93f015eba0 0x7f93f006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f6a5d640 1 --2- 172.21.15.32:0/2899084211 >> v2:172.21.15.39:3300/0 conn(0x7f93f006ab60 0x7f93f006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f525a640 1 -- 172.21.15.32:0/2899084211 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221645770 0 0) 0x7f93f006b4b0 con 0x7f93f015d7b0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f525a640 1 -- 172.21.15.32:0/2899084211 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d8003520 con 0x7f93f015d7b0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f5a5b640 1 -- 172.21.15.32:0/2899084211 >> v2:172.21.15.39:3300/0 conn(0x7f93f006ab60 msgr2=0x7f93f006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f5a5b640 1 --2- 172.21.15.32:0/2899084211 >> v2:172.21.15.39:3300/0 conn(0x7f93f006ab60 0x7f93f006af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f5a5b640 1 -- 172.21.15.32:0/2899084211 >> v1:172.21.15.32:6789/0 conn(0x7f93f015d7b0 legacy=0x7f93f00b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f5a5b640 1 -- 172.21.15.32:0/2899084211 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0161eb0 con 0x7f93f015eba0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.172+0000 7f93f6a5d640 1 --2- 172.21.15.32:0/2899084211 >> v2:172.21.15.39:3300/0 conn(0x7f93f006ab60 0x7f93f006af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f5a5b640 1 --2- 172.21.15.32:0/2899084211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f015eba0 0x7f93f006fa00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097a0 tx=0x7f93e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61897dd20d2280ff server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f525a640 1 -- 172.21.15.32:0/2899084211 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e402e070 con 0x7f93f015eba0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f525a640 1 -- 172.21.15.32:0/2899084211 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40315a0 con 0x7f93f015eba0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f525a640 1 -- 172.21.15.32:0/2899084211 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4031930 con 0x7f93f015eba0 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 -- 172.21.15.32:0/2899084211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f015eba0 msgr2=0x7f93f006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 --2- 172.21.15.32:0/2899084211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f015eba0 0x7f93f006fa00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097a0 tx=0x7f93e402b840 comp rx=0 tx=0).stop 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 -- 172.21.15.32:0/2899084211 shutdown_connections 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 --2- 172.21.15.32:0/2899084211 >> v2:172.21.15.39:3300/0 conn(0x7f93f006ab60 0x7f93f006af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 --2- 172.21.15.32:0/2899084211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f015eba0 0x7f93f006fa00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 -- 172.21.15.32:0/2899084211 >> 172.21.15.32:0/2899084211 conn(0x7f93f00b2390 msgr2=0x7f93f00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 -- 172.21.15.32:0/2899084211 shutdown_connections 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.173+0000 7f93f84c0640 1 -- 172.21.15.32:0/2899084211 wait complete. 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 Processor -- start 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 -- start start 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 0x7f93f0147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f93f015d7b0 0x7f93f014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f015eba0 0x7f93f014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f015c920 con 0x7f93f006ab60 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0148dd0 con 0x7f93f015eba0 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f84c0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f01490b0 con 0x7f93f015d7b0 2024-02-17T00:36:36.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f625c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 0x7f93f0147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f625c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 0x7f93f0147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42822/0 (socket says 172.21.15.32:42822) 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f625c640 1 -- 172.21.15.32:0/3794894527 learned_addr learned my addr 172.21.15.32:0/3794894527 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f6a5d640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f015eba0 0x7f93f014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.175+0000 7f93f5a5b640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f93f015d7b0 0x7f93f014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f625c640 1 -- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f93f015d7b0 msgr2=0x7f93f014a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f625c640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f93f015d7b0 0x7f93f014a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f625c640 1 -- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f015eba0 msgr2=0x7f93f014a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f625c640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f015eba0 0x7f93f014a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f625c640 1 -- 172.21.15.32:0/3794894527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4009400 con 0x7f93f006ab60 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f625c640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 0x7f93f0147880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93e800c430 tx=0x7f93e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8005ce0 con 0x7f93f006ab60 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e8005e40 con 0x7f93f006ab60 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f0149390 con 0x7f93f006ab60 2024-02-17T00:36:36.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80072f0 con 0x7f93f006ab60 2024-02-17T00:36:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.176+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f0149950 con 0x7f93f006ab60 2024-02-17T00:36:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.177+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f0068fd0 con 0x7f93f006ab60 2024-02-17T00:36:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.178+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f93e8007450 con 0x7f93f006ab60 2024-02-17T00:36:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.178+0000 7f93eeffd640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f93dc06b810 0x7f93dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.178+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f93e80896c0 con 0x7f93f006ab60 2024-02-17T00:36:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.178+0000 7f93f5a5b640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f93dc06b810 0x7f93dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:36.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.179+0000 7f93f5a5b640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f93dc06b810 0x7f93dc06dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f93e4036000 tx=0x7f93e403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:36.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.182+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93e80542e0 con 0x7f93f006ab60 2024-02-17T00:36:36.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:36.363+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f93f0070440 con 0x7f93f006ab60 2024-02-17T00:36:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.009+0000 7f93eeffd640 1 -- 172.21.15.32:0/3794894527 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f93e8017020 con 0x7f93f006ab60 2024-02-17T00:36:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-02-17T00:36:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f93dc06b810 msgr2=0x7f93dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f93dc06b810 0x7f93dc06dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f93e4036000 tx=0x7f93e403d040 comp rx=0 tx=0).stop 2024-02-17T00:36:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 msgr2=0x7f93f0147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 0x7f93f0147880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93e800c430 tx=0x7f93e800c8f0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 shutdown_connections 2024-02-17T00:36:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f015eba0 0x7f93f014a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f93dc06b810 0x7f93dc06dcd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f93f015d7b0 0x7f93f014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 --2- 172.21.15.32:0/3794894527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f006ab60 0x7f93f0147880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.014+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 >> 172.21.15.32:0/3794894527 conn(0x7f93f00b2390 msgr2=0x7f93f00b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.015+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 shutdown_connections 2024-02-17T00:36:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.015+0000 7f93f84c0640 1 -- 172.21.15.32:0/3794894527 wait complete. 2024-02-17T00:36:37.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T00:36:37.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 Processor -- start 2024-02-17T00:36:37.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 -- start start 2024-02-17T00:36:37.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff5a415f1c0 0x7ff5a415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:37.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40ce830 0x7ff5a40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:37.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40ce380 con 0x7ff5a40d3760 2024-02-17T00:36:37.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40ceff0 con 0x7ff5a415f1c0 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.149+0000 7ff5a98c0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a415f000 con 0x7ff5a40ce830 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff5a415f1c0 0x7ff5a415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40ce830 0x7ff5a40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff5a415f1c0 0x7ff5a415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:53254/0 (socket says 172.21.15.32:53254) 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 -- 172.21.15.32:0/4042351753 learned_addr learned my addr 172.21.15.32:0/4042351753 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a2ffd640 1 --1- 172.21.15.32:0/4042351753 >> v1:172.21.15.39:6789/0 conn(0x7ff5a40d3760 0x7ff5a40d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:48464/0 (socket says 172.21.15.32:48464) 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 -- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40ce830 msgr2=0x7ff5a40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 --2- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40ce830 0x7ff5a40b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 -- 172.21.15.32:0/4042351753 >> v1:172.21.15.39:6789/0 conn(0x7ff5a40d3760 legacy=0x7ff5a40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a27fc640 1 -- 172.21.15.32:0/4042351753 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40d2190 con 0x7ff5a415f1c0 2024-02-17T00:36:37.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.150+0000 7ff5a37fe640 1 --2- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40ce830 0x7ff5a40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:37.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.151+0000 7ff5a27fc640 1 --2- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a415eac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009870 tx=0x7ff58c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b4fad796ae7b6a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:37.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.151+0000 7ff5a1ffb640 1 -- 172.21.15.32:0/4042351753 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c030840 con 0x7ff5a415f1c0 2024-02-17T00:36:37.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.151+0000 7ff5a1ffb640 1 -- 172.21.15.32:0/4042351753 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0309a0 con 0x7ff5a415f1c0 2024-02-17T00:36:37.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.151+0000 7ff5a1ffb640 1 -- 172.21.15.32:0/4042351753 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c030d30 con 0x7ff5a415f1c0 2024-02-17T00:36:37.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.151+0000 7ff5a98c0640 1 -- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 msgr2=0x7ff5a415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:37.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.151+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a415eac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009870 tx=0x7ff58c02b980 comp rx=0 tx=0).stop 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.152+0000 7ff5a98c0640 1 -- 172.21.15.32:0/4042351753 shutdown_connections 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.152+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40ce830 0x7ff5a40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.152+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/4042351753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a415eac0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.152+0000 7ff5a98c0640 1 -- 172.21.15.32:0/4042351753 >> 172.21.15.32:0/4042351753 conn(0x7ff5a4072680 msgr2=0x7ff5a4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.152+0000 7ff5a98c0640 1 -- 172.21.15.32:0/4042351753 shutdown_connections 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.152+0000 7ff5a98c0640 1 -- 172.21.15.32:0/4042351753 wait complete. 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.153+0000 7ff5a98c0640 1 Processor -- start 2024-02-17T00:36:37.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.153+0000 7ff5a98c0640 1 -- start start 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 0x7ff5a40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40d3760 0x7ff5a40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40aa1c0 con 0x7ff5a40ce830 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40b6180 con 0x7ff5a415f1c0 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40ca8a0 con 0x7ff5a40d3760 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 0x7ff5a40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 0x7ff5a40b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42836/0 (socket says 172.21.15.32:42836) 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 -- 172.21.15.32:0/1420640373 learned_addr learned my addr 172.21.15.32:0/1420640373 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a37fe640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a27fc640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40d3760 0x7ff5a40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 -- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40d3760 msgr2=0x7ff5a40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40d3760 0x7ff5a40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 -- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 msgr2=0x7ff5a40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 -- 172.21.15.32:0/1420640373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c009a70 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a27fc640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40d3760 0x7ff5a40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a2ffd640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 0x7ff5a40b5c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c400 tx=0x7ff59400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940074e0 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594007640 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594004a00 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.154+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c0094d0 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.155+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a40cadd0 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.156+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4068f60 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.156+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff594004b60 con 0x7ff5a40ce830 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.156+0000 7ff59bfff640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff58406b810 0x7ff58406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:37.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.156+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff594089a90 con 0x7ff5a40ce830 2024-02-17T00:36:37.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.157+0000 7ff5a27fc640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff58406b810 0x7ff58406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:37.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.157+0000 7ff5a27fc640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff58406b810 0x7ff58406dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff58c036000 tx=0x7ff58c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:37.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.161+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5940545b0 con 0x7ff5a40ce830 2024-02-17T00:36:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:37.378+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff5a40ce610 con 0x7ff5a40ce830 2024-02-17T00:36:38.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.025+0000 7ff59bfff640 1 -- 172.21.15.32:0/1420640373 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff594057c70 con 0x7ff5a40ce830 2024-02-17T00:36:38.028 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 2 and data pool 3 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.029+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff58406b810 msgr2=0x7ff58406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.029+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff58406b810 0x7ff58406dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff58c036000 tx=0x7ff58c03b040 comp rx=0 tx=0).stop 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.029+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 msgr2=0x7ff5a40b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.029+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 0x7ff5a40b5c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c400 tx=0x7ff59400c800 comp rx=0 tx=0).stop 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 shutdown_connections 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5a415f1c0 0x7ff5a40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff58406b810 0x7ff58406dcd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff5a40d3760 0x7ff5a40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 --2- 172.21.15.32:0/1420640373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5a40ce830 0x7ff5a40b5c40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 >> 172.21.15.32:0/1420640373 conn(0x7ff5a4072680 msgr2=0x7ff5a40b72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:38.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 shutdown_connections 2024-02-17T00:36:38.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.030+0000 7ff5a98c0640 1 -- 172.21.15.32:0/1420640373 wait complete. 2024-02-17T00:36:38.059 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-02-17T00:36:38.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-02-17T00:36:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.171+0000 7fc1be4d4640 1 Processor -- start 2024-02-17T00:36:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.171+0000 7fc1be4d4640 1 -- start start 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.171+0000 7fc1be4d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1be4d4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1b80b59e0 0x7fc1b815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1be4d4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b815f490 con 0x7fc1b80b28f0 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1be4d4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b815e6d0 con 0x7fc1b80b59e0 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1be4d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b815e9b0 con 0x7fc1b815de90 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1b80b59e0 0x7fc1b815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1b80b59e0 0x7fc1b815f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42846/0 (socket says 172.21.15.32:42846) 2024-02-17T00:36:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 -- 172.21.15.32:0/3280023437 learned_addr learned my addr 172.21.15.32:0/3280023437 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1b7fff640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 -- 172.21.15.32:0/3280023437 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 msgr2=0x7fc1b806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 -- 172.21.15.32:0/3280023437 >> v1:172.21.15.39:6789/0 conn(0x7fc1b80b28f0 legacy=0x7fc1b80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1bca71640 1 -- 172.21.15.32:0/3280023437 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b815ec90 con 0x7fc1b80b59e0 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.172+0000 7fc1b7fff640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1bca71640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b59e0 0x7fc1b815f7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009e50 tx=0x7fc1b002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ecf1a25e27c28f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1b6ffd640 1 -- 172.21.15.32:0/3280023437 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b002cb00 con 0x7fc1b80b59e0 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1b6ffd640 1 -- 172.21.15.32:0/3280023437 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b002cc60 con 0x7fc1b80b59e0 2024-02-17T00:36:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1b6ffd640 1 -- 172.21.15.32:0/3280023437 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00343f0 con 0x7fc1b80b59e0 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1be4d4640 1 -- 172.21.15.32:0/3280023437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b59e0 msgr2=0x7fc1b815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b59e0 0x7fc1b815f7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009e50 tx=0x7fc1b002bf60 comp rx=0 tx=0).stop 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1be4d4640 1 -- 172.21.15.32:0/3280023437 shutdown_connections 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.173+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b59e0 0x7fc1b815f7f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.174+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/3280023437 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.174+0000 7fc1be4d4640 1 -- 172.21.15.32:0/3280023437 >> 172.21.15.32:0/3280023437 conn(0x7fc1b80d02d0 msgr2=0x7fc1b80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.174+0000 7fc1be4d4640 1 -- 172.21.15.32:0/3280023437 shutdown_connections 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.174+0000 7fc1be4d4640 1 -- 172.21.15.32:0/3280023437 wait complete. 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.175+0000 7fc1be4d4640 1 Processor -- start 2024-02-17T00:36:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.175+0000 7fc1be4d4640 1 -- start start 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.175+0000 7fc1be4d4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 0x7fc1b81f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.175+0000 7fc1be4d4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1b80b59e0 0x7fc1b8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1be4d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b80c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1be4d4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b81f7cc0 con 0x7fc1b80b28f0 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1be4d4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80ca6a0 con 0x7fc1b80b59e0 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1be4d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80c9a90 con 0x7fc1b815de90 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 0x7fc1b81f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 0x7fc1b81f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42854/0 (socket says 172.21.15.32:42854) 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 -- 172.21.15.32:0/1309936534 learned_addr learned my addr 172.21.15.32:0/1309936534 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b77fe640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1b80b59e0 0x7fc1b8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1bca71640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b80c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 -- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 msgr2=0x7fc1b80c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b80c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 -- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1b80b59e0 msgr2=0x7fc1b8159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1b80b59e0 0x7fc1b8159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 -- 172.21.15.32:0/1309936534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0009b30 con 0x7fc1b80b28f0 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b77fe640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1b80b59e0 0x7fc1b8159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b7fff640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 0x7fc1b81f7780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800d7d0 tx=0x7fc1a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8004030 con 0x7fc1b80b28f0 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8004190 con 0x7fc1b80b28f0 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80c9d70 con 0x7fc1b80b28f0 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8004520 con 0x7fc1b80b28f0 2024-02-17T00:36:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.176+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b80ca330 con 0x7fc1b80b28f0 2024-02-17T00:36:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.177+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b8074bb0 con 0x7fc1b80b28f0 2024-02-17T00:36:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.178+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc1a80096a0 con 0x7fc1b80b28f0 2024-02-17T00:36:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.178+0000 7fc1b4ff9640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1a406b810 0x7fc1a406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.178+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a808a3e0 con 0x7fc1b80b28f0 2024-02-17T00:36:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.178+0000 7fc1b77fe640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1a406b810 0x7fc1a406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.179+0000 7fc1b77fe640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1a406b810 0x7fc1a406dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80c8330 tx=0x7fc1ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:38.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.183+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1a8054e00 con 0x7fc1b80b28f0 2024-02-17T00:36:38.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:38.370+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc1b80cd950 con 0x7fc1b80b28f0 2024-02-17T00:36:39.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.026+0000 7fc1b4ff9640 1 -- 172.21.15.32:0/1309936534 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc1a80584c0 con 0x7fc1b80b28f0 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1a406b810 msgr2=0x7fc1a406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1a406b810 0x7fc1a406dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80c8330 tx=0x7fc1ac009040 comp rx=0 tx=0).stop 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 msgr2=0x7fc1b81f7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 0x7fc1b81f7780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800d7d0 tx=0x7fc1a800dc90 comp rx=0 tx=0).stop 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 shutdown_connections 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1a406b810 0x7fc1a406dcd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc1b815de90 0x7fc1b80c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1b80b59e0 0x7fc1b8159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 --2- 172.21.15.32:0/1309936534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b80b28f0 0x7fc1b81f7780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 >> 172.21.15.32:0/1309936534 conn(0x7fc1b80d02d0 msgr2=0x7fc1b815d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.029+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 shutdown_connections 2024-02-17T00:36:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.030+0000 7fc1be4d4640 1 -- 172.21.15.32:0/1309936534 wait complete. 2024-02-17T00:36:39.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T00:36:39.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.158+0000 7f196db8a640 1 Processor -- start 2024-02-17T00:36:39.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.158+0000 7f196db8a640 1 -- start start 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.158+0000 7f196db8a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f196815dce0 0x7f19680ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.158+0000 7f196db8a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196815e0c0 con 0x7f196806cd90 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.158+0000 7f196db8a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19680d0cc0 con 0x7f19680d04d0 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.158+0000 7f196db8a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19680d0fa0 con 0x7f196815dce0 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f19677fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f196815dce0 0x7f19680ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f1967fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f196806cd90 0x7f19680b1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48074/0 (socket says 172.21.15.32:48074) 2024-02-17T00:36:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f1967fff640 1 -- 172.21.15.32:0/3276705574 learned_addr learned my addr 172.21.15.32:0/3276705574 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f19677fe640 1 -- 172.21.15.32:0/3276705574 >> v1:172.21.15.39:6789/0 conn(0x7f19680d04d0 legacy=0x7f196806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f1966ffd640 1 -- 172.21.15.32:0/3276705574 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891944905 0 0) 0x7f1960001490 con 0x7f196806cd90 2024-02-17T00:36:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f19677fe640 1 -- 172.21.15.32:0/3276705574 >> v1:172.21.15.32:6789/0 conn(0x7f196806cd90 legacy=0x7f19680b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.159+0000 7f19677fe640 1 -- 172.21.15.32:0/3276705574 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680d1280 con 0x7f196815dce0 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f19677fe640 1 --2- 172.21.15.32:0/3276705574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f196815dce0 0x7f19680ce7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f195802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756feb0b37a29488 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f1966ffd640 1 -- 172.21.15.32:0/3276705574 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958031830 con 0x7f196815dce0 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f1966ffd640 1 -- 172.21.15.32:0/3276705574 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958031990 con 0x7f196815dce0 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f1966ffd640 1 -- 172.21.15.32:0/3276705574 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958031d20 con 0x7f196815dce0 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 -- 172.21.15.32:0/3276705574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f196815dce0 msgr2=0x7f19680ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 --2- 172.21.15.32:0/3276705574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f196815dce0 0x7f19680ce7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f195802b8d0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 -- 172.21.15.32:0/3276705574 shutdown_connections 2024-02-17T00:36:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 --2- 172.21.15.32:0/3276705574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f196815dce0 0x7f19680ce7f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 -- 172.21.15.32:0/3276705574 >> 172.21.15.32:0/3276705574 conn(0x7f19680d1780 msgr2=0x7f19680d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 -- 172.21.15.32:0/3276705574 shutdown_connections 2024-02-17T00:36:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.160+0000 7f196db8a640 1 -- 172.21.15.32:0/3276705574 wait complete. 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.161+0000 7f196db8a640 1 Processor -- start 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 -- start start 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f196806cd90 0x7f1968157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 0x7f19680c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f196815dce0 0x7f196815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19681581c0 con 0x7f19680d04d0 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19680cb2e0 con 0x7f196815dce0 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f196db8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680c9300 con 0x7f196806cd90 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.162+0000 7f195effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 0x7f19680c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:39.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 0x7f19680c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42858/0 (socket says 172.21.15.32:42858) 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 -- 172.21.15.32:0/4060561171 learned_addr learned my addr 172.21.15.32:0/4060561171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f19677fe640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f196806cd90 0x7f1968157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f1967fff640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f196815dce0 0x7f196815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 -- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f196806cd90 msgr2=0x7f1968157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f196806cd90 0x7f1968157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 -- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f196815dce0 msgr2=0x7f196815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f196815dce0 0x7f196815e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 -- 172.21.15.32:0/4060561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009400 con 0x7f19680d04d0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f195effd640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 0x7f19680c9de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f195000c430 tx=0x7f195000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950011790 con 0x7f19680d04d0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19500118f0 con 0x7f19680d04d0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19680c95e0 con 0x7f19680d04d0 2024-02-17T00:36:39.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950011ce0 con 0x7f19680d04d0 2024-02-17T00:36:39.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.163+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19680cb5c0 con 0x7f19680d04d0 2024-02-17T00:36:39.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.164+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19680c9b00 con 0x7f19680d04d0 2024-02-17T00:36:39.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.165+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f195001c460 con 0x7f19680d04d0 2024-02-17T00:36:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.165+0000 7f1964ff9640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f194806b810 0x7f194806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.165+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f195008a110 con 0x7f19680d04d0 2024-02-17T00:36:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.165+0000 7f19677fe640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f194806b810 0x7f194806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.166+0000 7f19677fe640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f194806b810 0x7f194806dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1958036000 tx=0x7f195803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.170+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19680c9b00 con 0x7f19680d04d0 2024-02-17T00:36:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:39.349+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19680c9b00 con 0x7f19680d04d0 2024-02-17T00:36:41.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.056+0000 7f1964ff9640 1 -- 172.21.15.32:0/4060561171 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f19680c9b00 con 0x7f19680d04d0 2024-02-17T00:36:41.059 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data_ec' created 2024-02-17T00:36:41.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f194806b810 msgr2=0x7f194806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f194806b810 0x7f194806dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1958036000 tx=0x7f195803c040 comp rx=0 tx=0).stop 2024-02-17T00:36:41.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 msgr2=0x7f19680c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 0x7f19680c9de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f195000c430 tx=0x7f195000c8f0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 shutdown_connections 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f196815dce0 0x7f196815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19680d04d0 0x7f19680c9de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f194806b810 0x7f194806dcd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 --2- 172.21.15.32:0/4060561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f196806cd90 0x7f1968157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 >> 172.21.15.32:0/4060561171 conn(0x7f19680d1780 msgr2=0x7f19680ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 shutdown_connections 2024-02-17T00:36:41.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.059+0000 7f196db8a640 1 -- 172.21.15.32:0/4060561171 wait complete. 2024-02-17T00:36:41.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-02-17T00:36:41.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.187+0000 7f84a91b6640 1 Processor -- start 2024-02-17T00:36:41.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.187+0000 7f84a91b6640 1 -- start start 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a91b6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 0x7f84a40cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a91b6640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a40d05b0 con 0x7f84a40cfc90 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a91b6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a406cc50 con 0x7f84a40cd620 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a91b6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40d0120 con 0x7f84a40999f0 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a359e640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f84a40cfc90 0x7f84a40cbc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48078/0 (socket says 172.21.15.32:48078) 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a359e640 1 -- 172.21.15.32:0/3902448075 learned_addr learned my addr 172.21.15.32:0/3902448075 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f849bfff640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 0x7f84a40cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150872606 0 0) 0x7f84a40d05b0 con 0x7f84a40cfc90 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8490003520 con 0x7f84a40cfc90 2024-02-17T00:36:41.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225324571 0 0) 0x7f84a406cc50 con 0x7f84a40cd620 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a40d05b0 con 0x7f84a40cd620 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586717801 0 0) 0x7f8490003520 con 0x7f84a40cfc90 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 msgr2=0x7f84a40cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 0x7f84a40cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 >> v1:172.21.15.39:6789/0 conn(0x7f84a40cd620 legacy=0x7f84a406c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a406cf30 con 0x7f84a40cfc90 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f849c0019f0 con 0x7f84a40cfc90 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 >> v1:172.21.15.32:6789/0 conn(0x7f84a40cfc90 legacy=0x7f84a40cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8490003b30 0x7f8490003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84900047c0 0x7f8490004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 0x7f8490005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40d0120 con 0x7f84900047c0 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849000ba30 con 0x7f8490003b30 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.188+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849000bbf0 con 0x7f84a40999f0 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84900047c0 0x7f8490004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f84a2d9d640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8490003b30 0x7f8490003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f84a359e640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 0x7f8490005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 -- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 msgr2=0x7f8490005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a40999f0 0x7f8490005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 -- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8490003b30 msgr2=0x7f8490003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8490003b30 0x7f8490003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 -- 172.21.15.32:0/3902448075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490003520 con 0x7f84900047c0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f84a2d9d640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8490003b30 0x7f8490003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.189+0000 7f849bfff640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84900047c0 0x7f8490004c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f848c009ac0 tx=0x7f84900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efb4ea9ede712c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c02c6b0 con 0x7f84900047c0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c02c810 con 0x7f84900047c0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a259c640 1 -- 172.21.15.32:0/3902448075 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c02cba0 con 0x7f84900047c0 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a91b6640 1 -- 172.21.15.32:0/3902448075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84900047c0 msgr2=0x7f8490004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a91b6640 1 --2- 172.21.15.32:0/3902448075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84900047c0 0x7f8490004c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f848c009ac0 tx=0x7f84900057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a359e640 1 -- 172.21.15.32:0/3902448075 reap_dead start 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a91b6640 1 -- 172.21.15.32:0/3902448075 shutdown_connections 2024-02-17T00:36:41.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a91b6640 1 -- 172.21.15.32:0/3902448075 >> 172.21.15.32:0/3902448075 conn(0x7f84a40b3130 msgr2=0x7f84a40b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:41.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a91b6640 1 -- 172.21.15.32:0/3902448075 shutdown_connections 2024-02-17T00:36:41.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.190+0000 7f84a91b6640 1 -- 172.21.15.32:0/3902448075 wait complete. 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.191+0000 7f84a91b6640 1 Processor -- start 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 -- start start 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84900047c0 0x7f84a409e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 0x7f84a415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a406fa40 0x7f84a406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a4070400 con 0x7f84a409c3c0 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a409ef80 con 0x7f84900047c0 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a91b6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a409f260 con 0x7f84a406fa40 2024-02-17T00:36:41.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f849bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 0x7f84a415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f849bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 0x7f84a415bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42888/0 (socket says 172.21.15.32:42888) 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f849bfff640 1 -- 172.21.15.32:0/1718093999 learned_addr learned my addr 172.21.15.32:0/1718093999 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a359e640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a406fa40 0x7f84a406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.192+0000 7f84a2d9d640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84900047c0 0x7f84a409e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849bfff640 1 -- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a406fa40 msgr2=0x7f84a406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849bfff640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a406fa40 0x7f84a406fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849bfff640 1 -- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84900047c0 msgr2=0x7f84a409e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849bfff640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84900047c0 0x7f84a409e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849bfff640 1 -- 172.21.15.32:0/1718093999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40c88b0 con 0x7f84a409c3c0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849bfff640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 0x7f84a415bc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c003810 con 0x7f84a409c3c0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c003970 con 0x7f84a409c3c0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a40c8b90 con 0x7f84a409c3c0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c003d00 con 0x7f84a409c3c0 2024-02-17T00:36:41.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.193+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a415c150 con 0x7f84a409c3c0 2024-02-17T00:36:41.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.194+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a40c86f0 con 0x7f84a409c3c0 2024-02-17T00:36:41.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.194+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f848c047450 con 0x7f84a409c3c0 2024-02-17T00:36:41.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.195+0000 7f849b7fe640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f848406b860 0x7f848406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:41.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.195+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f848c0ac570 con 0x7f84a409c3c0 2024-02-17T00:36:41.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.195+0000 7f84a2d9d640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f848406b860 0x7f848406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:41.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.196+0000 7f84a2d9d640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f848406b860 0x7f848406dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8494005470 tx=0x7f8494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:41.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.199+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f848c076e90 con 0x7f84a409c3c0 2024-02-17T00:36:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:41.378+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f84a4069040 con 0x7f84a409c3c0 2024-02-17T00:36:42.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.063+0000 7f849b7fe640 1 -- 172.21.15.32:0/1718093999 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f848c0044e0 con 0x7f84a409c3c0 2024-02-17T00:36:42.066 INFO:teuthology.orchestra.run.smithi032.stderr:set pool 4 allow_ec_overwrites to true 2024-02-17T00:36:42.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f848406b860 msgr2=0x7f848406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:42.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f848406b860 0x7f848406dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8494005470 tx=0x7f8494009040 comp rx=0 tx=0).stop 2024-02-17T00:36:42.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 msgr2=0x7f84a415bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:42.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 0x7f84a415bc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c004730 comp rx=0 tx=0).stop 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 shutdown_connections 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f848406b860 0x7f848406dd20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84a406fa40 0x7f84a406fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a409c3c0 0x7f84a415bc10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 --2- 172.21.15.32:0/1718093999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84900047c0 0x7f84a409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 >> 172.21.15.32:0/1718093999 conn(0x7f84a40b3130 msgr2=0x7f84a4161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 shutdown_connections 2024-02-17T00:36:42.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.066+0000 7f84a91b6640 1 -- 172.21.15.32:0/1718093999 wait complete. 2024-02-17T00:36:42.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-02-17T00:36:42.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.204+0000 7f60a154f640 1 Processor -- start 2024-02-17T00:36:42.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.204+0000 7f60a154f640 1 -- start start 2024-02-17T00:36:42.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f60a154f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f609c15db00 0x7f609c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f60a154f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f60a154f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f609c0ce2b0 0x7f609c161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f60a154f640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0d1e80 con 0x7f609c15db00 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f60a154f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0b5930 con 0x7f609c0ce2b0 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f60a154f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0b5c10 con 0x7f609c0b53b0 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f609c15db00 0x7f609c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f609c15db00 0x7f609c0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42896/0 (socket says 172.21.15.32:42896) 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 -- 172.21.15.32:0/19180618 learned_addr learned my addr 172.21.15.32:0/19180618 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609b7fe640 1 --2- 172.21.15.32:0/19180618 >> v2:172.21.15.39:3300/0 conn(0x7f609c0ce2b0 0x7f609c161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f6093fff640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 -- 172.21.15.32:0/19180618 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 msgr2=0x7f609c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 -- 172.21.15.32:0/19180618 >> v2:172.21.15.39:3300/0 conn(0x7f609c0ce2b0 msgr2=0x7f609c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 --2- 172.21.15.32:0/19180618 >> v2:172.21.15.39:3300/0 conn(0x7f609c0ce2b0 0x7f609c161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609affd640 1 -- 172.21.15.32:0/19180618 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0b5ef0 con 0x7f609c15db00 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f609b7fe640 1 --2- 172.21.15.32:0/19180618 >> v2:172.21.15.39:3300/0 conn(0x7f609c0ce2b0 0x7f609c161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.205+0000 7f6093fff640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.206+0000 7f609affd640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0d0340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f609c0ce010 tx=0x7f608c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc1b7c5ef0b2c1d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.206+0000 7f609a7fc640 1 -- 172.21.15.32:0/19180618 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c031870 con 0x7f609c15db00 2024-02-17T00:36:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.206+0000 7f609a7fc640 1 -- 172.21.15.32:0/19180618 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c0319d0 con 0x7f609c15db00 2024-02-17T00:36:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.206+0000 7f609a7fc640 1 -- 172.21.15.32:0/19180618 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c031d60 con 0x7f609c15db00 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 -- 172.21.15.32:0/19180618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 msgr2=0x7f609c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0d0340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f609c0ce010 tx=0x7f608c02b910 comp rx=0 tx=0).stop 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 -- 172.21.15.32:0/19180618 shutdown_connections 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 --2- 172.21.15.32:0/19180618 >> v2:172.21.15.39:3300/0 conn(0x7f609c0ce2b0 0x7f609c161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 --2- 172.21.15.32:0/19180618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0d0340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 -- 172.21.15.32:0/19180618 >> 172.21.15.32:0/19180618 conn(0x7f609c072290 msgr2=0x7f609c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 -- 172.21.15.32:0/19180618 shutdown_connections 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.207+0000 7f60a154f640 1 -- 172.21.15.32:0/19180618 wait complete. 2024-02-17T00:36:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.208+0000 7f60a154f640 1 Processor -- start 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.208+0000 7f60a154f640 1 -- start start 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f609c0ce2b0 0x7f609c0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c151690 con 0x7f609c15db00 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1f67c0 con 0x7f609c0ce2b0 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1f6aa0 con 0x7f609c0b53b0 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42910/0 (socket says 172.21.15.32:42910) 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 -- 172.21.15.32:0/3194890095 learned_addr learned my addr 172.21.15.32:0/3194890095 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609affd640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f6093fff640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f609c0ce2b0 0x7f609c0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 -- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 msgr2=0x7f609c151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 -- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f609c0ce2b0 msgr2=0x7f609c0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f609c0ce2b0 0x7f609c0cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 -- 172.21.15.32:0/3194890095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0094d0 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f609b7fe640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0cf3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f609400cef0 tx=0x7f609400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400d840 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609400d9c0 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c1f6d80 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400dd70 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.209+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c0cd800 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.211+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c1f6900 con 0x7f609c15db00 2024-02-17T00:36:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.211+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f609401e3b0 con 0x7f609c15db00 2024-02-17T00:36:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.211+0000 7f60937fe640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f607c06b810 0x7f607c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.211+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f609408ae10 con 0x7f609c15db00 2024-02-17T00:36:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.211+0000 7f609affd640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f607c06b810 0x7f607c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.212+0000 7f609affd640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f607c06b810 0x7f607c06dcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f608c036000 tx=0x7f608c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:42.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.216+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f609c1f6900 con 0x7f609c15db00 2024-02-17T00:36:42.385 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T00:36:42.382+0000 7fcb0f356640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T00:36:42.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:42.432+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f609c1f72a0 con 0x7f609c15db00 2024-02-17T00:36:43.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.070+0000 7f60937fe640 1 -- 172.21.15.32:0/3194890095 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f609c1f72a0 con 0x7f609c15db00 2024-02-17T00:36:43.074 INFO:teuthology.orchestra.run.smithi032.stderr:added data pool 4 to fsmap 2024-02-17T00:36:43.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f607c06b810 msgr2=0x7f607c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f607c06b810 0x7f607c06dcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f608c036000 tx=0x7f608c03c040 comp rx=0 tx=0).stop 2024-02-17T00:36:43.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 msgr2=0x7f609c0cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0cf3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f609400cef0 tx=0x7f609400a710 comp rx=0 tx=0).stop 2024-02-17T00:36:43.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 shutdown_connections 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f609c15db00 0x7f609c0cf3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f609c0ce2b0 0x7f609c0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f607c06b810 0x7f607c06dcd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 --2- 172.21.15.32:0/3194890095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f609c0b53b0 0x7f609c151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 >> 172.21.15.32:0/3194890095 conn(0x7f609c072290 msgr2=0x7f609c0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 shutdown_connections 2024-02-17T00:36:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.073+0000 7f60a154f640 1 -- 172.21.15.32:0/3194890095 wait complete. 2024-02-17T00:36:43.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:36:43.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.193+0000 7fd60d70f640 1 Processor -- start 2024-02-17T00:36:43.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.193+0000 7fd60d70f640 1 -- start start 2024-02-17T00:36:43.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd60d70f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd6080b53b0 0x7fd6080d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd60d70f640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080d1e80 con 0x7fd6080d0a50 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd60d70f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080b5930 con 0x7fd60815db00 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd60d70f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080b5c10 con 0x7fd6080b53b0 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd5fffff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd6080d0a50 0x7fd6080d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48094/0 (socket says 172.21.15.32:48094) 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd5fffff640 1 -- 172.21.15.32:0/914127693 learned_addr learned my addr 172.21.15.32:0/914127693 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6077fe640 1 --2- 172.21.15.32:0/914127693 >> v2:172.21.15.39:3300/0 conn(0x7fd6080b53b0 0x7fd6080d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710876699 0 0) 0x7fd6080d1e80 con 0x7fd6080d0a50 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f4003520 con 0x7fd6080d0a50 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477511169 0 0) 0x7fd5f4003520 con 0x7fd6080d0a50 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 >> v2:172.21.15.39:3300/0 conn(0x7fd6080b53b0 msgr2=0x7fd6080d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 --2- 172.21.15.32:0/914127693 >> v2:172.21.15.39:3300/0 conn(0x7fd6080b53b0 0x7fd6080d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 >> v1:172.21.15.39:6789/0 conn(0x7fd60815db00 legacy=0x7fd6080d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080b5ef0 con 0x7fd6080d0a50 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fd5f0001670 con 0x7fd6080d0a50 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 >> v1:172.21.15.32:6789/0 conn(0x7fd6080d0a50 legacy=0x7fd6080d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4003970 0x7fd5f4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5f4004370 0x7fd5f4004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f4005040 0x7fd5f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b5c10 con 0x7fd5f4005040 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f400bfa0 con 0x7fd5f4004370 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f400c160 con 0x7fd5f4003970 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.194+0000 7fd6077fe640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f4005040 0x7fd5f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd606ffd640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4003970 0x7fd5f4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd5fffff640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5f4004370 0x7fd5f4004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 -- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4003970 msgr2=0x7fd5f4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4003970 0x7fd5f4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 -- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5f4004370 msgr2=0x7fd5f4004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5f4004370 0x7fd5f4004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 -- 172.21.15.32:0/914127693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4003520 con 0x7fd5f4005040 2024-02-17T00:36:43.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd606ffd640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4003970 0x7fd5f4003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd5fffff640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5f4004370 0x7fd5f4004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 -- 172.21.15.32:0/914127693 reap_dead start 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.195+0000 7fd6077fe640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f4005040 0x7fd5f400b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd600009f90 tx=0x7fd5f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d96d2bc9b8705a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002cc20 con 0x7fd5f4005040 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000f040 con 0x7fd5f4005040 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd6067fc640 1 -- 172.21.15.32:0/914127693 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600034440 con 0x7fd5f4005040 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 -- 172.21.15.32:0/914127693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f4005040 msgr2=0x7fd5f400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f4005040 0x7fd5f400b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd600009f90 tx=0x7fd5f40057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 -- 172.21.15.32:0/914127693 shutdown_connections 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 --2- 172.21.15.32:0/914127693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f4005040 0x7fd5f400b980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 -- 172.21.15.32:0/914127693 >> 172.21.15.32:0/914127693 conn(0x7fd608072290 msgr2=0x7fd6080726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 -- 172.21.15.32:0/914127693 shutdown_connections 2024-02-17T00:36:43.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.196+0000 7fd60d70f640 1 -- 172.21.15.32:0/914127693 wait complete. 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.197+0000 7fd60d70f640 1 Processor -- start 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.197+0000 7fd60d70f640 1 -- start start 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd60d70f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4005040 0x7fd60814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd60d70f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 0x7fd6080cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd60d70f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6080ccc40 0x7fd6080cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd60d70f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080cd630 con 0x7fd60815f140 2024-02-17T00:36:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd60d70f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080cc270 con 0x7fd6080ccc40 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd60d70f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080cbf40 con 0x7fd5f4005040 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd5fffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 0x7fd6080cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd5fffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 0x7fd6080cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42938/0 (socket says 172.21.15.32:42938) 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd5fffff640 1 -- 172.21.15.32:0/3824947409 learned_addr learned my addr 172.21.15.32:0/3824947409 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd606ffd640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4005040 0x7fd60814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.198+0000 7fd6077fe640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6080ccc40 0x7fd6080cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5fffff640 1 -- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4005040 msgr2=0x7fd60814a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5fffff640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4005040 0x7fd60814a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5fffff640 1 -- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6080ccc40 msgr2=0x7fd6080cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5fffff640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6080ccc40 0x7fd6080cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5fffff640 1 -- 172.21.15.32:0/3824947409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080c7e70 con 0x7fd60815f140 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd606ffd640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4005040 0x7fd60814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5fffff640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 0x7fd6080cc700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000e710 tx=0x7fd5f000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000c660 con 0x7fd60815f140 2024-02-17T00:36:43.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f000c7c0 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080c8150 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000cb30 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.199+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6080c8710 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.200+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6080cc0b0 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.200+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd5f001d460 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.201+0000 7fd5ff7fe640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd5e806b840 0x7fd5e806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.201+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd5f008a5d0 con 0x7fd60815f140 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.201+0000 7fd606ffd640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd5e806b840 0x7fd5e806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.201+0000 7fd606ffd640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd5e806b840 0x7fd5e806dd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8005580 tx=0x7fd5f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.205+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6080cc0b0 con 0x7fd60815f140 2024-02-17T00:36:43.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.423+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6080cc0b0 con 0x7fd60815f140 2024-02-17T00:36:43.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.424+0000 7fd5ff7fe640 1 -- 172.21.15.32:0/3824947409 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fd6080cc0b0 con 0x7fd60815f140 2024-02-17T00:36:43.427 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:43.427 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:42.434238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-17T00:36:43.427 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2024-02-17T00:36:43.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd5e806b840 msgr2=0x7fd5e806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd5e806b840 0x7fd5e806dd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8005580 tx=0x7fd5f8009040 comp rx=0 tx=0).stop 2024-02-17T00:36:43.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 msgr2=0x7fd6080cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 0x7fd6080cc700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000e710 tx=0x7fd5f000ebd0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 shutdown_connections 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6080ccc40 0x7fd6080cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60815f140 0x7fd6080cc700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd5e806b840 0x7fd5e806dd00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 --2- 172.21.15.32:0/3824947409 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd5f4005040 0x7fd60814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 >> 172.21.15.32:0/3824947409 conn(0x7fd608072290 msgr2=0x7fd60815b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 shutdown_connections 2024-02-17T00:36:43.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.426+0000 7fd60d70f640 1 -- 172.21.15.32:0/3824947409 wait complete. 2024-02-17T00:36:43.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:43.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.537+0000 7f078d5ac640 1 Processor -- start 2024-02-17T00:36:43.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.537+0000 7f078d5ac640 1 -- start start 2024-02-17T00:36:43.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f078d5ac640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f078815dc10 0x7f07881615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f078d5ac640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f078d5ac640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880d1d90 con 0x7f07880b6b90 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f078d5ac640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880d23c0 con 0x7f078815dc10 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f078d5ac640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0788162040 con 0x7f0788161b30 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f078815dc10 0x7f07881615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f078815dc10 0x7f07881615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60166/0 (socket says 172.21.15.32:60166) 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 -- 172.21.15.32:0/1513686728 learned_addr learned my addr 172.21.15.32:0/1513686728 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f07867fc640 1 --2- 172.21.15.32:0/1513686728 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 -- 172.21.15.32:0/1513686728 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 msgr2=0x7f07880d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 --2- 172.21.15.32:0/1513686728 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 -- 172.21.15.32:0/1513686728 >> v1:172.21.15.39:6789/0 conn(0x7f07880b6b90 legacy=0x7f07880b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.538+0000 7f0786ffd640 1 -- 172.21.15.32:0/1513686728 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788162320 con 0x7f078815dc10 2024-02-17T00:36:43.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.539+0000 7f0786ffd640 1 --2- 172.21.15.32:0/1513686728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f078815dc10 0x7f07881615f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0780009870 tx=0x7f078002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7c71829e1050cc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.539+0000 7f0785ffb640 1 -- 172.21.15.32:0/1513686728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800317c0 con 0x7f078815dc10 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.539+0000 7f0785ffb640 1 -- 172.21.15.32:0/1513686728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780031920 con 0x7f078815dc10 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.539+0000 7f0785ffb640 1 -- 172.21.15.32:0/1513686728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780031cb0 con 0x7f078815dc10 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 -- 172.21.15.32:0/1513686728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f078815dc10 msgr2=0x7f07881615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 --2- 172.21.15.32:0/1513686728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f078815dc10 0x7f07881615f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0780009870 tx=0x7f078002b860 comp rx=0 tx=0).stop 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 -- 172.21.15.32:0/1513686728 shutdown_connections 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 --2- 172.21.15.32:0/1513686728 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 --2- 172.21.15.32:0/1513686728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f078815dc10 0x7f07881615f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 -- 172.21.15.32:0/1513686728 >> 172.21.15.32:0/1513686728 conn(0x7f0788072290 msgr2=0x7f07880726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 -- 172.21.15.32:0/1513686728 shutdown_connections 2024-02-17T00:36:43.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.540+0000 7f078d5ac640 1 -- 172.21.15.32:0/1513686728 wait complete. 2024-02-17T00:36:43.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.541+0000 7f078d5ac640 1 Processor -- start 2024-02-17T00:36:43.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.541+0000 7f078d5ac640 1 -- start start 2024-02-17T00:36:43.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 0x7f078814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f078815dc10 0x7f07880b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880cc430 con 0x7f07880b6b90 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880cbab0 con 0x7f078815dc10 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880cd170 con 0x7f0788161b30 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 0x7f078814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 0x7f078814d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60170/0 (socket says 172.21.15.32:60170) 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 -- 172.21.15.32:0/3271876042 learned_addr learned my addr 172.21.15.32:0/3271876042 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f07867fc640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f078815dc10 0x7f07880b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f07877fe640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 -- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 msgr2=0x7f07880b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 -- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f078815dc10 msgr2=0x7f07880b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f078815dc10 0x7f07880b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 -- 172.21.15.32:0/3271876042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800094d0 con 0x7f07880b6b90 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f0786ffd640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 0x7f078814d090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f078002b8a0 tx=0x7f07800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780032860 con 0x7f07880b6b90 2024-02-17T00:36:43.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07800329c0 con 0x7f07880b6b90 2024-02-17T00:36:43.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07880cbd30 con 0x7f07880b6b90 2024-02-17T00:36:43.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780032d70 con 0x7f07880b6b90 2024-02-17T00:36:43.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.542+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078814d5d0 con 0x7f07880b6b90 2024-02-17T00:36:43.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.543+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0788067420 con 0x7f07880b6b90 2024-02-17T00:36:43.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.544+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f078004e450 con 0x7f07880b6b90 2024-02-17T00:36:43.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.544+0000 7f077f7fe640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f076806b810 0x7f076806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.544+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f07800ac520 con 0x7f07880b6b90 2024-02-17T00:36:43.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.544+0000 7f07867fc640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f076806b810 0x7f076806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.545+0000 7f07867fc640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f076806b810 0x7f076806dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f078815ebd0 tx=0x7f0770009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.549+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0780076d40 con 0x7f07880b6b90 2024-02-17T00:36:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.731+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0788068fd0 con 0x7f07880b6b90 2024-02-17T00:36:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.732+0000 7f077f7fe640 1 -- 172.21.15.32:0/3271876042 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f078007a400 con 0x7f07880b6b90 2024-02-17T00:36:43.736 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:43.736 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f076806b810 msgr2=0x7f076806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f076806b810 0x7f076806dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f078815ebd0 tx=0x7f0770009190 comp rx=0 tx=0).stop 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 msgr2=0x7f078814d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 0x7f078814d090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f078002b8a0 tx=0x7f07800046c0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 shutdown_connections 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f076806b810 0x7f076806dcd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0788161b30 0x7f07880b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f078815dc10 0x7f07880b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 --2- 172.21.15.32:0/3271876042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07880b6b90 0x7f078814d090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 >> 172.21.15.32:0/3271876042 conn(0x7f0788072290 msgr2=0x7f07880d3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:43.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 shutdown_connections 2024-02-17T00:36:43.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.735+0000 7f078d5ac640 1 -- 172.21.15.32:0/3271876042 wait complete. 2024-02-17T00:36:43.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:43.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.848+0000 7f05dc84e640 1 Processor -- start 2024-02-17T00:36:43.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.848+0000 7f05dc84e640 1 -- start start 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05dc84e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f05d80b9250 0x7f05d80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05dc84e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05d815dd00 0x7f05d80ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05dc84e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d80d1de0 con 0x7f05d815d920 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05dc84e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d8162560 con 0x7f05d80b9250 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05dc84e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d8161d40 con 0x7f05d815dd00 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05d5d9b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f05d80b9250 0x7f05d80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05d5d9b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f05d80b9250 0x7f05d80ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60176/0 (socket says 172.21.15.32:60176) 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05d5d9b640 1 -- 172.21.15.32:0/1526533170 learned_addr learned my addr 172.21.15.32:0/1526533170 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.849+0000 7f05d6d9d640 1 --2- 172.21.15.32:0/1526533170 >> v2:172.21.15.39:3300/0 conn(0x7f05d815dd00 0x7f05d80ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.850+0000 7f05d5d9b640 1 -- 172.21.15.32:0/1526533170 >> v2:172.21.15.39:3300/0 conn(0x7f05d815dd00 msgr2=0x7f05d80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:43.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.850+0000 7f05d5d9b640 1 --2- 172.21.15.32:0/1526533170 >> v2:172.21.15.39:3300/0 conn(0x7f05d815dd00 0x7f05d80ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.850+0000 7f05d5d9b640 1 -- 172.21.15.32:0/1526533170 >> v1:172.21.15.39:6789/0 conn(0x7f05d815d920 legacy=0x7f05d8161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.850+0000 7f05d5d9b640 1 -- 172.21.15.32:0/1526533170 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8161fa0 con 0x7f05d80b9250 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.850+0000 7f05d5d9b640 1 --2- 172.21.15.32:0/1526533170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d80ce620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05d80cf190 tx=0x7f05cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acad8be6b8d75e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05d559a640 1 -- 172.21.15.32:0/1526533170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0317e0 con 0x7f05d80b9250 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05d559a640 1 -- 172.21.15.32:0/1526533170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc031940 con 0x7f05d80b9250 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05d559a640 1 -- 172.21.15.32:0/1526533170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc031cd0 con 0x7f05d80b9250 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 -- 172.21.15.32:0/1526533170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 msgr2=0x7f05d80ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 --2- 172.21.15.32:0/1526533170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d80ce620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05d80cf190 tx=0x7f05cc02b880 comp rx=0 tx=0).stop 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 -- 172.21.15.32:0/1526533170 shutdown_connections 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 --2- 172.21.15.32:0/1526533170 >> v2:172.21.15.39:3300/0 conn(0x7f05d815dd00 0x7f05d80ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 --2- 172.21.15.32:0/1526533170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d80ce620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 -- 172.21.15.32:0/1526533170 >> 172.21.15.32:0/1526533170 conn(0x7f05d806bfe0 msgr2=0x7f05d806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 -- 172.21.15.32:0/1526533170 shutdown_connections 2024-02-17T00:36:43.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.851+0000 7f05dc84e640 1 -- 172.21.15.32:0/1526533170 wait complete. 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.852+0000 7f05dc84e640 1 Processor -- start 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 -- start start 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d8155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05d815d920 0x7f05d8159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f05d815dd00 0x7f05d80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80cbe60 con 0x7f05d80b9250 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d8156330 con 0x7f05d815d920 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05dc84e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c7380 con 0x7f05d815dd00 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05d659c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d8155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05d659c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d8155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60180/0 (socket says 172.21.15.32:60180) 2024-02-17T00:36:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05d659c640 1 -- 172.21.15.32:0/2680155780 learned_addr learned my addr 172.21.15.32:0/2680155780 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05d5d9b640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05d815d920 0x7f05d8159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.853+0000 7f05d6d9d640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f05d815dd00 0x7f05d80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05d659c640 1 -- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f05d815dd00 msgr2=0x7f05d80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05d659c640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f05d815dd00 0x7f05d80c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05d659c640 1 -- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05d815d920 msgr2=0x7f05d8159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05d659c640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05d815d920 0x7f05d8159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05d659c640 1 -- 172.21.15.32:0/2680155780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0094d0 con 0x7f05d80b9250 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05d659c640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d8155df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c790 tx=0x7f05c800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800cea0 con 0x7f05d80b9250 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8006d50 con 0x7f05d80b9250 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8003bb0 con 0x7f05d80b9250 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d80c7660 con 0x7f05d80b9250 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.854+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d80cbaf0 con 0x7f05d80b9250 2024-02-17T00:36:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.855+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d80c7b80 con 0x7f05d80b9250 2024-02-17T00:36:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.855+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f05c8003d10 con 0x7f05d80b9250 2024-02-17T00:36:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.856+0000 7f05c6ffd640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f05b806b810 0x7f05b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.856+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f05c8089ff0 con 0x7f05d80b9250 2024-02-17T00:36:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.856+0000 7f05d5d9b640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f05b806b810 0x7f05b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.856+0000 7f05d5d9b640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f05b806b810 0x7f05b806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05cc036000 tx=0x7f05cc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:43.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:43.860+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05c80bd8c0 con 0x7f05d80b9250 2024-02-17T00:36:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.039+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05d8068fd0 con 0x7f05d80b9250 2024-02-17T00:36:44.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.041+0000 7f05c6ffd640 1 -- 172.21.15.32:0/2680155780 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f05d80c7b80 con 0x7f05d80b9250 2024-02-17T00:36:44.044 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:44.044 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.042+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f05b806b810 msgr2=0x7f05b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.042+0000 7f05dc84e640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f05b806b810 0x7f05b806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05cc036000 tx=0x7f05cc03d040 comp rx=0 tx=0).stop 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.042+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 msgr2=0x7f05d8155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.042+0000 7f05dc84e640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d8155df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c790 tx=0x7f05c800cc50 comp rx=0 tx=0).stop 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.042+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 shutdown_connections 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f05b806b810 0x7f05b806dcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f05d815dd00 0x7f05d80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05d815d920 0x7f05d8159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 --2- 172.21.15.32:0/2680155780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05d80b9250 0x7f05d8155df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 >> 172.21.15.32:0/2680155780 conn(0x7f05d806bfe0 msgr2=0x7f05d80d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 shutdown_connections 2024-02-17T00:36:44.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.043+0000 7f05dc84e640 1 -- 172.21.15.32:0/2680155780 wait complete. 2024-02-17T00:36:44.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:36:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.167+0000 7ff926dc9640 1 Processor -- start 2024-02-17T00:36:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.167+0000 7ff926dc9640 1 -- start start 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff926dc9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9200d0a50 0x7ff9200d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff926dc9640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9200b53b0 0x7ff9200d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff926dc9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9200d1e80 con 0x7ff92015db00 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff926dc9640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9200b5930 con 0x7ff9200b53b0 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff926dc9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9200b5c10 con 0x7ff9200d0a50 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9200b53b0 0x7ff9200d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9200b53b0 0x7ff9200d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60194/0 (socket says 172.21.15.32:60194) 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 -- 172.21.15.32:0/3805560036 learned_addr learned my addr 172.21.15.32:0/3805560036 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff91ffff640 1 --2- 172.21.15.32:0/3805560036 >> v2:172.21.15.39:3300/0 conn(0x7ff9200d0a50 0x7ff9200d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 -- 172.21.15.32:0/3805560036 >> v2:172.21.15.39:3300/0 conn(0x7ff9200d0a50 msgr2=0x7ff9200d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 --2- 172.21.15.32:0/3805560036 >> v2:172.21.15.39:3300/0 conn(0x7ff9200d0a50 0x7ff9200d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 -- 172.21.15.32:0/3805560036 >> v1:172.21.15.39:6789/0 conn(0x7ff92015db00 legacy=0x7ff9200d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.168+0000 7ff925366640 1 -- 172.21.15.32:0/3805560036 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9200b5ef0 con 0x7ff9200b53b0 2024-02-17T00:36:44.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.169+0000 7ff925366640 1 --2- 172.21.15.32:0/3805560036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff9200d2870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff9200d4a00 tx=0x7ff90802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46108128b2de5dac server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:44.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.169+0000 7ff91f7fe640 1 -- 172.21.15.32:0/3805560036 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908030860 con 0x7ff9200b53b0 2024-02-17T00:36:44.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.169+0000 7ff91f7fe640 1 -- 172.21.15.32:0/3805560036 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9080309c0 con 0x7ff9200b53b0 2024-02-17T00:36:44.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.169+0000 7ff91f7fe640 1 -- 172.21.15.32:0/3805560036 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908030d50 con 0x7ff9200b53b0 2024-02-17T00:36:44.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 -- 172.21.15.32:0/3805560036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 msgr2=0x7ff9200d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 --2- 172.21.15.32:0/3805560036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff9200d2870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff9200d4a00 tx=0x7ff90802b9a0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 -- 172.21.15.32:0/3805560036 shutdown_connections 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 --2- 172.21.15.32:0/3805560036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff9200d2870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 --2- 172.21.15.32:0/3805560036 >> v2:172.21.15.39:3300/0 conn(0x7ff9200d0a50 0x7ff9200d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 -- 172.21.15.32:0/3805560036 >> 172.21.15.32:0/3805560036 conn(0x7ff920072290 msgr2=0x7ff9200726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 -- 172.21.15.32:0/3805560036 shutdown_connections 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.170+0000 7ff926dc9640 1 -- 172.21.15.32:0/3805560036 wait complete. 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.171+0000 7ff926dc9640 1 Processor -- start 2024-02-17T00:36:44.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.171+0000 7ff926dc9640 1 -- start start 2024-02-17T00:36:44.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff926dc9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff92015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff926dc9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9200d0a50 0x7ff920149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff926dc9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff92015db00 0x7ff9201f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff926dc9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920149bb0 con 0x7ff9200b53b0 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff926dc9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200cada0 con 0x7ff9200d0a50 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff926dc9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200cb080 con 0x7ff92015db00 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff92015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff92015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60198/0 (socket says 172.21.15.32:60198) 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 -- 172.21.15.32:0/1766656863 learned_addr learned my addr 172.21.15.32:0/1766656863 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff91ffff640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9200d0a50 0x7ff920149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff925366640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff92015db00 0x7ff9201f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 -- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff92015db00 msgr2=0x7ff9201f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff92015db00 0x7ff9201f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 -- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9200d0a50 msgr2=0x7ff920149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9200d0a50 0x7ff920149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 -- 172.21.15.32:0/1766656863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080094d0 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff925366640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff92015db00 0x7ff9201f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.172+0000 7ff924b65640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff92015cad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c3c0 tx=0x7ff91800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.173+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9180052d0 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.173+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918005450 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.173+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9200cb360 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.173+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918007260 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.173+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9200cb640 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.174+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9200d0300 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.174+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff9180073c0 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.174+0000 7ff91d7fa640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff90006b810 0x7ff90006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.175+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff918089750 con 0x7ff9200b53b0 2024-02-17T00:36:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.175+0000 7ff91ffff640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff90006b810 0x7ff90006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.175+0000 7ff91ffff640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff90006b810 0x7ff90006dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9201f6fc0 tx=0x7ff91000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:44.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.179+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff918053f70 con 0x7ff9200b53b0 2024-02-17T00:36:44.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.394+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff920068fd0 con 0x7ff9200b53b0 2024-02-17T00:36:44.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.395+0000 7ff91d7fa640 1 -- 172.21.15.32:0/1766656863 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4928 (secure 0 0 0) 0x7ff918057630 con 0x7ff9200b53b0 2024-02-17T00:36:44.398 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:44.398 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:42.434238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-17T00:36:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2024-02-17T00:36:44.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff90006b810 msgr2=0x7ff90006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff90006b810 0x7ff90006dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9201f6fc0 tx=0x7ff91000b040 comp rx=0 tx=0).stop 2024-02-17T00:36:44.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 msgr2=0x7ff92015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff92015cad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c3c0 tx=0x7ff91800c880 comp rx=0 tx=0).stop 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 shutdown_connections 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff90006b810 0x7ff90006dcd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff92015db00 0x7ff9201f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9200d0a50 0x7ff920149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 --2- 172.21.15.32:0/1766656863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9200b53b0 0x7ff92015cad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 >> 172.21.15.32:0/1766656863 conn(0x7ff920072290 msgr2=0x7ff92015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 shutdown_connections 2024-02-17T00:36:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.397+0000 7ff926dc9640 1 -- 172.21.15.32:0/1766656863 wait complete. 2024-02-17T00:36:44.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.508+0000 7fb08d0c0640 1 Processor -- start 2024-02-17T00:36:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.508+0000 7fb08d0c0640 1 -- start start 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08d0c0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb08815dd00 0x7fb0880b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08d0c0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08d0c0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08815e0e0 con 0x7fb0880b6a40 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08d0c0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08806cfe0 con 0x7fb08815dd00 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08d0c0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08806cd00 con 0x7fb08806c6c0 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb086d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb08815dd00 0x7fb0880b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb07ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb0880b6a40 0x7fb08806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:59176/0 (socket says 172.21.15.32:59176) 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb07ffff640 1 -- 172.21.15.32:0/1365421282 learned_addr learned my addr 172.21.15.32:0/1365421282 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08659c640 1 -- 172.21.15.32:0/1365421282 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499517406 0 0) 0x7fb070001110 con 0x7fb0880b6a40 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08659c640 1 -- 172.21.15.32:0/1365421282 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb074003520 con 0x7fb0880b6a40 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb086d9d640 1 -- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 msgr2=0x7fb0880b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb086d9d640 1 --2- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb086d9d640 1 -- 172.21.15.32:0/1365421282 >> v1:172.21.15.39:6789/0 conn(0x7fb0880b6a40 legacy=0x7fb08806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb086d9d640 1 -- 172.21.15.32:0/1365421282 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880d1ca0 con 0x7fb08815dd00 2024-02-17T00:36:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.509+0000 7fb08759e640 1 --2- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:44.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.510+0000 7fb086d9d640 1 --2- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0880b5750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0780097a0 tx=0x7fb07802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4cfe4fba647a9db server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:44.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.510+0000 7fb08659c640 1 -- 172.21.15.32:0/1365421282 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078030610 con 0x7fb08815dd00 2024-02-17T00:36:44.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.510+0000 7fb08659c640 1 -- 172.21.15.32:0/1365421282 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb078030770 con 0x7fb08815dd00 2024-02-17T00:36:44.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.510+0000 7fb08659c640 1 -- 172.21.15.32:0/1365421282 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078030ae0 con 0x7fb08815dd00 2024-02-17T00:36:44.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 -- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 msgr2=0x7fb0880b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0880b5750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0780097a0 tx=0x7fb07802b960 comp rx=0 tx=0).stop 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 -- 172.21.15.32:0/1365421282 shutdown_connections 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/1365421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0880b5750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 -- 172.21.15.32:0/1365421282 >> 172.21.15.32:0/1365421282 conn(0x7fb0880d07b0 msgr2=0x7fb0880d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 -- 172.21.15.32:0/1365421282 shutdown_connections 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.511+0000 7fb08d0c0640 1 -- 172.21.15.32:0/1365421282 wait complete. 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.512+0000 7fb08d0c0640 1 Processor -- start 2024-02-17T00:36:44.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.512+0000 7fb08d0c0640 1 -- start start 2024-02-17T00:36:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08d0c0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08d0c0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 0x7fb08815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08d0c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0881f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08d0c0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08815c270 con 0x7fb0880b6a40 2024-02-17T00:36:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08d0c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0881f4690 con 0x7fb08815dd00 2024-02-17T00:36:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08d0c0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cb030 con 0x7fb08806c6c0 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 0x7fb08815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 0x7fb08815bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60204/0 (socket says 172.21.15.32:60204) 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 -- 172.21.15.32:0/2971012477 learned_addr learned my addr 172.21.15.32:0/2971012477 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb086d9d640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08759e640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0881f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 -- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 msgr2=0x7fb0880ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 -- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 msgr2=0x7fb0881f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0881f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 -- 172.21.15.32:0/2971012477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009a70 con 0x7fb0880b6a40 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb086d9d640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb08759e640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0881f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.513+0000 7fb07ffff640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 0x7fb08815bd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c700 tx=0x7fb07000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.514+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070005ab0 con 0x7fb0880b6a40 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.514+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070005c10 con 0x7fb0880b6a40 2024-02-17T00:36:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.514+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb078009400 con 0x7fb0880b6a40 2024-02-17T00:36:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.514+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070001d50 con 0x7fb0880b6a40 2024-02-17T00:36:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.514+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0880cb5f0 con 0x7fb0880b6a40 2024-02-17T00:36:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.515+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0880680c0 con 0x7fb0880b6a40 2024-02-17T00:36:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.515+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb070007070 con 0x7fb0880b6a40 2024-02-17T00:36:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.515+0000 7fb07f7fe640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb06806b810 0x7fb06806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.516+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb070089a50 con 0x7fb0880b6a40 2024-02-17T00:36:44.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.516+0000 7fb086d9d640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb06806b810 0x7fb06806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:44.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.516+0000 7fb086d9d640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb06806b810 0x7fb06806dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb078036000 tx=0x7fb07803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:44.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.520+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb070054010 con 0x7fb0880b6a40 2024-02-17T00:36:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.702+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb08815e0e0 con 0x7fb0880b6a40 2024-02-17T00:36:44.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.703+0000 7fb07f7fe640 1 -- 172.21.15.32:0/2971012477 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7fb08815e0e0 con 0x7fb0880b6a40 2024-02-17T00:36:44.707 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:44.707 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:44.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb06806b810 msgr2=0x7fb06806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb06806b810 0x7fb06806dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb078036000 tx=0x7fb07803b040 comp rx=0 tx=0).stop 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 msgr2=0x7fb08815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 0x7fb08815bd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c700 tx=0x7fb07000cbc0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 shutdown_connections 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb08815dd00 0x7fb0881f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0880b6a40 0x7fb08815bd30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb06806b810 0x7fb06806dcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 --2- 172.21.15.32:0/2971012477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb08806c6c0 0x7fb0880ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 >> 172.21.15.32:0/2971012477 conn(0x7fb0880d07b0 msgr2=0x7fb0880ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 shutdown_connections 2024-02-17T00:36:44.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:44.705+0000 7fb08d0c0640 1 -- 172.21.15.32:0/2971012477 wait complete. 2024-02-17T00:36:45.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T00:36:37.380132+0000', 'modified': '2024-02-17T00:36:42.434238+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6837/268609901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 268609901}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 268609901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-02-17T00:36:45.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T00:36:45.122 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-17T00:36:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.222+0000 7fda95ed4640 1 Processor -- start 2024-02-17T00:36:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.222+0000 7fda95ed4640 1 -- start start 2024-02-17T00:36:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda95ed4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fda9015dd00 0x7fda900b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda95ed4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda95ed4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9015e0e0 con 0x7fda9006bfb0 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda95ed4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9006cfe0 con 0x7fda9015dd00 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda95ed4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9006cd00 con 0x7fda900b6a40 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fda9015dd00 0x7fda900b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fda9015dd00 0x7fda900b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60208/0 (socket says 172.21.15.32:60208) 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 -- 172.21.15.32:0/2309114211 learned_addr learned my addr 172.21.15.32:0/2309114211 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 -- 172.21.15.32:0/2309114211 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 msgr2=0x7fda900b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/2309114211 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 -- 172.21.15.32:0/2309114211 >> v1:172.21.15.39:6789/0 conn(0x7fda9006bfb0 legacy=0x7fda9006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.223+0000 7fda8f7fe640 1 -- 172.21.15.32:0/2309114211 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900d1ca0 con 0x7fda9015dd00 2024-02-17T00:36:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.224+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/2309114211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b5750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda80009870 tx=0x7fda8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4db13692245c22d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.224+0000 7fda8e7fc640 1 -- 172.21.15.32:0/2309114211 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80030840 con 0x7fda9015dd00 2024-02-17T00:36:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.224+0000 7fda8e7fc640 1 -- 172.21.15.32:0/2309114211 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda800309a0 con 0x7fda9015dd00 2024-02-17T00:36:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.224+0000 7fda8e7fc640 1 -- 172.21.15.32:0/2309114211 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80030d30 con 0x7fda9015dd00 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 -- 172.21.15.32:0/2309114211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 msgr2=0x7fda900b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 --2- 172.21.15.32:0/2309114211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b5750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda80009870 tx=0x7fda8002b980 comp rx=0 tx=0).stop 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 -- 172.21.15.32:0/2309114211 shutdown_connections 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 --2- 172.21.15.32:0/2309114211 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 --2- 172.21.15.32:0/2309114211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b5750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 -- 172.21.15.32:0/2309114211 >> 172.21.15.32:0/2309114211 conn(0x7fda900d07b0 msgr2=0x7fda900d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 -- 172.21.15.32:0/2309114211 shutdown_connections 2024-02-17T00:36:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.225+0000 7fda95ed4640 1 -- 172.21.15.32:0/2309114211 wait complete. 2024-02-17T00:36:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.226+0000 7fda95ed4640 1 Processor -- start 2024-02-17T00:36:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.226+0000 7fda95ed4640 1 -- start start 2024-02-17T00:36:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda95ed4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda9006bfb0 0x7fda900c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda95ed4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda95ed4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda95ed4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c99d0 con 0x7fda9015dd00 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda95ed4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9015a150 con 0x7fda9006bfb0 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda95ed4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9015a430 con 0x7fda900b6a40 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60218/0 (socket says 172.21.15.32:60218) 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 -- 172.21.15.32:0/3981763273 learned_addr learned my addr 172.21.15.32:0/3981763273 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda9006bfb0 0x7fda900c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8effd640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 -- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 msgr2=0x7fda900b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 -- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda9006bfb0 msgr2=0x7fda900c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda9006bfb0 0x7fda900c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 -- 172.21.15.32:0/3981763273 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800094d0 con 0x7fda9015dd00 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda9006bfb0 0x7fda900c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b7450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c780 tx=0x7fda8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.227+0000 7fda77fff640 1 -- 172.21.15.32:0/3981763273 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88003d80 con 0x7fda9015dd00 2024-02-17T00:36:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.228+0000 7fda77fff640 1 -- 172.21.15.32:0/3981763273 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8800ce90 con 0x7fda9015dd00 2024-02-17T00:36:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.228+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9015a710 con 0x7fda9015dd00 2024-02-17T00:36:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.228+0000 7fda77fff640 1 -- 172.21.15.32:0/3981763273 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880052b0 con 0x7fda9015dd00 2024-02-17T00:36:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.228+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9015acd0 con 0x7fda9015dd00 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.229+0000 7fda77fff640 1 -- 172.21.15.32:0/3981763273 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fda88005410 con 0x7fda9015dd00 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.229+0000 7fda77fff640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fda7c06b810 0x7fda7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.229+0000 7fda77fff640 1 -- 172.21.15.32:0/3981763273 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda88089d90 con 0x7fda9015dd00 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.230+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fda7c06b810 0x7fda7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.230+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fda7c06b810 0x7fda7c06dcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda80036000 tx=0x7fda8003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.230+0000 7fda98b7f740 1 Processor -- start 2024-02-17T00:36:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.230+0000 7fda98b7f740 1 -- start start 2024-02-17T00:36:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 0x563f0bac9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba990c0 0x563f0bac6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0ba9cc20 0x563f0bac6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda98b7f740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ba59dc0 con 0x563f0bac90a0 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ba0cf20 con 0x563f0ba990c0 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f0ba0a450 con 0x563f0ba9cc20 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda8f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 0x563f0bac9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda8f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 0x563f0bac9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60234/0 (socket says 172.21.15.32:60234) 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda8f7fe640 1 -- 172.21.15.32:0/3612152577 learned_addr learned my addr 172.21.15.32:0/3612152577 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda8effd640 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba990c0 0x563f0bac6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.231+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0ba9cc20 0x563f0bac6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda8f7fe640 1 -- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0ba9cc20 msgr2=0x563f0bac6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0ba9cc20 0x563f0bac6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda8f7fe640 1 -- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba990c0 msgr2=0x563f0bac6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba990c0 0x563f0bac6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda8f7fe640 1 -- 172.21.15.32:0/3612152577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0b9baf20 con 0x563f0bac90a0 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 0x563f0bac9480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda80009960 tx=0x7fda80030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9efbfacae8a45e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda757fa640 1 -- 172.21.15.32:0/3612152577 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8004a070 con 0x563f0bac90a0 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda757fa640 1 -- 172.21.15.32:0/3612152577 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80030e30 con 0x563f0bac90a0 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.232+0000 7fda757fa640 1 -- 172.21.15.32:0/3612152577 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80039690 con 0x563f0bac90a0 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 -- 172.21.15.32:0/3612152577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 msgr2=0x563f0bac9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 0x563f0bac9480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda80009960 tx=0x7fda80030000 comp rx=0 tx=0).stop 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 -- 172.21.15.32:0/3612152577 shutdown_connections 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0ba9cc20 0x563f0bac6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba990c0 0x563f0bac6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3612152577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bac90a0 0x563f0bac9480 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 -- 172.21.15.32:0/3612152577 >> 172.21.15.32:0/3612152577 conn(0x563f0ba9b330 msgr2=0x563f0bae3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 -- 172.21.15.32:0/3612152577 shutdown_connections 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 -- 172.21.15.32:0/3612152577 wait complete. 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 -- start start 2024-02-17T00:36:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.233+0000 7fda98b7f740 1 Processor -- start 2024-02-17T00:36:45.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bacc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bac90a0 0x563f0bac1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bacd7e0 0x563f0bac1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ba05c30 con 0x563f0ba9cc20 2024-02-17T00:36:45.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b9aad30 con 0x563f0bac90a0 2024-02-17T00:36:45.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f0b6d9310 con 0x563f0bacd7e0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bacc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda98b7f740 10 client.0 _ll_register_callbacks cb 0x563f0b9b2d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bacc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60246/0 (socket says 172.21.15.32:60246) 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 -- 172.21.15.32:0/918317131 learned_addr learned my addr 172.21.15.32:0/918317131 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8effd640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bac90a0 0x563f0bac1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8ffff640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bacd7e0 0x563f0bac1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 -- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bacd7e0 msgr2=0x563f0bac1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bacd7e0 0x563f0bac1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 -- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bac90a0 msgr2=0x563f0bac1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bac90a0 0x563f0bac1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.234+0000 7fda8f7fe640 1 -- 172.21.15.32:0/918317131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda900d1ca0 con 0x563f0ba9cc20 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bacc3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda80000c00 tx=0x7fda80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6466b3cc93b34dd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-02-17T00:36:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda6e7fc640 1 -- 172.21.15.32:0/918317131 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8004a040 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda6e7fc640 1 -- 172.21.15.32:0/918317131 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda8003e040 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f0b7056c0 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda6e7fc640 1 -- 172.21.15.32:0/918317131 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda80039cd0 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 10 client.4419 fetch_fsmap learned FSMap version 6 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x563f0ba042b0 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda6e7fc640 1 -- 172.21.15.32:0/918317131 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f0b7056c0 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda6e7fc640 1 -- 172.21.15.32:0/918317131 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fda80057070 con 0x563f0ba9cc20 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 20 client.4419 populate_metadata read hostname 'smithi032' 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0bacb8c0 0x563f0bb018a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 4 client.4419 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 --> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f0b756270 con 0x563f0bacb8c0 2024-02-17T00:36:45.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.235+0000 7fda8effd640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0bacb8c0 0x563f0bb018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.236+0000 7fda8effd640 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0bacb8c0 0x563f0bb018a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b3e9810e80d2e0 server_cookie=3d46875acda77375 in_seq=0 out_seq=0 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.236+0000 7fda6e7fc640 10 client.4419 ms_handle_connect on v2:172.21.15.39:6834/268609901 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.236+0000 7fda6e7fc640 1 -- 172.21.15.32:0/918317131 <== mds.0 v2:172.21.15.39:6834/268609901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f0b756270 con 0x563f0bacb8c0 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.236+0000 7fda6e7fc640 10 client.4419 handle_command_reply: tid=0 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.236+0000 7fda98b7f740 1 client.4419 shutdown 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 msgr2=0x563f0bacc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bacc3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda80000c00 tx=0x7fda80004730 comp rx=0 tx=0).stop 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 shutdown_connections 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0bacb8c0 0x563f0bb018a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bacd7e0 0x563f0bac1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda6e7fc640 0 client.4419 ms_handle_reset on v2:172.21.15.39:6834/268609901 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bac90a0 0x563f0bac1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 --2- 172.21.15.32:0/918317131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bacc3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 >> 172.21.15.32:0/918317131 conn(0x563f0ba990c0 msgr2=0x563f0baccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 shutdown_connections 2024-02-17T00:36:45.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 1 -- 172.21.15.32:0/918317131 wait complete. 2024-02-17T00:36:45.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.237+0000 7fda98b7f740 20 client.4419 trim_cache size 0 max 16384 2024-02-17T00:36:45.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.252+0000 7fda98b7f740 1 Processor -- start 2024-02-17T00:36:45.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.252+0000 7fda98b7f740 1 -- start start 2024-02-17T00:36:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bac5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bae66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bacd7e0 0x563f0bae6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda98b7f740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b98b490 con 0x563f0ba9cc20 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0bae48d0 con 0x563f0bacd7e0 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f0bb065f0 con 0x563f0bac90a0 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda8f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bac5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda8f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bac5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60252/0 (socket says 172.21.15.32:60252) 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda8f7fe640 1 -- 172.21.15.32:0/4012459232 learned_addr learned my addr 172.21.15.32:0/4012459232 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda8ffff640 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bacd7e0 0x563f0bae6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.253+0000 7fda8effd640 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bae66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8f7fe640 1 -- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 msgr2=0x563f0bae66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bae66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8f7fe640 1 -- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bacd7e0 msgr2=0x563f0bae6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bacd7e0 0x563f0bae6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8f7fe640 1 -- 172.21.15.32:0/4012459232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0b9a0a20 con 0x563f0ba9cc20 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8ffff640 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bacd7e0 0x563f0bae6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bac5c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda80030e00 tx=0x7fda80056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16309778c78f0c64 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda74ff9640 1 -- 172.21.15.32:0/4012459232 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8004a070 con 0x563f0ba9cc20 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda74ff9640 1 -- 172.21.15.32:0/4012459232 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80030b60 con 0x563f0ba9cc20 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda74ff9640 1 -- 172.21.15.32:0/4012459232 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80039cd0 con 0x563f0ba9cc20 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda98b7f740 1 -- 172.21.15.32:0/4012459232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 msgr2=0x563f0bac5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.254+0000 7fda98b7f740 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bac5c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda80030e00 tx=0x7fda80056000 comp rx=0 tx=0).stop 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 -- 172.21.15.32:0/4012459232 shutdown_connections 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0bacd7e0 0x563f0bae6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bae66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 --2- 172.21.15.32:0/4012459232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0ba9cc20 0x563f0bac5c90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 -- 172.21.15.32:0/4012459232 >> 172.21.15.32:0/4012459232 conn(0x563f0ba990c0 msgr2=0x563f0baccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 -- 172.21.15.32:0/4012459232 shutdown_connections 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 -- 172.21.15.32:0/4012459232 wait complete. 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 -- start start 2024-02-17T00:36:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.255+0000 7fda98b7f740 1 Processor -- start 2024-02-17T00:36:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba9cc20 0x563f0bace230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bace770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 0x563f0baf85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ba9db90 con 0x563f0bacd7e0 2024-02-17T00:36:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0bb50190 con 0x563f0ba9cc20 2024-02-17T00:36:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f0bb4f840 con 0x563f0bac90a0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda98b7f740 10 client.0 _ll_register_callbacks cb 0x7fda800096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 0x563f0baf85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 0x563f0baf85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60264/0 (socket says 172.21.15.32:60264) 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 -- 172.21.15.32:0/3650959337 learned_addr learned my addr 172.21.15.32:0/3650959337 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba9cc20 0x563f0bace230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8effd640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bace770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 -- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 msgr2=0x563f0bace770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bace770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 -- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba9cc20 msgr2=0x563f0bace230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba9cc20 0x563f0bace230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 -- 172.21.15.32:0/3650959337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f0ba042b0 con 0x563f0bacd7e0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8effd640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bace770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda8ffff640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 0x563f0baf85b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda8800a430 tx=0x7fda8805c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4903440dc6fd8ba server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.256+0000 7fda6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda6e7fc640 1 -- 172.21.15.32:0/3650959337 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880056c0 con 0x563f0bacd7e0 2024-02-17T00:36:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda6e7fc640 1 -- 172.21.15.32:0/3650959337 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda8806d070 con 0x563f0bacd7e0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda80030e30 con 0x563f0bacd7e0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda6e7fc640 1 -- 172.21.15.32:0/3650959337 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda88005820 con 0x563f0bacd7e0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 10 client.4425 fetch_fsmap learned FSMap version 6 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x563f0b9c6780 con 0x563f0bacd7e0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda6e7fc640 1 -- 172.21.15.32:0/3650959337 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80030e30 con 0x563f0bacd7e0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda6e7fc640 1 -- 172.21.15.32:0/3650959337 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fda88058430 con 0x563f0bacd7e0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 10 client.4425 fetch_fsmap finished waiting for FSMap version 6 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 20 client.4425 populate_metadata read hostname 'smithi032' 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0baf8df0 0x563f0bae3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 4 client.4425 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 --> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563f0b742610 con 0x563f0baf8df0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.257+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0baf8df0 0x563f0bae3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda6e7fc640 10 client.4425 ms_handle_connect on v2:172.21.15.39:6834/268609901 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda8f7fe640 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0baf8df0 0x563f0bae3400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52a89f40ae3d6587 server_cookie=44cb6012f4f4cba8 in_seq=0 out_seq=0 2024-02-17T00:36:45.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda6e7fc640 1 -- 172.21.15.32:0/3650959337 <== mds.0 v2:172.21.15.39:6834/268609901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563f0b742610 con 0x563f0baf8df0 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda6e7fc640 10 client.4425 handle_command_reply: tid=0 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 client.4425 shutdown 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 msgr2=0x563f0baf85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 0x563f0baf85b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda8800a430 tx=0x7fda8805c320 comp rx=0 tx=0).stop 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 shutdown_connections 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x563f0baf8df0 0x563f0bae3400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563f0bacd7e0 0x563f0baf85b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x563f0bac90a0 0x563f0bace770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda6e7fc640 0 client.4425 ms_handle_reset on v2:172.21.15.39:6834/268609901 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 --2- 172.21.15.32:0/3650959337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563f0ba9cc20 0x563f0bace230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 >> 172.21.15.32:0/3650959337 conn(0x563f0ba990c0 msgr2=0x563f0bae73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 shutdown_connections 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 1 -- 172.21.15.32:0/3650959337 wait complete. 2024-02-17T00:36:45.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda98b7f740 20 client.4425 trim_cache size 0 max 16384 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "2fde0ac4-9f5d-41d6-aea9-1575265f7f65", 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4294, 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 7.2318963969999999, 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 6, 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 27, 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 27, 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 13.883032672000001 2024-02-17T00:36:45.268 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-02-17T00:36:45.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fda7c06b810 msgr2=0x7fda7c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda95ed4640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fda7c06b810 0x7fda7c06dcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda80036000 tx=0x7fda8003b040 comp rx=0 tx=0).stop 2024-02-17T00:36:45.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 msgr2=0x7fda900b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.258+0000 7fda95ed4640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b7450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c780 tx=0x7fda8800cc40 comp rx=0 tx=0).stop 2024-02-17T00:36:45.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 shutdown_connections 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda9015dd00 0x7fda900b7450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fda7c06b810 0x7fda7c06dcd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fda900b6a40 0x7fda900b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 --2- 172.21.15.32:0/3981763273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda9006bfb0 0x7fda900c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 >> 172.21.15.32:0/3981763273 conn(0x7fda900d07b0 msgr2=0x7fda9006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 shutdown_connections 2024-02-17T00:36:45.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.259+0000 7fda95ed4640 1 -- 172.21.15.32:0/3981763273 wait complete. 2024-02-17T00:36:45.272 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T00:36:45.272 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:45.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T00:36:45.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 Processor -- start 2024-02-17T00:36:45.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 -- start start 2024-02-17T00:36:45.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7df815dd00 0x7f7df80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 0x7f7df80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df815e0e0 con 0x7f7df806bfb0 2024-02-17T00:36:45.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df806cfe0 con 0x7f7df815dd00 2024-02-17T00:36:45.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.370+0000 7f7dff8f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df806cd00 con 0x7f7df80b6a40 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfde91640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7df806bfb0 0x7f7df806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60998/0 (socket says 172.21.15.32:60998) 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfde91640 1 -- 172.21.15.32:0/26237391 learned_addr learned my addr 172.21.15.32:0/26237391 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535846419 0 0) 0x7f7df0001490 con 0x7f7df806bfb0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfd690640 1 --2- 172.21.15.32:0/26237391 >> v2:172.21.15.39:3300/0 conn(0x7f7df815dd00 0x7f7df80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7de4003520 con 0x7f7df806bfb0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfce8f640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 0x7f7df80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232602638 0 0) 0x7f7de4003520 con 0x7f7df806bfb0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 msgr2=0x7f7df80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 0x7f7df80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 >> v2:172.21.15.39:3300/0 conn(0x7f7df815dd00 msgr2=0x7f7df80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 --2- 172.21.15.32:0/26237391 >> v2:172.21.15.39:3300/0 conn(0x7f7df815dd00 0x7f7df80b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df80d1ca0 con 0x7f7df806bfb0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f7df0001b80 con 0x7f7df806bfb0 2024-02-17T00:36:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 >> v1:172.21.15.32:6789/0 conn(0x7f7df806bfb0 legacy=0x7f7df806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de4003970 0x7f7de4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 0x7f7de40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4004d00 0x7f7de4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df806cfe0 con 0x7f7de4003970 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df806cd00 con 0x7f7de4004d00 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de400b980 con 0x7f7df80b6a40 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfd690640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de4003970 0x7f7de4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfce8f640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 0x7f7de40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.371+0000 7f7dfde91640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4004d00 0x7f7de4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfd690640 1 -- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 msgr2=0x7f7de40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfd690640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df80b6a40 0x7f7de40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfd690640 1 -- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4004d00 msgr2=0x7f7de4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfd690640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4004d00 0x7f7de4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfd690640 1 -- 172.21.15.32:0/26237391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4003520 con 0x7f7de4003970 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfde91640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4004d00 0x7f7de4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:36:45.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7dfd690640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de4003970 0x7f7de4003d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009ac0 tx=0x7f7de40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af051d743594c14 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df402c710 con 0x7f7de4003970 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df402c870 con 0x7f7de4003970 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.372+0000 7f7deffff640 1 -- 172.21.15.32:0/26237391 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df402cc00 con 0x7f7de4003970 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dff8f4640 1 -- 172.21.15.32:0/26237391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de4003970 msgr2=0x7f7de4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/26237391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de4003970 0x7f7de4003d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009ac0 tx=0x7f7de40057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dfde91640 1 -- 172.21.15.32:0/26237391 reap_dead start 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dff8f4640 1 -- 172.21.15.32:0/26237391 shutdown_connections 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dff8f4640 1 -- 172.21.15.32:0/26237391 >> 172.21.15.32:0/26237391 conn(0x7f7df80d07b0 msgr2=0x7f7df80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dff8f4640 1 -- 172.21.15.32:0/26237391 shutdown_connections 2024-02-17T00:36:45.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.373+0000 7f7dff8f4640 1 -- 172.21.15.32:0/26237391 wait complete. 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.374+0000 7f7dff8f4640 1 Processor -- start 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.374+0000 7f7dff8f4640 1 -- start start 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dff8f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4003970 0x7f7df81ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dff8f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df81f4080 0x7f7df815f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dff8f4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 0x7f7df815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dff8f4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8151660 con 0x7f7df81f4500 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dff8f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8150740 con 0x7f7de4003970 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dff8f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df81509e0 con 0x7f7df81f4080 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 0x7f7df815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 0x7f7df815fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60278/0 (socket says 172.21.15.32:60278) 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 -- 172.21.15.32:0/4071575710 learned_addr learned my addr 172.21.15.32:0/4071575710 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:45.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfd690640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4003970 0x7f7df81ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfce8f640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df81f4080 0x7f7df815f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 -- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df81f4080 msgr2=0x7f7df815f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df81f4080 0x7f7df815f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 -- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4003970 msgr2=0x7f7df81ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4003970 0x7f7df81ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.375+0000 7f7dfde91640 1 -- 172.21.15.32:0/4071575710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8150cc0 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.376+0000 7f7dfde91640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 0x7f7df815fa70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7df80ce440 tx=0x7f7df000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.376+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000eb90 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.376+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df000ecf0 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.376+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df8150fa0 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.376+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0013660 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.376+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df81521c0 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.377+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df80680c0 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.377+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7df00137c0 con 0x7f7df81f4500 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.377+0000 7f7dedffb640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ddc06b840 0x7f7ddc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:45.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.378+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7df008a570 con 0x7f7df81f4500 2024-02-17T00:36:45.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.378+0000 7f7dfd690640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ddc06b840 0x7f7ddc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:45.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.378+0000 7f7dfd690640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ddc06b840 0x7f7ddc06dd00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7df4036000 tx=0x7f7df4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:45.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.382+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7df0054ce0 con 0x7f7df81f4500 2024-02-17T00:36:45.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.600+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7df80b9920 con 0x7f7df81f4500 2024-02-17T00:36:45.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.601+0000 7f7dedffb640 1 -- 172.21.15.32:0/4071575710 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7df0017070 con 0x7f7df81f4500 2024-02-17T00:36:45.604 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T00:36:45.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ddc06b840 msgr2=0x7f7ddc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ddc06b840 0x7f7ddc06dd00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7df4036000 tx=0x7f7df4030000 comp rx=0 tx=0).stop 2024-02-17T00:36:45.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 msgr2=0x7f7df815fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 0x7f7df815fa70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7df80ce440 tx=0x7f7df000e530 comp rx=0 tx=0).stop 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 shutdown_connections 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7df81f4500 0x7f7df815fa70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ddc06b840 0x7f7ddc06dd00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7df81f4080 0x7f7df815f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 --2- 172.21.15.32:0/4071575710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de4003970 0x7f7df81ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 >> 172.21.15.32:0/4071575710 conn(0x7f7df80d07b0 msgr2=0x7f7df80b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 shutdown_connections 2024-02-17T00:36:45.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:45.603+0000 7f7dff8f4640 1 -- 172.21.15.32:0/4071575710 wait complete. 2024-02-17T00:36:45.616 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T00:36:45.617 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-02-17T00:36:45.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:45.617 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-02-17T00:36:45.632 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42672sec preferred_lft 42672sec 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link noprefixroute 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:36:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-02-17T00:36:45.633 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T00:36:45.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T00:36:45.634 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:36:45.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:45.792 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T00:36:45.817 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-02-17T00:36:45.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:45.819 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-02-17T00:36:45.889 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-02-17T00:36:45.889 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T00:36:45.889 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-17T00:36:45.889 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-17T00:36:45.889 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T00:36:45.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:45.890 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:36:45.890 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:36:45.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-17T00:36:45.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-17T00:36:45.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-17T00:36:45.890 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:36:46.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.159 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-02-17T00:36:46.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.174 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-02-17T00:36:46.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.228 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:36:46.229 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:36:46.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T00:36:46.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-02-17T00:36:46.229 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:36:46.312 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-02-17T00:36:46.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.312 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-02-17T00:36:46.313 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:36:46.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.452 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:36:46.452 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:36:46.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-02-17T00:36:46.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T00:36:46.453 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:36:46.495 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-02-17T00:36:46.495 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:36:46.495 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:46.551 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-02-17T00:36:46.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:36:46.552 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:46.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-02-17T00:36:46.674 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T00:36:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-02-17T00:36:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-02-17T00:36:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-02-17T00:36:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-02-17T00:36:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-02-17T00:36:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/selinux 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T00:36:46.730 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T00:36:46.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.731 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-02-17T00:36:46.784 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-17T00:36:46.784 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-02-17T00:36:46.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-02-17T00:36:46.852 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-02-17T00:36:46.908 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/selinux 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T00:36:46.909 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T00:36:46.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:46.910 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-02-17T00:36:46.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:2024-02-17T00:36:46.912+0000 7f519a837480 -1 init, newargv = 0x561fa7e73650 newargc=15 2024-02-17T00:36:46.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[44113]: starting ceph client 2024-02-17T00:36:46.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[44113]: starting fuse 2024-02-17T00:36:46.930 INFO:teuthology.orchestra.run.smithi032.stdout:42 2024-02-17T00:36:46.930 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-02-17T00:36:46.931 DEBUG:teuthology.orchestra.run.smithi032:> 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-02-17T00:36:46.932 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-02-17T00:36:46.933 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-17T00:36:46.933 DEBUG:teuthology.orchestra.run.smithi032:> 2024-02-17T00:36:46.933 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.admin")) 2024-02-17T00:36:46.933 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-02-17T00:36:47.050 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.admin.44113.asok 2024-02-17T00:36:47.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-17T00:36:47.124 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44113.asok 2024-02-17T00:36:47.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:47.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44113.asok status 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "2d9ecbfd71ad813d2904991462c430e98ff63b84", 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev)", 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "admin", 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "44113", 2024-02-17T00:36:47.273 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4437, 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4437 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1281550305 2024-02-17T00:36:47.274 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1281550305 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4437 192.168.0.1:0/1281550305", 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/1281550305", 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 6, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 27, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-02-17T00:36:47.275 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-02-17T00:36:47.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:47.281 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-02-17T00:36:47.281 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:47.296 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-02-17T00:36:47.296 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:47.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:47.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:47.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:47.364 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-02-17T00:36:47.440 INFO:teuthology.orchestra.run.smithi032.stdout:# file: . 2024-02-17T00:36:47.440 INFO:teuthology.orchestra.run.smithi032.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-02-17T00:36:47.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:47.440 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:47.441 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:36:47.496 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:47.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.634+0000 7f312154f640 1 Processor -- start 2024-02-17T00:36:47.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.634+0000 7f312154f640 1 -- start start 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.634+0000 7f312154f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f311c0ced20 0x7f311c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.634+0000 7f312154f640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c1444e0 con 0x7f311c06e970 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.634+0000 7f312154f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c15ac70 con 0x7f311c144100 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.634+0000 7f312154f640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c0cdbf0 con 0x7f311c0ced20 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f311b7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f311c0ced20 0x7f311c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f3113fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f311c06e970 0x7f311c15b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32782/0 (socket says 172.21.15.32:32782) 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f3113fff640 1 -- 172.21.15.32:0/367288208 learned_addr learned my addr 172.21.15.32:0/367288208 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:47.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f311b7fe640 1 -- 172.21.15.32:0/367288208 >> v1:172.21.15.39:6789/0 conn(0x7f311c144100 legacy=0x7f311c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:47.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f311b7fe640 1 -- 172.21.15.32:0/367288208 >> v1:172.21.15.32:6789/0 conn(0x7f311c06e970 legacy=0x7f311c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f311a7fc640 1 -- 172.21.15.32:0/367288208 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254686198 0 0) 0x7f311c1444e0 con 0x7f311c06e970 2024-02-17T00:36:47.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.635+0000 7f311b7fe640 1 -- 172.21.15.32:0/367288208 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0cded0 con 0x7f311c0ced20 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f311b7fe640 1 --2- 172.21.15.32:0/367288208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c0ced20 0x7f311c0cd610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f311402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6629e0daf8ad16 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f311a7fc640 1 -- 172.21.15.32:0/367288208 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311402cbd0 con 0x7f311c0ced20 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f311a7fc640 1 -- 172.21.15.32:0/367288208 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311402cd30 con 0x7f311c0ced20 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f311a7fc640 1 -- 172.21.15.32:0/367288208 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311402cea0 con 0x7f311c0ced20 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 -- 172.21.15.32:0/367288208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c0ced20 msgr2=0x7f311c0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 --2- 172.21.15.32:0/367288208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c0ced20 0x7f311c0cd610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f311402be20 comp rx=0 tx=0).stop 2024-02-17T00:36:47.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 -- 172.21.15.32:0/367288208 shutdown_connections 2024-02-17T00:36:47.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 --2- 172.21.15.32:0/367288208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c0ced20 0x7f311c0cd610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 -- 172.21.15.32:0/367288208 >> 172.21.15.32:0/367288208 conn(0x7f311c071150 msgr2=0x7f311c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:47.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 -- 172.21.15.32:0/367288208 shutdown_connections 2024-02-17T00:36:47.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.636+0000 7f312154f640 1 -- 172.21.15.32:0/367288208 wait complete. 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.637+0000 7f312154f640 1 Processor -- start 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 -- start start 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f311c06e970 0x7f311c1f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f311c0ced20 0x7f311c156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 0x7f311c1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1f5150 con 0x7f311c144100 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1f5430 con 0x7f311c0ced20 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f312154f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1f13d0 con 0x7f311c06e970 2024-02-17T00:36:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 0x7f311c1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 0x7f311c1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60306/0 (socket says 172.21.15.32:60306) 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.638+0000 7f311b7fe640 1 -- 172.21.15.32:0/2123154933 learned_addr learned my addr 172.21.15.32:0/2123154933 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f3113fff640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f311c0ced20 0x7f311c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311affd640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f311c06e970 0x7f311c1f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311b7fe640 1 -- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f311c06e970 msgr2=0x7f311c1f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311b7fe640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f311c06e970 0x7f311c1f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311b7fe640 1 -- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f311c0ced20 msgr2=0x7f311c156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311b7fe640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f311c0ced20 0x7f311c156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311b7fe640 1 -- 172.21.15.32:0/2123154933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114009a70 con 0x7f311c144100 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f311b7fe640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 0x7f311c1f46b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f3114004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311402cea0 con 0x7f311c144100 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311403e630 con 0x7f311c144100 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c1f16b0 con 0x7f311c144100 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311403e9e0 con 0x7f311c144100 2024-02-17T00:36:47.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.639+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c1413e0 con 0x7f311c144100 2024-02-17T00:36:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.640+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c0cf350 con 0x7f311c144100 2024-02-17T00:36:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.640+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f311403b050 con 0x7f311c144100 2024-02-17T00:36:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.641+0000 7f31137fe640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30fc06b810 0x7f30fc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.641+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f31140acd40 con 0x7f311c144100 2024-02-17T00:36:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.641+0000 7f311affd640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30fc06b810 0x7f30fc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.641+0000 7f311affd640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30fc06b810 0x7f30fc06dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f310c006fd0 tx=0x7f310c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.645+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3114077560 con 0x7f311c144100 2024-02-17T00:36:47.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.825+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f311c0cf350 con 0x7f311c144100 2024-02-17T00:36:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.826+0000 7f31137fe640 1 -- 172.21.15.32:0/2123154933 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f311404e090 con 0x7f311c144100 2024-02-17T00:36:47.830 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:47.830 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30fc06b810 msgr2=0x7f30fc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30fc06b810 0x7f30fc06dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f310c006fd0 tx=0x7f310c009060 comp rx=0 tx=0).stop 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 msgr2=0x7f311c1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 0x7f311c1f46b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f3114004a40 comp rx=0 tx=0).stop 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 shutdown_connections 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c144100 0x7f311c1f46b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f311c0ced20 0x7f311c156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30fc06b810 0x7f30fc06dcd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 --2- 172.21.15.32:0/2123154933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f311c06e970 0x7f311c1f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 >> 172.21.15.32:0/2123154933 conn(0x7f311c071150 msgr2=0x7f311c06d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 shutdown_connections 2024-02-17T00:36:47.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.828+0000 7f312154f640 1 -- 172.21.15.32:0/2123154933 wait complete. 2024-02-17T00:36:47.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:36:47.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:36:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.943+0000 7f2e01fbc640 1 Processor -- start 2024-02-17T00:36:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.943+0000 7f2e01fbc640 1 -- start start 2024-02-17T00:36:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2e01fbc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2dfc09a100 0x7f2dfc0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2e01fbc640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dfc0cf200 con 0x7f2dfc0d0210 2024-02-17T00:36:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2e01fbc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dfc0d0650 con 0x7f2dfc15ba40 2024-02-17T00:36:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2e01fbc640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dfc0cf450 con 0x7f2dfc09a100 2024-02-17T00:36:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2dfbfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2dfc09a100 0x7f2dfc0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2dfaffd640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2dfc0d0210 0x7f2dfc0999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32788/0 (socket says 172.21.15.32:32788) 2024-02-17T00:36:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2dfaffd640 1 -- 172.21.15.32:0/4278140302 learned_addr learned my addr 172.21.15.32:0/4278140302 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.944+0000 7f2dfbfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2dfc09a100 0x7f2dfc0b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60310/0 (socket says 172.21.15.32:60310) 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfbfff640 1 -- 172.21.15.32:0/4278140302 >> v1:172.21.15.39:6789/0 conn(0x7f2dfc15ba40 legacy=0x7f2dfc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfbfff640 1 -- 172.21.15.32:0/4278140302 >> v1:172.21.15.32:6789/0 conn(0x7f2dfc0d0210 legacy=0x7f2dfc0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfbfff640 1 -- 172.21.15.32:0/4278140302 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0cf730 con 0x7f2dfc09a100 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfbfff640 1 --2- 172.21.15.32:0/4278140302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc09a100 0x7f2dfc0b0f90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009d90 tx=0x7f2df402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4db43cc3b16a971 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfa7fc640 1 -- 172.21.15.32:0/4278140302 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df402cd00 con 0x7f2dfc09a100 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfa7fc640 1 -- 172.21.15.32:0/4278140302 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df402ce60 con 0x7f2dfc09a100 2024-02-17T00:36:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.945+0000 7f2dfa7fc640 1 -- 172.21.15.32:0/4278140302 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4034660 con 0x7f2dfc09a100 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 -- 172.21.15.32:0/4278140302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc09a100 msgr2=0x7f2dfc0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/4278140302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc09a100 0x7f2dfc0b0f90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009d90 tx=0x7f2df402bf50 comp rx=0 tx=0).stop 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 -- 172.21.15.32:0/4278140302 shutdown_connections 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/4278140302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc09a100 0x7f2dfc0b0f90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 -- 172.21.15.32:0/4278140302 >> 172.21.15.32:0/4278140302 conn(0x7f2dfc0b3120 msgr2=0x7f2dfc0b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 -- 172.21.15.32:0/4278140302 shutdown_connections 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.946+0000 7f2e01fbc640 1 -- 172.21.15.32:0/4278140302 wait complete. 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.947+0000 7f2e01fbc640 1 Processor -- start 2024-02-17T00:36:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.947+0000 7f2e01fbc640 1 -- start start 2024-02-17T00:36:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2e01fbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dfc09a100 0x7f2dfc15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2e01fbc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 0x7f2dfc0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2e01fbc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2dfc15ba40 0x7f2dfc154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2e01fbc640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc15e660 con 0x7f2dfc0d0210 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2e01fbc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc15e940 con 0x7f2dfc09a100 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2e01fbc640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc15be20 con 0x7f2dfc15ba40 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2dfaffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 0x7f2dfc0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2dfaffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 0x7f2dfc0cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60322/0 (socket says 172.21.15.32:60322) 2024-02-17T00:36:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2dfaffd640 1 -- 172.21.15.32:0/2622083743 learned_addr learned my addr 172.21.15.32:0/2622083743 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2dfbfff640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2dfc15ba40 0x7f2dfc154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.948+0000 7f2dfb7fe640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dfc09a100 0x7f2dfc15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2dfaffd640 1 -- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2dfc15ba40 msgr2=0x7f2dfc154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2dfaffd640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2dfc15ba40 0x7f2dfc154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2dfaffd640 1 -- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dfc09a100 msgr2=0x7f2dfc15e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2dfaffd640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dfc09a100 0x7f2dfc15e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2dfaffd640 1 -- 172.21.15.32:0/2622083743 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009a70 con 0x7f2dfc0d0210 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2dfaffd640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 0x7f2dfc0cafc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c480 tx=0x7f2df000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0005ce0 con 0x7f2dfc0d0210 2024-02-17T00:36:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df0005e40 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df00072f0 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc15c100 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.949+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc0cb500 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.950+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc15c620 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.950+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2df0007510 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.951+0000 7f2de3fff640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2de806b810 0x7f2de806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.951+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2df0089a40 con 0x7f2dfc0d0210 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.951+0000 7f2dfb7fe640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2de806b810 0x7f2de806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.951+0000 7f2dfb7fe640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2de806b810 0x7f2de806dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0b2d00 tx=0x7f2dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:47.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:47.955+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2dfc15c620 con 0x7f2dfc0d0210 2024-02-17T00:36:48.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.136+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dfc15c620 con 0x7f2dfc0d0210 2024-02-17T00:36:48.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.136+0000 7f2de3fff640 1 -- 172.21.15.32:0/2622083743 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2df0017020 con 0x7f2dfc0d0210 2024-02-17T00:36:48.140 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2de806b810 msgr2=0x7f2de806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2de806b810 0x7f2de806dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0b2d00 tx=0x7f2dec009040 comp rx=0 tx=0).stop 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 msgr2=0x7f2dfc0cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 0x7f2dfc0cafc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c480 tx=0x7f2df000c940 comp rx=0 tx=0).stop 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 shutdown_connections 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2de806b810 0x7f2de806dcd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2dfc15ba40 0x7f2dfc154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dfc0d0210 0x7f2dfc0cafc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.138+0000 7f2e01fbc640 1 --2- 172.21.15.32:0/2622083743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dfc09a100 0x7f2dfc15e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.139+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 >> 172.21.15.32:0/2622083743 conn(0x7f2dfc0b3120 msgr2=0x7f2dfc06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:48.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.139+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 shutdown_connections 2024-02-17T00:36:48.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.139+0000 7f2e01fbc640 1 -- 172.21.15.32:0/2622083743 wait complete. 2024-02-17T00:36:48.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:36:48.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.253+0000 7fa8dcbc9640 1 Processor -- start 2024-02-17T00:36:48.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.253+0000 7fa8dcbc9640 1 -- start start 2024-02-17T00:36:48.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8dcbc9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80d3760 0x7fa8d815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8dcbc9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8d815f1c0 0x7fa8d80d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8dcbc9640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8d80ce830 0x7fa8d80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8dcbc9640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80ceff0 con 0x7fa8d80ce830 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8dcbc9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80ce380 con 0x7fa8d815f1c0 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8dcbc9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d815f000 con 0x7fa8d80d3760 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8d80ce830 0x7fa8d80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8d80ce830 0x7fa8d80b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60326/0 (socket says 172.21.15.32:60326) 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 -- 172.21.15.32:0/2119038941 learned_addr learned my addr 172.21.15.32:0/2119038941 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d5d9b640 1 --2- 172.21.15.32:0/2119038941 >> v2:172.21.15.39:3300/0 conn(0x7fa8d815f1c0 0x7fa8d80d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d659c640 1 --2- 172.21.15.32:0/2119038941 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80d3760 0x7fa8d815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 -- 172.21.15.32:0/2119038941 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80d3760 msgr2=0x7fa8d815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 --2- 172.21.15.32:0/2119038941 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80d3760 0x7fa8d815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 -- 172.21.15.32:0/2119038941 >> v2:172.21.15.39:3300/0 conn(0x7fa8d815f1c0 msgr2=0x7fa8d80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:48.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 --2- 172.21.15.32:0/2119038941 >> v2:172.21.15.39:3300/0 conn(0x7fa8d815f1c0 0x7fa8d80d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.254+0000 7fa8d6d9d640 1 -- 172.21.15.32:0/2119038941 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80d2190 con 0x7fa8d80ce830 2024-02-17T00:36:48.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.255+0000 7fa8d6d9d640 1 --2- 172.21.15.32:0/2119038941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80ce830 0x7fa8d80b2240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80b6350 tx=0x7fa8c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8c5ed8011e5c82 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.255+0000 7fa8d559a640 1 -- 172.21.15.32:0/2119038941 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c802ca70 con 0x7fa8d80ce830 2024-02-17T00:36:48.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.255+0000 7fa8d559a640 1 -- 172.21.15.32:0/2119038941 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c802cbd0 con 0x7fa8d80ce830 2024-02-17T00:36:48.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.255+0000 7fa8d559a640 1 -- 172.21.15.32:0/2119038941 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80343f0 con 0x7fa8d80ce830 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2119038941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80ce830 msgr2=0x7fa8d80b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2119038941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80ce830 0x7fa8d80b2240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80b6350 tx=0x7fa8c802bed0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2119038941 shutdown_connections 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2119038941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80ce830 0x7fa8d80b2240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2119038941 >> v2:172.21.15.39:3300/0 conn(0x7fa8d815f1c0 0x7fa8d80d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2119038941 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80d3760 0x7fa8d815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2119038941 >> 172.21.15.32:0/2119038941 conn(0x7fa8d8072680 msgr2=0x7fa8d8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2119038941 shutdown_connections 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.256+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2119038941 wait complete. 2024-02-17T00:36:48.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.257+0000 7fa8dcbc9640 1 Processor -- start 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.257+0000 7fa8dcbc9640 1 -- start start 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8dcbc9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80ce830 0x7fa8d814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8dcbc9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 0x7fa8d814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8dcbc9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d815f1c0 0x7fa8d81f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8dcbc9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d814ef40 con 0x7fa8d80d3760 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8dcbc9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d814fbb0 con 0x7fa8d815f1c0 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8dcbc9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d814fe90 con 0x7fa8d80ce830 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d5d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 0x7fa8d814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d5d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 0x7fa8d814ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60336/0 (socket says 172.21.15.32:60336) 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d5d9b640 1 -- 172.21.15.32:0/2657953988 learned_addr learned my addr 172.21.15.32:0/2657953988 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d659c640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80ce830 0x7fa8d814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d6d9d640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d815f1c0 0x7fa8d81f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d5d9b640 1 -- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80ce830 msgr2=0x7fa8d814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.258+0000 7fa8d5d9b640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80ce830 0x7fa8d814e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8d5d9b640 1 -- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d815f1c0 msgr2=0x7fa8d81f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8d5d9b640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d815f1c0 0x7fa8d81f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8d5d9b640 1 -- 172.21.15.32:0/2657953988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009b30 con 0x7fa8d80d3760 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8d5d9b640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 0x7fa8d814ea00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c7c0 tx=0x7fa8c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0007820 con 0x7fa8d80d3760 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c0007980 con 0x7fa8d80d3760 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d8150170 con 0x7fa8d80d3760 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0007cf0 con 0x7fa8d80d3760 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.259+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d8150730 con 0x7fa8d80d3760 2024-02-17T00:36:48.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.260+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8150920 con 0x7fa8d80d3760 2024-02-17T00:36:48.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.260+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa8c00113f0 con 0x7fa8d80d3760 2024-02-17T00:36:48.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.261+0000 7fa8ceffd640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa8b806b810 0x7fa8b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.261+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa8c008a140 con 0x7fa8d80d3760 2024-02-17T00:36:48.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.261+0000 7fa8d659c640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa8b806b810 0x7fa8b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.262+0000 7fa8d659c640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa8b806b810 0x7fa8b806dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000aaf0 tx=0x7fa8d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.265+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8c00548d0 con 0x7fa8d80d3760 2024-02-17T00:36:48.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.446+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8d8068f60 con 0x7fa8d80d3760 2024-02-17T00:36:48.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.446+0000 7fa8ceffd640 1 -- 172.21.15.32:0/2657953988 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8c0057f90 con 0x7fa8d80d3760 2024-02-17T00:36:48.450 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa8b806b810 msgr2=0x7fa8b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa8b806b810 0x7fa8b806dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000aaf0 tx=0x7fa8d0008040 comp rx=0 tx=0).stop 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 msgr2=0x7fa8d814ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 0x7fa8d814ea00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c7c0 tx=0x7fa8c000cc80 comp rx=0 tx=0).stop 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 shutdown_connections 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d815f1c0 0x7fa8d81f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d80d3760 0x7fa8d814ea00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa8b806b810 0x7fa8b806dcd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 --2- 172.21.15.32:0/2657953988 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8d80ce830 0x7fa8d814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 >> 172.21.15.32:0/2657953988 conn(0x7fa8d8072680 msgr2=0x7fa8d80c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:48.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 shutdown_connections 2024-02-17T00:36:48.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.448+0000 7fa8dcbc9640 1 -- 172.21.15.32:0/2657953988 wait complete. 2024-02-17T00:36:48.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:36:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.564+0000 7f670f325640 1 Processor -- start 2024-02-17T00:36:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.564+0000 7f670f325640 1 -- start start 2024-02-17T00:36:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670f325640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67080ce830 0x7f670815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670f325640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67080ce380 con 0x7f67080d3760 2024-02-17T00:36:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670f325640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670815f000 con 0x7f670815f1c0 2024-02-17T00:36:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670f325640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67080ceff0 con 0x7f67080ce830 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670d8c2640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67080ce830 0x7f670815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670d0c1640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f67080d3760 0x7f67080d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32792/0 (socket says 172.21.15.32:32792) 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670d0c1640 1 -- 172.21.15.32:0/1173851434 learned_addr learned my addr 172.21.15.32:0/1173851434 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670d8c2640 1 -- 172.21.15.32:0/1173851434 >> v1:172.21.15.39:6789/0 conn(0x7f670815f1c0 legacy=0x7f67080b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670d8c2640 1 -- 172.21.15.32:0/1173851434 >> v1:172.21.15.32:6789/0 conn(0x7f67080d3760 legacy=0x7f67080d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f670d8c2640 1 -- 172.21.15.32:0/1173851434 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080d2190 con 0x7f67080ce830 2024-02-17T00:36:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.565+0000 7f66fffff640 1 -- 172.21.15.32:0/1173851434 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062831179 0 0) 0x7f67080ce380 con 0x7f67080d3760 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.566+0000 7f670d8c2640 1 --2- 172.21.15.32:0/1173851434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67080ce830 0x7f670815eac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f670002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12591d26e7adb6bf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.566+0000 7f66fffff640 1 -- 172.21.15.32:0/1173851434 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670002cd00 con 0x7f67080ce830 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.566+0000 7f66fffff640 1 -- 172.21.15.32:0/1173851434 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670002ce60 con 0x7f67080ce830 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.566+0000 7f66fffff640 1 -- 172.21.15.32:0/1173851434 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700034660 con 0x7f67080ce830 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.566+0000 7f670f325640 1 -- 172.21.15.32:0/1173851434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67080ce830 msgr2=0x7f670815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.566+0000 7f670f325640 1 --2- 172.21.15.32:0/1173851434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67080ce830 0x7f670815eac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f670002bf50 comp rx=0 tx=0).stop 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.567+0000 7f670f325640 1 -- 172.21.15.32:0/1173851434 shutdown_connections 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.567+0000 7f670f325640 1 --2- 172.21.15.32:0/1173851434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67080ce830 0x7f670815eac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.567+0000 7f670f325640 1 -- 172.21.15.32:0/1173851434 >> 172.21.15.32:0/1173851434 conn(0x7f6708072680 msgr2=0x7f6708072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.567+0000 7f670f325640 1 -- 172.21.15.32:0/1173851434 shutdown_connections 2024-02-17T00:36:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.567+0000 7f670f325640 1 -- 172.21.15.32:0/1173851434 wait complete. 2024-02-17T00:36:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.568+0000 7f670f325640 1 Processor -- start 2024-02-17T00:36:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.568+0000 7f670f325640 1 -- start start 2024-02-17T00:36:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67080ce830 0x7f67080cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67080d3760 0x7f67081574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 0x7f6708158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6708157a20 con 0x7f670815f1c0 2024-02-17T00:36:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6708157cc0 con 0x7f67080d3760 2024-02-17T00:36:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6708157fa0 con 0x7f67080ce830 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 0x7f6708158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 0x7f6708158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60354/0 (socket says 172.21.15.32:60354) 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 -- 172.21.15.32:0/3045555453 learned_addr learned my addr 172.21.15.32:0/3045555453 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d0c1640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67080ce830 0x7f67080cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670c8c0640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67080d3760 0x7f67081574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 -- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67080ce830 msgr2=0x7f67080cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67080ce830 0x7f67080cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 -- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67080d3760 msgr2=0x7f67081574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67080d3760 0x7f67081574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 -- 172.21.15.32:0/3045555453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009a70 con 0x7f670815f1c0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670c8c0640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67080d3760 0x7f67081574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670d8c2640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 0x7f6708158d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f6700004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670003d600 con 0x7f670815f1c0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670003d780 con 0x7f670815f1c0 2024-02-17T00:36:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670003db30 con 0x7f670815f1c0 2024-02-17T00:36:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.569+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6708158280 con 0x7f670815f1c0 2024-02-17T00:36:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.570+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6708158840 con 0x7f670815f1c0 2024-02-17T00:36:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.571+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6708068f60 con 0x7f670815f1c0 2024-02-17T00:36:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.571+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f670003b040 con 0x7f670815f1c0 2024-02-17T00:36:48.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.571+0000 7f66fdffb640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66ec06b810 0x7f66ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.571+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f67000ac540 con 0x7f670815f1c0 2024-02-17T00:36:48.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.571+0000 7f670d0c1640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66ec06b810 0x7f66ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.572+0000 7f670d0c1640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66ec06b810 0x7f66ec06dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6704000f60 tx=0x7f6704007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.576+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6700076c20 con 0x7f670815f1c0 2024-02-17T00:36:48.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.753+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67080ce610 con 0x7f670815f1c0 2024-02-17T00:36:48.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.753+0000 7f66fdffb640 1 -- 172.21.15.32:0/3045555453 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f670007a2e0 con 0x7f670815f1c0 2024-02-17T00:36:48.757 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:36:48.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66ec06b810 msgr2=0x7f66ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66ec06b810 0x7f66ec06dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6704000f60 tx=0x7f6704007b90 comp rx=0 tx=0).stop 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 msgr2=0x7f6708158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 0x7f6708158d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f6700004a40 comp rx=0 tx=0).stop 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 shutdown_connections 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f670815f1c0 0x7f6708158d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67080d3760 0x7f67081574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66ec06b810 0x7f66ec06dcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 --2- 172.21.15.32:0/3045555453 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67080ce830 0x7f67080cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 >> 172.21.15.32:0/3045555453 conn(0x7f6708072680 msgr2=0x7f670815e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 shutdown_connections 2024-02-17T00:36:48.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.755+0000 7f670f325640 1 -- 172.21.15.32:0/3045555453 wait complete. 2024-02-17T00:36:48.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:36:48.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.869+0000 7fe2bc13a640 1 Processor -- start 2024-02-17T00:36:48.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.870+0000 7fe2bc13a640 1 -- start start 2024-02-17T00:36:48.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.870+0000 7fe2bc13a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b4071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.870+0000 7fe2bc13a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe2b4071670 0x7fe2b415c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.870+0000 7fe2bc13a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40a8560 con 0x7fe2b4144fe0 2024-02-17T00:36:48.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.870+0000 7fe2bc13a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b4071b00 con 0x7fe2b4071670 2024-02-17T00:36:48.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.870+0000 7fe2bc13a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41453c0 con 0x7fe2b406d130 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe2b4071670 0x7fe2b415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe2b4071670 0x7fe2b415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60358/0 (socket says 172.21.15.32:60358) 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/917196214 learned_addr learned my addr 172.21.15.32:0/917196214 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2b96d5640 1 --2- 172.21.15.32:0/917196214 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b4071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/917196214 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 msgr2=0x7fe2b4071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 --2- 172.21.15.32:0/917196214 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b4071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/917196214 >> v1:172.21.15.39:6789/0 conn(0x7fe2b4144fe0 legacy=0x7fe2b406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:48.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.871+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/917196214 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b406d6a0 con 0x7fe2b4071670 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2ba6d7640 1 --2- 172.21.15.32:0/917196214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4071670 0x7fe2b415c370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009e50 tx=0x7fe2ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb8c5ceb0a59d1e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2b8ed4640 1 -- 172.21.15.32:0/917196214 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac02ca70 con 0x7fe2b4071670 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2b8ed4640 1 -- 172.21.15.32:0/917196214 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac02cbd0 con 0x7fe2b4071670 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2b8ed4640 1 -- 172.21.15.32:0/917196214 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0343f0 con 0x7fe2b4071670 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 -- 172.21.15.32:0/917196214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4071670 msgr2=0x7fe2b415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/917196214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4071670 0x7fe2b415c370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009e50 tx=0x7fe2ac02bed0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 -- 172.21.15.32:0/917196214 shutdown_connections 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/917196214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4071670 0x7fe2b415c370 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/917196214 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b4071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 -- 172.21.15.32:0/917196214 >> 172.21.15.32:0/917196214 conn(0x7fe2b406ab60 msgr2=0x7fe2b406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:48.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 -- 172.21.15.32:0/917196214 shutdown_connections 2024-02-17T00:36:48.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.872+0000 7fe2bc13a640 1 -- 172.21.15.32:0/917196214 wait complete. 2024-02-17T00:36:48.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 Processor -- start 2024-02-17T00:36:48.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 -- start start 2024-02-17T00:36:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b413ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b4071670 0x7fe2b4138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 0x7fe2b4142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b413a530 con 0x7fe2b4144fe0 2024-02-17T00:36:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4139920 con 0x7fe2b4071670 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2bc13a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4139c00 con 0x7fe2b406d130 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2ba6d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 0x7fe2b4142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2ba6d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 0x7fe2b4142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60366/0 (socket says 172.21.15.32:60366) 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/3234749016 learned_addr learned my addr 172.21.15.32:0/3234749016 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2b9ed6640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b413ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.874+0000 7fe2b96d5640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b4071670 0x7fe2b4138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 msgr2=0x7fe2b413ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2ba6d7640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b413ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b4071670 msgr2=0x7fe2b4138e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2ba6d7640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b4071670 0x7fe2b4138e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2ba6d7640 1 -- 172.21.15.32:0/3234749016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac009b30 con 0x7fe2b4144fe0 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2ba6d7640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 0x7fe2b4142a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac036040 tx=0x7fe2ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac03e450 con 0x7fe2b4144fe0 2024-02-17T00:36:48.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac03e5d0 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4139ee0 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac03e980 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.875+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b413b220 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.876+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b4068f60 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.876+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe2ac03eae0 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.877+0000 7fe2aa7fc640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe29806b810 0x7fe29806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.877+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe2ac0ad330 con 0x7fe2b4144fe0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.877+0000 7fe2b9ed6640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe29806b810 0x7fe29806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.877+0000 7fe2b9ed6640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe29806b810 0x7fe29806dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0006fd0 tx=0x7fe2b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:48.881+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2ac077aa0 con 0x7fe2b4144fe0 2024-02-17T00:36:49.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.060+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2b413e880 con 0x7fe2b4144fe0 2024-02-17T00:36:49.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.060+0000 7fe2aa7fc640 1 -- 172.21.15.32:0/3234749016 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2ac07b160 con 0x7fe2b4144fe0 2024-02-17T00:36:49.064 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe29806b810 msgr2=0x7fe29806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe29806b810 0x7fe29806dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0006fd0 tx=0x7fe2b0008040 comp rx=0 tx=0).stop 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 msgr2=0x7fe2b4142a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 0x7fe2b4142a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac036040 tx=0x7fe2ac004a40 comp rx=0 tx=0).stop 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 shutdown_connections 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b4144fe0 0x7fe2b4142a60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b4071670 0x7fe2b4138e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe29806b810 0x7fe29806dcd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 --2- 172.21.15.32:0/3234749016 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe2b406d130 0x7fe2b413ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.062+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 >> 172.21.15.32:0/3234749016 conn(0x7fe2b406ab60 msgr2=0x7fe2b41400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:49.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.063+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 shutdown_connections 2024-02-17T00:36:49.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.063+0000 7fe2bc13a640 1 -- 172.21.15.32:0/3234749016 wait complete. 2024-02-17T00:36:49.076 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T00:36:49.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.176+0000 7f817aceb640 1 Processor -- start 2024-02-17T00:36:49.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.176+0000 7f817aceb640 1 -- start start 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f817aceb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f817415dd00 0x7f81740b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f817aceb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f817406c6c0 0x7f81740b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f817aceb640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817415e0e0 con 0x7f81740b6a40 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f817aceb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817406cfe0 con 0x7f817406c6c0 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f817aceb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817406cd00 con 0x7f817415dd00 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f8173fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f81740b6a40 0x7f817406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32794/0 (socket says 172.21.15.32:32794) 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f8173fff640 1 -- 172.21.15.32:0/3511817051 learned_addr learned my addr 172.21.15.32:0/3511817051 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f8179288640 1 --2- 172.21.15.32:0/3511817051 >> v2:172.21.15.39:3300/0 conn(0x7f817406c6c0 0x7f81740b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f8178a87640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f817415dd00 0x7f81740b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283708150 0 0) 0x7f815c001110 con 0x7f81740b6a40 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.177+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8160003520 con 0x7f81740b6a40 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1417972145 0 0) 0x7f8160003520 con 0x7f81740b6a40 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f817415dd00 msgr2=0x7f81740b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f817415dd00 0x7f81740b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 >> v2:172.21.15.39:3300/0 conn(0x7f817406c6c0 msgr2=0x7f81740b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 --2- 172.21.15.32:0/3511817051 >> v2:172.21.15.39:3300/0 conn(0x7f817406c6c0 0x7f81740b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740d1ca0 con 0x7f81740b6a40 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f815c001800 con 0x7f81740b6a40 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 >> v1:172.21.15.32:6789/0 conn(0x7f81740b6a40 legacy=0x7f817406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8160003970 0x7f8160003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81600047c0 0x7f8160004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8160005180 0x7f816000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817406cfe0 con 0x7f8160003970 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817406cd00 con 0x7f8160005180 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816000bec0 con 0x7f81600047c0 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f817415dd00 0x7f81740b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8179288640 1 --2- 172.21.15.32:0/3511817051 >> v2:172.21.15.39:3300/0 conn(0x7f817406c6c0 0x7f81740b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8160003970 0x7f8160003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8173fff640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81600047c0 0x7f8160004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8179288640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8160005180 0x7f816000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 -- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81600047c0 msgr2=0x7f8160004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81600047c0 0x7f8160004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 -- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8160005180 msgr2=0x7f816000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8160005180 0x7f816000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.178+0000 7f8178a87640 1 -- 172.21.15.32:0/3511817051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160003520 con 0x7f8160003970 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f8178a87640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8160003970 0x7f8160003d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81740b6500 tx=0x7f81600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5241923654c7823a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c02ccf0 con 0x7f8160003970 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c00f040 con 0x7f8160003970 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f81737fe640 1 -- 172.21.15.32:0/3511817051 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c003bb0 con 0x7f8160003970 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f817aceb640 1 -- 172.21.15.32:0/3511817051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8160003970 msgr2=0x7f8160003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f817aceb640 1 --2- 172.21.15.32:0/3511817051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8160003970 0x7f8160003d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81740b6500 tx=0x7f81600057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.179+0000 7f8179288640 1 -- 172.21.15.32:0/3511817051 reap_dead start 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.180+0000 7f817aceb640 1 -- 172.21.15.32:0/3511817051 shutdown_connections 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.180+0000 7f817aceb640 1 -- 172.21.15.32:0/3511817051 >> 172.21.15.32:0/3511817051 conn(0x7f81740d07b0 msgr2=0x7f81740d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.180+0000 7f817aceb640 1 -- 172.21.15.32:0/3511817051 shutdown_connections 2024-02-17T00:36:49.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.180+0000 7f817aceb640 1 -- 172.21.15.32:0/3511817051 wait complete. 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.181+0000 7f817aceb640 1 Processor -- start 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.181+0000 7f817aceb640 1 -- start start 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8160003970 0x7f81741f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 0x7f8174149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81741495a0 0x7f81741f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740cbb60 con 0x7f817414f100 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740c9e20 con 0x7f81741495a0 2024-02-17T00:36:49.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817414f580 con 0x7f8160003970 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 0x7f8174149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 0x7f8174149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60380/0 (socket says 172.21.15.32:60380) 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 -- 172.21.15.32:0/1572799695 learned_addr learned my addr 172.21.15.32:0/1572799695 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8179288640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81741495a0 0x7f81741f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8178a87640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8160003970 0x7f81741f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 -- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8160003970 msgr2=0x7f81741f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8160003970 0x7f81741f3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 -- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81741495a0 msgr2=0x7f81741f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81741495a0 0x7f81741f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 -- 172.21.15.32:0/1572799695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740cbd70 con 0x7f817414f100 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8178a87640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8160003970 0x7f81741f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8179288640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81741495a0 0x7f81741f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f8173fff640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 0x7f8174149060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f815c004f40 tx=0x7f815c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00f750 con 0x7f817414f100 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00f910 con 0x7f817414f100 2024-02-17T00:36:49.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81740cc050 con 0x7f817414f100 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00fcc0 con 0x7f817414f100 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.182+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740cc610 con 0x7f817414f100 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.183+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81740680c0 con 0x7f817414f100 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.184+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f815c01d460 con 0x7f817414f100 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.184+0000 7f81717fa640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f815406b810 0x7f815406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.184+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f815c08a4a0 con 0x7f817414f100 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.184+0000 7f8178a87640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f815406b810 0x7f815406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.185+0000 7f8178a87640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f815406b810 0x7f815406dcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f816c035000 tx=0x7f816c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.188+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f815c054c30 con 0x7f817414f100 2024-02-17T00:36:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.380+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81740b9920 con 0x7f817414f100 2024-02-17T00:36:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.381+0000 7f81717fa640 1 -- 172.21.15.32:0/1572799695 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f815c0582f0 con 0x7f817414f100 2024-02-17T00:36:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.382+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f815406b810 msgr2=0x7f815406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.382+0000 7f817aceb640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f815406b810 0x7f815406dcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f816c035000 tx=0x7f816c02e000 comp rx=0 tx=0).stop 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.382+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 msgr2=0x7f8174149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.382+0000 7f817aceb640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 0x7f8174149060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f815c004f40 tx=0x7f815c0074f0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 shutdown_connections 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81741495a0 0x7f81741f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f817414f100 0x7f8174149060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f815406b810 0x7f815406dcd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 --2- 172.21.15.32:0/1572799695 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8160003970 0x7f81741f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 >> 172.21.15.32:0/1572799695 conn(0x7f81740d07b0 msgr2=0x7f81740cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 shutdown_connections 2024-02-17T00:36:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.383+0000 7f817aceb640 1 -- 172.21.15.32:0/1572799695 wait complete. 2024-02-17T00:36:49.396 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:36:49.396 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:36:49.411 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:49.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.548+0000 7f6715ad4640 1 Processor -- start 2024-02-17T00:36:49.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.548+0000 7f6715ad4640 1 -- start start 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f6715ad4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67100d0a50 0x7f67100d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f6715ad4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100b53b0 0x7f67100d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f6715ad4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100d1e80 con 0x7f671015db00 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f6715ad4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100b5930 con 0x7f67100d0a50 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f6715ad4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b5c10 con 0x7f67100b53b0 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670f7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f671015db00 0x7f67100d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32810/0 (socket says 172.21.15.32:32810) 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670f7fe640 1 -- 172.21.15.32:0/182848593 learned_addr learned my addr 172.21.15.32:0/182848593 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670ffff640 1 --2- 172.21.15.32:0/182848593 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100b53b0 0x7f67100d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670effd640 1 --2- 172.21.15.32:0/182848593 >> v2:172.21.15.39:3300/0 conn(0x7f67100d0a50 0x7f67100d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670e7fc640 1 -- 172.21.15.32:0/182848593 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620423315 0 0) 0x7f67100d1e80 con 0x7f671015db00 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670e7fc640 1 -- 172.21.15.32:0/182848593 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f8003520 con 0x7f671015db00 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670ffff640 1 -- 172.21.15.32:0/182848593 >> v2:172.21.15.39:3300/0 conn(0x7f67100d0a50 msgr2=0x7f67100d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670ffff640 1 --2- 172.21.15.32:0/182848593 >> v2:172.21.15.39:3300/0 conn(0x7f67100d0a50 0x7f67100d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670ffff640 1 -- 172.21.15.32:0/182848593 >> v1:172.21.15.32:6789/0 conn(0x7f671015db00 legacy=0x7f67100d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.549+0000 7f670ffff640 1 -- 172.21.15.32:0/182848593 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100b5ef0 con 0x7f67100b53b0 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.550+0000 7f670ffff640 1 --2- 172.21.15.32:0/182848593 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100b53b0 0x7f67100d2870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6708009d90 tx=0x7f670802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a5b9bc19f6b37a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.550+0000 7f670e7fc640 1 -- 172.21.15.32:0/182848593 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670802cc50 con 0x7f67100b53b0 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.550+0000 7f670e7fc640 1 -- 172.21.15.32:0/182848593 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670802cdb0 con 0x7f67100b53b0 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f670e7fc640 1 -- 172.21.15.32:0/182848593 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708034640 con 0x7f67100b53b0 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 -- 172.21.15.32:0/182848593 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100b53b0 msgr2=0x7f67100d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 --2- 172.21.15.32:0/182848593 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100b53b0 0x7f67100d2870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6708009d90 tx=0x7f670802bea0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 -- 172.21.15.32:0/182848593 shutdown_connections 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 --2- 172.21.15.32:0/182848593 >> v2:172.21.15.39:3300/0 conn(0x7f67100d0a50 0x7f67100d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 --2- 172.21.15.32:0/182848593 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100b53b0 0x7f67100d2870 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 -- 172.21.15.32:0/182848593 >> 172.21.15.32:0/182848593 conn(0x7f6710072290 msgr2=0x7f67100726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 -- 172.21.15.32:0/182848593 shutdown_connections 2024-02-17T00:36:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.551+0000 7f6715ad4640 1 -- 172.21.15.32:0/182848593 wait complete. 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.552+0000 7f6715ad4640 1 Processor -- start 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.552+0000 7f6715ad4640 1 -- start start 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f6715ad4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 0x7f671015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f6715ad4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100d0a50 0x7f67101567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f6715ad4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f671015db00 0x7f6710156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f6715ad4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710160bc0 con 0x7f67100b53b0 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f6715ad4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710160ea0 con 0x7f671015db00 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f6715ad4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c75e0 con 0x7f67100d0a50 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 0x7f671015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 0x7f671015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60394/0 (socket says 172.21.15.32:60394) 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670f7fe640 1 -- 172.21.15.32:0/3731115921 learned_addr learned my addr 172.21.15.32:0/3731115921 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670ffff640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f671015db00 0x7f6710156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670effd640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100d0a50 0x7f67101567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670f7fe640 1 -- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100d0a50 msgr2=0x7f67101567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.553+0000 7f670f7fe640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100d0a50 0x7f67101567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f670f7fe640 1 -- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f671015db00 msgr2=0x7f6710156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f670f7fe640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f671015db00 0x7f6710156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f670f7fe640 1 -- 172.21.15.32:0/3731115921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009a70 con 0x7f67100b53b0 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f670f7fe640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 0x7f671015eb00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f670000c390 tx=0x7f670000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700005ce0 con 0x7f67100b53b0 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700005e40 con 0x7f67100b53b0 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000072f0 con 0x7f67100b53b0 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100c78c0 con 0x7f67100b53b0 2024-02-17T00:36:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.554+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6710160950 con 0x7f67100b53b0 2024-02-17T00:36:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.555+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100c7ae0 con 0x7f67100b53b0 2024-02-17T00:36:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.555+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6700007450 con 0x7f67100b53b0 2024-02-17T00:36:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.556+0000 7f66f7fff640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66fc06b810 0x7f66fc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.556+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6700089ad0 con 0x7f67100b53b0 2024-02-17T00:36:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.556+0000 7f670effd640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66fc06b810 0x7f66fc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.556+0000 7f670effd640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66fc06b810 0x7f66fc06dcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67100b90b0 tx=0x7f6704009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.560+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67000541c0 con 0x7f67100b53b0 2024-02-17T00:36:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.740+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6710068fd0 con 0x7f67100b53b0 2024-02-17T00:36:49.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.741+0000 7f66f7fff640 1 -- 172.21.15.32:0/3731115921 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f6700017090 con 0x7f67100b53b0 2024-02-17T00:36:49.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:49.745 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66fc06b810 msgr2=0x7f66fc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66fc06b810 0x7f66fc06dcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67100b90b0 tx=0x7f6704009190 comp rx=0 tx=0).stop 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 msgr2=0x7f671015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 0x7f671015eb00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f670000c390 tx=0x7f670000c850 comp rx=0 tx=0).stop 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 shutdown_connections 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f671015db00 0x7f6710156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f66fc06b810 0x7f66fc06dcd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f67100d0a50 0x7f67101567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 --2- 172.21.15.32:0/3731115921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67100b53b0 0x7f671015eb00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 >> 172.21.15.32:0/3731115921 conn(0x7f6710072290 msgr2=0x7f6710158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:49.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 shutdown_connections 2024-02-17T00:36:49.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.743+0000 7f6715ad4640 1 -- 172.21.15.32:0/3731115921 wait complete. 2024-02-17T00:36:49.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:36:49.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:36:49.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.860+0000 7fad3012c640 1 Processor -- start 2024-02-17T00:36:49.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.860+0000 7fad3012c640 1 -- start start 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad3012c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fad280ce830 0x7fad2815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad3012c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad280ce380 con 0x7fad2815f1c0 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad3012c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2815f000 con 0x7fad280d3760 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad3012c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad280ceff0 con 0x7fad280ce830 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2e6c9640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fad280ce830 0x7fad2815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2e6c9640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fad280ce830 0x7fad2815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60410/0 (socket says 172.21.15.32:60410) 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2e6c9640 1 -- 172.21.15.32:0/2746154540 learned_addr learned my addr 172.21.15.32:0/2746154540 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:49.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2d6c7640 1 --1- 172.21.15.32:0/2746154540 >> v1:172.21.15.32:6789/0 conn(0x7fad2815f1c0 0x7fad280b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32816/0 (socket says 172.21.15.32:32816) 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2e6c9640 1 -- 172.21.15.32:0/2746154540 >> v1:172.21.15.39:6789/0 conn(0x7fad280d3760 legacy=0x7fad280d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2e6c9640 1 -- 172.21.15.32:0/2746154540 >> v1:172.21.15.32:6789/0 conn(0x7fad2815f1c0 legacy=0x7fad280b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2e6c9640 1 -- 172.21.15.32:0/2746154540 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280d2190 con 0x7fad280ce830 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.861+0000 7fad2cec6640 1 -- 172.21.15.32:0/2746154540 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779653749 0 0) 0x7fad280ce380 con 0x7fad2815f1c0 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad2e6c9640 1 --2- 172.21.15.32:0/2746154540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad280ce830 0x7fad2815eac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43244816f9657e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad2cec6640 1 -- 172.21.15.32:0/2746154540 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2002cbb0 con 0x7fad280ce830 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad2cec6640 1 -- 172.21.15.32:0/2746154540 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2002cd10 con 0x7fad280ce830 2024-02-17T00:36:49.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad2cec6640 1 -- 172.21.15.32:0/2746154540 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20034610 con 0x7fad280ce830 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad3012c640 1 -- 172.21.15.32:0/2746154540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad280ce830 msgr2=0x7fad2815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad3012c640 1 --2- 172.21.15.32:0/2746154540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad280ce830 0x7fad2815eac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2002c010 comp rx=0 tx=0).stop 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad3012c640 1 -- 172.21.15.32:0/2746154540 shutdown_connections 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.862+0000 7fad3012c640 1 --2- 172.21.15.32:0/2746154540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad280ce830 0x7fad2815eac0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.863+0000 7fad3012c640 1 -- 172.21.15.32:0/2746154540 >> 172.21.15.32:0/2746154540 conn(0x7fad28072680 msgr2=0x7fad28072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.863+0000 7fad3012c640 1 -- 172.21.15.32:0/2746154540 shutdown_connections 2024-02-17T00:36:49.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.863+0000 7fad3012c640 1 -- 172.21.15.32:0/2746154540 wait complete. 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 Processor -- start 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 -- start start 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad280ce830 0x7fad28159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fad280d3760 0x7fad281e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 0x7fad2814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad281e7f80 con 0x7fad2815f1c0 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2814d1b0 con 0x7fad280ce830 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad3012c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad281e69a0 con 0x7fad280d3760 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.864+0000 7fad2e6c9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 0x7fad2814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 0x7fad2814cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60420/0 (socket says 172.21.15.32:60420) 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 -- 172.21.15.32:0/3739507900 learned_addr learned my addr 172.21.15.32:0/3739507900 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2d6c7640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fad280d3760 0x7fad281e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2dec8640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad280ce830 0x7fad28159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 -- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fad280d3760 msgr2=0x7fad281e7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fad280d3760 0x7fad281e7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 -- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad280ce830 msgr2=0x7fad28159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad280ce830 0x7fad28159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 -- 172.21.15.32:0/3739507900 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20009b30 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad2e6c9640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 0x7fad2814cc70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad20036040 tx=0x7fad20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20003990 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20003af0 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad281e6c80 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20003c80 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.865+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad281e7240 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.866+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad28068f60 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.867+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fad20048460 con 0x7fad2815f1c0 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.867+0000 7fad1e7fc640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fad0c06b810 0x7fad0c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:49.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.867+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fad200acc20 con 0x7fad2815f1c0 2024-02-17T00:36:49.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.867+0000 7fad2dec8640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fad0c06b810 0x7fad0c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:49.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.868+0000 7fad2dec8640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fad0c06b810 0x7fad0c06dcd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad2815d320 tx=0x7fad24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:49.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:49.871+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad20077300 con 0x7fad2815f1c0 2024-02-17T00:36:50.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.049+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad280ce610 con 0x7fad2815f1c0 2024-02-17T00:36:50.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.050+0000 7fad1e7fc640 1 -- 172.21.15.32:0/3739507900 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad2007a9c0 con 0x7fad2815f1c0 2024-02-17T00:36:50.053 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fad0c06b810 msgr2=0x7fad0c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fad0c06b810 0x7fad0c06dcd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad2815d320 tx=0x7fad24009040 comp rx=0 tx=0).stop 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 msgr2=0x7fad2814cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 0x7fad2814cc70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad20036040 tx=0x7fad20004a40 comp rx=0 tx=0).stop 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 shutdown_connections 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad2815f1c0 0x7fad2814cc70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fad0c06b810 0x7fad0c06dcd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fad280d3760 0x7fad281e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 --2- 172.21.15.32:0/3739507900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad280ce830 0x7fad28159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.051+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 >> 172.21.15.32:0/3739507900 conn(0x7fad28072680 msgr2=0x7fad280b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.052+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 shutdown_connections 2024-02-17T00:36:50.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.052+0000 7fad3012c640 1 -- 172.21.15.32:0/3739507900 wait complete. 2024-02-17T00:36:50.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:36:50.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.169+0000 7f44f908d640 1 Processor -- start 2024-02-17T00:36:50.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f908d640 1 -- start start 2024-02-17T00:36:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f908d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 0x7f44f415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f908d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f40ce380 con 0x7f44f40ce830 2024-02-17T00:36:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f908d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f415f000 con 0x7f44f415f1c0 2024-02-17T00:36:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f908d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40ceff0 con 0x7f44f40d3760 2024-02-17T00:36:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f359e640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f44f40ce830 0x7f44f40b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32826/0 (socket says 172.21.15.32:32826) 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.170+0000 7f44f359e640 1 -- 172.21.15.32:0/164499124 learned_addr learned my addr 172.21.15.32:0/164499124 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875520295 0 0) 0x7f44f40ce380 con 0x7f44f40ce830 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f2d9d640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 0x7f44f415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e0003520 con 0x7f44f40ce830 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293031288 0 0) 0x7f44e0003520 con 0x7f44f40ce830 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 msgr2=0x7f44f415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 0x7f44f415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 >> v1:172.21.15.39:6789/0 conn(0x7f44f415f1c0 legacy=0x7f44f40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40d2190 con 0x7f44f40ce830 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f44ec0019f0 con 0x7f44f40ce830 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 >> v1:172.21.15.32:6789/0 conn(0x7f44f40ce830 legacy=0x7f44f40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44e00039a0 0x7f44e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 0x7f44e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44e0004d00 0x7f44e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40ceff0 con 0x7f44e0004d00 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e000ba30 con 0x7f44e00039a0 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e000bbf0 con 0x7f44f40d3760 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f359e640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44e0004d00 0x7f44e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44ebfff640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 0x7f44e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f2d9d640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44e00039a0 0x7f44e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f359e640 1 -- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 msgr2=0x7f44e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f359e640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40d3760 0x7f44e00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f359e640 1 -- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44e00039a0 msgr2=0x7f44e0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f359e640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44e00039a0 0x7f44e0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.171+0000 7f44f359e640 1 -- 172.21.15.32:0/164499124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0003520 con 0x7f44e0004d00 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.172+0000 7f44f359e640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44e0004d00 0x7f44e0005180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f44f40cec40 tx=0x7f44e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0640814ed107b51 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.172+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0072d0 con 0x7f44e0004d00 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.172+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec02f070 con 0x7f44e0004d00 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.172+0000 7f44f259c640 1 -- 172.21.15.32:0/164499124 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007690 con 0x7f44e0004d00 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f908d640 1 -- 172.21.15.32:0/164499124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44e0004d00 msgr2=0x7f44e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f908d640 1 --2- 172.21.15.32:0/164499124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44e0004d00 0x7f44e0005180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f44f40cec40 tx=0x7f44e00057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f359e640 1 -- 172.21.15.32:0/164499124 reap_dead start 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f908d640 1 -- 172.21.15.32:0/164499124 shutdown_connections 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f908d640 1 -- 172.21.15.32:0/164499124 >> 172.21.15.32:0/164499124 conn(0x7f44f4072680 msgr2=0x7f44f4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f908d640 1 -- 172.21.15.32:0/164499124 shutdown_connections 2024-02-17T00:36:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.173+0000 7f44f908d640 1 -- 172.21.15.32:0/164499124 wait complete. 2024-02-17T00:36:50.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.174+0000 7f44f908d640 1 Processor -- start 2024-02-17T00:36:50.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.174+0000 7f44f908d640 1 -- start start 2024-02-17T00:36:50.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f908d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f4148770 0x7f44f40c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f908d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40c99f0 0x7f44f41498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f908d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 0x7f44f41f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f908d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f414c690 con 0x7f44f4149de0 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f908d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40c9e70 con 0x7f44f40c99f0 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f908d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f414ad90 con 0x7f44f4148770 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 0x7f44f41f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 0x7f44f41f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60430/0 (socket says 172.21.15.32:60430) 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 -- 172.21.15.32:0/74662653 learned_addr learned my addr 172.21.15.32:0/74662653 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44ebfff640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40c99f0 0x7f44f41498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f2d9d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f4148770 0x7f44f40c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 -- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f4148770 msgr2=0x7f44f40c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f4148770 0x7f44f40c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 -- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40c99f0 msgr2=0x7f44f41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40c99f0 0x7f44f41498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 -- 172.21.15.32:0/74662653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f414a260 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.175+0000 7f44f359e640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 0x7f44f41f2a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44ec001cb0 tx=0x7f44f40d2100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.176+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec044070 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.176+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec0019e0 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.176+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f415c870 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.176+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0074e0 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.176+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f414a7d0 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.177+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f414c7d0 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.177+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f44ec031030 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.178+0000 7f44eb7fe640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44d406b810 0x7f44d406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.178+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f44ec02ce40 con 0x7f44f4149de0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.178+0000 7f44f2d9d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44d406b810 0x7f44d406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.178+0000 7f44f2d9d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44d406b810 0x7f44d406dcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009b00 tx=0x7f44e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.182+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44f414c7d0 con 0x7f44f4149de0 2024-02-17T00:36:50.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.362+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44f414c7d0 con 0x7f44f4149de0 2024-02-17T00:36:50.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.362+0000 7f44eb7fe640 1 -- 172.21.15.32:0/74662653 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44f414c7d0 con 0x7f44f4149de0 2024-02-17T00:36:50.365 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44d406b810 msgr2=0x7f44d406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44d406b810 0x7f44d406dcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009b00 tx=0x7f44e4008040 comp rx=0 tx=0).stop 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 msgr2=0x7f44f41f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 0x7f44f41f2a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44ec001cb0 tx=0x7f44f40d2100 comp rx=0 tx=0).stop 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 shutdown_connections 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f4149de0 0x7f44f41f2a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40c99f0 0x7f44f41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44d406b810 0x7f44d406dcd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 --2- 172.21.15.32:0/74662653 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f4148770 0x7f44f40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 >> 172.21.15.32:0/74662653 conn(0x7f44f4072680 msgr2=0x7f44f40b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 shutdown_connections 2024-02-17T00:36:50.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.364+0000 7f44f908d640 1 -- 172.21.15.32:0/74662653 wait complete. 2024-02-17T00:36:50.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:36:50.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.480+0000 7fdfe930c640 1 Processor -- start 2024-02-17T00:36:50.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.480+0000 7fdfe930c640 1 -- start start 2024-02-17T00:36:50.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe930c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe415dc40 0x7fdfe40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe930c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdfe40b2800 0x7fdfe40cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe930c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe40d0250 con 0x7fdfe40af710 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe930c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe415e020 con 0x7fdfe40b2800 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe930c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40ccac0 con 0x7fdfe415dc40 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe27fc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdfe40b2800 0x7fdfe40cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe27fc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdfe40b2800 0x7fdfe40cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60444/0 (socket says 172.21.15.32:60444) 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe27fc640 1 -- 172.21.15.32:0/3507906486 learned_addr learned my addr 172.21.15.32:0/3507906486 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.481+0000 7fdfe37fe640 1 --1- 172.21.15.32:0/3507906486 >> v1:172.21.15.32:6789/0 conn(0x7fdfe40af710 0x7fdfe406e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32828/0 (socket says 172.21.15.32:32828) 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe2ffd640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe415dc40 0x7fdfe40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe27fc640 1 -- 172.21.15.32:0/3507906486 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe415dc40 msgr2=0x7fdfe40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe27fc640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe415dc40 0x7fdfe40cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe27fc640 1 -- 172.21.15.32:0/3507906486 >> v1:172.21.15.32:6789/0 conn(0x7fdfe40af710 legacy=0x7fdfe406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe27fc640 1 -- 172.21.15.32:0/3507906486 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40cc7e0 con 0x7fdfe40b2800 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe1ffb640 1 -- 172.21.15.32:0/3507906486 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655449306 0 0) 0x7fdfe40d0250 con 0x7fdfe40af710 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe2ffd640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe415dc40 0x7fdfe40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:50.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.482+0000 7fdfe27fc640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe40b2800 0x7fdfe40cfd10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009870 tx=0x7fdfd802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a72bc8c7ba81b8c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe1ffb640 1 -- 172.21.15.32:0/3507906486 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80317c0 con 0x7fdfe40b2800 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe1ffb640 1 -- 172.21.15.32:0/3507906486 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd8031920 con 0x7fdfe40b2800 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe1ffb640 1 -- 172.21.15.32:0/3507906486 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8031cb0 con 0x7fdfe40b2800 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 -- 172.21.15.32:0/3507906486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe40b2800 msgr2=0x7fdfe40cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe40b2800 0x7fdfe40cfd10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009870 tx=0x7fdfd802b860 comp rx=0 tx=0).stop 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 -- 172.21.15.32:0/3507906486 shutdown_connections 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe40b2800 0x7fdfe40cfd10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 --2- 172.21.15.32:0/3507906486 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe415dc40 0x7fdfe40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 -- 172.21.15.32:0/3507906486 >> 172.21.15.32:0/3507906486 conn(0x7fdfe40999f0 msgr2=0x7fdfe40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 -- 172.21.15.32:0/3507906486 shutdown_connections 2024-02-17T00:36:50.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.483+0000 7fdfe930c640 1 -- 172.21.15.32:0/3507906486 wait complete. 2024-02-17T00:36:50.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.484+0000 7fdfe930c640 1 Processor -- start 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.484+0000 7fdfe930c640 1 -- start start 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe930c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfe40af710 0x7fdfe40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe930c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe40b2800 0x7fdfe40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe930c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 0x7fdfe40b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe930c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40b46a0 con 0x7fdfe415dc40 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe930c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40b3a90 con 0x7fdfe40af710 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe930c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40b3d70 con 0x7fdfe40b2800 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe37fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 0x7fdfe40b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe37fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 0x7fdfe40b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60458/0 (socket says 172.21.15.32:60458) 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe37fe640 1 -- 172.21.15.32:0/2409851317 learned_addr learned my addr 172.21.15.32:0/2409851317 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe27fc640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe40b2800 0x7fdfe40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.485+0000 7fdfe2ffd640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfe40af710 0x7fdfe40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe37fe640 1 -- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe40b2800 msgr2=0x7fdfe40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe37fe640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe40b2800 0x7fdfe40b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe37fe640 1 -- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfe40af710 msgr2=0x7fdfe40b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe37fe640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfe40af710 0x7fdfe40b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe37fe640 1 -- 172.21.15.32:0/2409851317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80094d0 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe37fe640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 0x7fdfe40b3460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c700 tx=0x7fdfd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400ce10 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd400a640 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe40b4050 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400aa70 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.486+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe4156120 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.487+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe40b4810 con 0x7fdfe415dc40 2024-02-17T00:36:50.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.487+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdfd400abd0 con 0x7fdfe415dc40 2024-02-17T00:36:50.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.488+0000 7fdfcb7fe640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdfd006b810 0x7fdfd006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.488+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdfd4089bf0 con 0x7fdfe415dc40 2024-02-17T00:36:50.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.488+0000 7fdfe2ffd640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdfd006b810 0x7fdfd006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.489+0000 7fdfe2ffd640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdfd006b810 0x7fdfd006dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00ab60 tx=0x7fdfdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.492+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdfd4054380 con 0x7fdfe415dc40 2024-02-17T00:36:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.672+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfe4068f60 con 0x7fdfe415dc40 2024-02-17T00:36:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.673+0000 7fdfcb7fe640 1 -- 172.21.15.32:0/2409851317 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfd4018020 con 0x7fdfe415dc40 2024-02-17T00:36:50.676 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:36:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.674+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdfd006b810 msgr2=0x7fdfd006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.674+0000 7fdfe930c640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdfd006b810 0x7fdfd006dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00ab60 tx=0x7fdfdc008040 comp rx=0 tx=0).stop 2024-02-17T00:36:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 msgr2=0x7fdfe40b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 0x7fdfe40b3460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c700 tx=0x7fdfd400cbc0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 shutdown_connections 2024-02-17T00:36:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfe415dc40 0x7fdfe40b3460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdfd006b810 0x7fdfd006dcd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdfe40b2800 0x7fdfe40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 --2- 172.21.15.32:0/2409851317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfe40af710 0x7fdfe40b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 >> 172.21.15.32:0/2409851317 conn(0x7fdfe40999f0 msgr2=0x7fdfe40ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 shutdown_connections 2024-02-17T00:36:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.675+0000 7fdfe930c640 1 -- 172.21.15.32:0/2409851317 wait complete. 2024-02-17T00:36:50.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:36:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.789+0000 7f924f455640 1 Processor -- start 2024-02-17T00:36:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.789+0000 7f924f455640 1 -- start start 2024-02-17T00:36:50.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924f455640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 0x7f92480b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924f455640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480b7ef0 con 0x7f92480d0780 2024-02-17T00:36:50.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924f455640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480b81d0 con 0x7f92480b68b0 2024-02-17T00:36:50.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924f455640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b84b0 con 0x7f92480d2c40 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924d1f1640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f92480d0780 0x7f92480d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32836/0 (socket says 172.21.15.32:32836) 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924d1f1640 1 -- 172.21.15.32:0/4119352949 learned_addr learned my addr 172.21.15.32:0/4119352949 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f924c9f0640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 0x7f92480b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005613542 0 0) 0x7f92480b7ef0 con 0x7f92480d0780 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.790+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9230003520 con 0x7f92480d0780 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335548877 0 0) 0x7f9230003520 con 0x7f92480d0780 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 msgr2=0x7f92480b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 0x7f92480b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 >> v1:172.21.15.39:6789/0 conn(0x7f92480b68b0 legacy=0x7f92480b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480b8790 con 0x7f92480d0780 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f92380019f0 con 0x7f92480d0780 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 >> v1:172.21.15.32:6789/0 conn(0x7f92480d0780 legacy=0x7f92480d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 0x7f92300039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230003ee0 0x7f92300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9230004d00 0x7f9230005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b84b0 con 0x7f9230004d00 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923000b9e0 con 0x7f9230003ee0 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923000bba0 con 0x7f92480d2c40 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d9f2640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9230004d00 0x7f9230005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d1f1640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 0x7f92300039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924c9f0640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230003ee0 0x7f92300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d9f2640 1 -- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 msgr2=0x7f92300039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d9f2640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92480d2c40 0x7f92300039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d9f2640 1 -- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230003ee0 msgr2=0x7f92300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d9f2640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230003ee0 0x7f92300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.791+0000 7f924d9f2640 1 -- 172.21.15.32:0/4119352949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230003520 con 0x7f9230004d00 2024-02-17T00:36:50.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.792+0000 7f924d9f2640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9230004d00 0x7f9230005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9240001860 tx=0x7f92300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07bbc5c752adc85 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.792+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240033410 con 0x7f9230004d00 2024-02-17T00:36:50.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.792+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240033590 con 0x7f9230004d00 2024-02-17T00:36:50.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.792+0000 7f9247fff640 1 -- 172.21.15.32:0/4119352949 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240033940 con 0x7f9230004d00 2024-02-17T00:36:50.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924f455640 1 -- 172.21.15.32:0/4119352949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9230004d00 msgr2=0x7f9230005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924f455640 1 --2- 172.21.15.32:0/4119352949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9230004d00 0x7f9230005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9240001860 tx=0x7f92300057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924d9f2640 1 -- 172.21.15.32:0/4119352949 reap_dead start 2024-02-17T00:36:50.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924f455640 1 -- 172.21.15.32:0/4119352949 shutdown_connections 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924f455640 1 -- 172.21.15.32:0/4119352949 >> 172.21.15.32:0/4119352949 conn(0x7f92480726b0 msgr2=0x7f9248072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924f455640 1 -- 172.21.15.32:0/4119352949 shutdown_connections 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.793+0000 7f924f455640 1 -- 172.21.15.32:0/4119352949 wait complete. 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.794+0000 7f924f455640 1 Processor -- start 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.794+0000 7f924f455640 1 -- start start 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 0x7f9248156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92481f7860 0x7f92480b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92480b48b0 0x7f9248154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b4d10 con 0x7f92480c8d80 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9248156960 con 0x7f92480b48b0 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9248156c40 con 0x7f92481f7860 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 0x7f9248156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 0x7f9248156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60484/0 (socket says 172.21.15.32:60484) 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 -- 172.21.15.32:0/4222169103 learned_addr learned my addr 172.21.15.32:0/4222169103 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d9f2640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92480b48b0 0x7f9248154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924c9f0640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92481f7860 0x7f92480b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 -- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92481f7860 msgr2=0x7f92480b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92481f7860 0x7f92480b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 -- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92480b48b0 msgr2=0x7f9248154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92480b48b0 0x7f9248154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 -- 172.21.15.32:0/4222169103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248156f20 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924c9f0640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92481f7860 0x7f92480b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d9f2640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92480b48b0 0x7f9248154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924d1f1640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 0x7f9248156380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f923800a590 tx=0x7f923800aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238013600 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238013780 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9248157200 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.795+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238013b30 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.796+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92481f7ce0 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.796+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9248157720 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.797+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9238013c90 con 0x7f92480c8d80 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.797+0000 7f9245ffb640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f923406b810 0x7f923406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:50.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.797+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f923808b730 con 0x7f92480c8d80 2024-02-17T00:36:50.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.797+0000 7f924c9f0640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f923406b810 0x7f923406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:50.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.798+0000 7f924c9f0640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f923406b810 0x7f923406dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92480d1190 tx=0x7f923c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:50.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.801+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9248157720 con 0x7f92480c8d80 2024-02-17T00:36:50.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.981+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9248157720 con 0x7f92480c8d80 2024-02-17T00:36:50.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.981+0000 7f9245ffb640 1 -- 172.21.15.32:0/4222169103 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9248157720 con 0x7f92480c8d80 2024-02-17T00:36:50.984 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f923406b810 msgr2=0x7f923406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f923406b810 0x7f923406dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92480d1190 tx=0x7f923c008040 comp rx=0 tx=0).stop 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 msgr2=0x7f9248156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 0x7f9248156380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f923800a590 tx=0x7f923800aa50 comp rx=0 tx=0).stop 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 shutdown_connections 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92480b48b0 0x7f9248154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f923406b810 0x7f923406dcd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f92481f7860 0x7f92480b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 --2- 172.21.15.32:0/4222169103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92480c8d80 0x7f9248156380 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 >> 172.21.15.32:0/4222169103 conn(0x7f92480726b0 msgr2=0x7f92480ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:50.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 shutdown_connections 2024-02-17T00:36:50.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:50.983+0000 7f924f455640 1 -- 172.21.15.32:0/4222169103 wait complete. 2024-02-17T00:36:50.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T00:36:51.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.096+0000 7fc05f440640 1 Processor -- start 2024-02-17T00:36:51.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.096+0000 7fc05f440640 1 -- start start 2024-02-17T00:36:51.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05f440640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0580b53b0 0x7fc0580d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:51.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05f440640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580d1e80 con 0x7fc05815db00 2024-02-17T00:36:51.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05f440640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580b5930 con 0x7fc0580d0a50 2024-02-17T00:36:51.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05f440640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580b5c10 con 0x7fc0580b53b0 2024-02-17T00:36:51.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05d1dc640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc05815db00 0x7fc0580d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32846/0 (socket says 172.21.15.32:32846) 2024-02-17T00:36:51.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05d1dc640 1 -- 172.21.15.32:0/609855736 learned_addr learned my addr 172.21.15.32:0/609855736 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05d9dd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0580b53b0 0x7fc0580d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc057fff640 1 -- 172.21.15.32:0/609855736 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947697268 0 0) 0x7fc0580d1e80 con 0x7fc05815db00 2024-02-17T00:36:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc057fff640 1 -- 172.21.15.32:0/609855736 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc040003520 con 0x7fc05815db00 2024-02-17T00:36:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05d9dd640 1 -- 172.21.15.32:0/609855736 >> v1:172.21.15.39:6789/0 conn(0x7fc0580d0a50 legacy=0x7fc0580d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05d9dd640 1 -- 172.21.15.32:0/609855736 >> v1:172.21.15.32:6789/0 conn(0x7fc05815db00 legacy=0x7fc0580d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.097+0000 7fc05d9dd640 1 -- 172.21.15.32:0/609855736 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580b5ef0 con 0x7fc0580b53b0 2024-02-17T00:36:51.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc05d9dd640 1 --2- 172.21.15.32:0/609855736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580b53b0 0x7fc0580d2a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0480097a0 tx=0x7fc04802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7691e2d6ed415904 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:51.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc057fff640 1 -- 172.21.15.32:0/609855736 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048031830 con 0x7fc0580b53b0 2024-02-17T00:36:51.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc057fff640 1 -- 172.21.15.32:0/609855736 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048031990 con 0x7fc0580b53b0 2024-02-17T00:36:51.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc057fff640 1 -- 172.21.15.32:0/609855736 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048031d20 con 0x7fc0580b53b0 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc05f440640 1 -- 172.21.15.32:0/609855736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580b53b0 msgr2=0x7fc0580d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc05f440640 1 --2- 172.21.15.32:0/609855736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580b53b0 0x7fc0580d2a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0480097a0 tx=0x7fc04802b8d0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc05f440640 1 -- 172.21.15.32:0/609855736 shutdown_connections 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc05f440640 1 --2- 172.21.15.32:0/609855736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580b53b0 0x7fc0580d2a40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.098+0000 7fc05f440640 1 -- 172.21.15.32:0/609855736 >> 172.21.15.32:0/609855736 conn(0x7fc058072290 msgr2=0x7fc0580726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.099+0000 7fc05f440640 1 -- 172.21.15.32:0/609855736 shutdown_connections 2024-02-17T00:36:51.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.099+0000 7fc05f440640 1 -- 172.21.15.32:0/609855736 wait complete. 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 Processor -- start 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 -- start start 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc0580b53b0 0x7fc0581521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 0x7fc0580c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc05815db00 0x7fc058156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581562a0 con 0x7fc0580d0a50 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc058160610 con 0x7fc05815db00 2024-02-17T00:36:51.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.100+0000 7fc05f440640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc058155690 con 0x7fc0580b53b0 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 0x7fc0580c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 0x7fc0580c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60504/0 (socket says 172.21.15.32:60504) 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 -- 172.21.15.32:0/674942554 learned_addr learned my addr 172.21.15.32:0/674942554 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05d9dd640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc05815db00 0x7fc058156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05d1dc640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc0580b53b0 0x7fc0581521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 -- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc0580b53b0 msgr2=0x7fc0581521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc0580b53b0 0x7fc0581521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 -- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc05815db00 msgr2=0x7fc058156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc05815db00 0x7fc058156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 -- 172.21.15.32:0/674942554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009400 con 0x7fc0580d0a50 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05d9dd640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc05815db00 0x7fc058156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05d1dc640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc0580b53b0 0x7fc0581521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05c9db640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 0x7fc0580c7e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c460 tx=0x7fc04c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c012830 con 0x7fc0580d0a50 2024-02-17T00:36:51.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c0129d0 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc058155970 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c012d80 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.101+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc058155f30 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.102+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058156450 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.103+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc04c01b400 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.103+0000 7fc055ffb640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc04406b810 0x7fc04406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.103+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc04c08a400 con 0x7fc0580d0a50 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.103+0000 7fc05d1dc640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc04406b810 0x7fc04406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:51.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.104+0000 7fc05d1dc640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc04406b810 0x7fc04406dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc050005c00 tx=0x7fc050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:51.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.107+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc04c054b70 con 0x7fc0580d0a50 2024-02-17T00:36:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.299+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc058068fd0 con 0x7fc0580d0a50 2024-02-17T00:36:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.299+0000 7fc055ffb640 1 -- 172.21.15.32:0/674942554 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc04c058230 con 0x7fc0580d0a50 2024-02-17T00:36:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T00:36:51.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc04406b810 msgr2=0x7fc04406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:51.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc04406b810 0x7fc04406dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc050005c00 tx=0x7fc050009040 comp rx=0 tx=0).stop 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 msgr2=0x7fc0580c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 0x7fc0580c7e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c460 tx=0x7fc04c00c920 comp rx=0 tx=0).stop 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 shutdown_connections 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc05815db00 0x7fc058156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0580d0a50 0x7fc0580c7e70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc04406b810 0x7fc04406dcd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 --2- 172.21.15.32:0/674942554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc0580b53b0 0x7fc0581521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 >> 172.21.15.32:0/674942554 conn(0x7fc058072290 msgr2=0x7fc0580d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 shutdown_connections 2024-02-17T00:36:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:51.301+0000 7fc05f440640 1 -- 172.21.15.32:0/674942554 wait complete. 2024-02-17T00:36:51.315 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-02-17T00:36:51.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:51.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-02-17T00:36:51.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[44113]: fuse finished with error 0 and tester_r 0 2024-02-17T00:36:51.342 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T00:36:57.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:36:57.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:36:57.444 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-02-17T00:36:57.467 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:57.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.612+0000 7f916a32c640 1 Processor -- start 2024-02-17T00:36:57.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.612+0000 7f916a32c640 1 -- start start 2024-02-17T00:36:57.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f916a32c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f916415dc60 0x7f91640b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f916a32c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91640b5a20 con 0x7f916406ab60 2024-02-17T00:36:57.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f916a32c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91640b0160 con 0x7f91640afc00 2024-02-17T00:36:57.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f916a32c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640b07e0 con 0x7f916415dc60 2024-02-17T00:36:57.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f91637fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f916415dc60 0x7f91640b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f9163fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f916406ab60 0x7f916406af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38606/0 (socket says 172.21.15.32:38606) 2024-02-17T00:36:57.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f9163fff640 1 -- 172.21.15.32:0/1492401465 learned_addr learned my addr 172.21.15.32:0/1492401465 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:57.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f91637fe640 1 -- 172.21.15.32:0/1492401465 >> v1:172.21.15.39:6789/0 conn(0x7f91640afc00 legacy=0x7f91640b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f91637fe640 1 -- 172.21.15.32:0/1492401465 >> v1:172.21.15.32:6789/0 conn(0x7f916406ab60 legacy=0x7f916406af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.613+0000 7f91637fe640 1 -- 172.21.15.32:0/1492401465 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640b1310 con 0x7f916415dc60 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.614+0000 7f91637fe640 1 --2- 172.21.15.32:0/1492401465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91640b1ba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f914c0097a0 tx=0x7f914c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd647e2f2bdc513 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.614+0000 7f9162ffd640 1 -- 172.21.15.32:0/1492401465 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c02e070 con 0x7f916415dc60 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.614+0000 7f9162ffd640 1 -- 172.21.15.32:0/1492401465 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c0315a0 con 0x7f916415dc60 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.614+0000 7f9162ffd640 1 -- 172.21.15.32:0/1492401465 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c031930 con 0x7f916415dc60 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 -- 172.21.15.32:0/1492401465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 msgr2=0x7f91640b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 --2- 172.21.15.32:0/1492401465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91640b1ba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f914c0097a0 tx=0x7f914c02b840 comp rx=0 tx=0).stop 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 -- 172.21.15.32:0/1492401465 shutdown_connections 2024-02-17T00:36:57.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 --2- 172.21.15.32:0/1492401465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91640b1ba0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 -- 172.21.15.32:0/1492401465 >> 172.21.15.32:0/1492401465 conn(0x7f91640b5c30 msgr2=0x7f91640999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:57.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 -- 172.21.15.32:0/1492401465 shutdown_connections 2024-02-17T00:36:57.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.615+0000 7f916a32c640 1 -- 172.21.15.32:0/1492401465 wait complete. 2024-02-17T00:36:57.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.616+0000 7f916a32c640 1 Processor -- start 2024-02-17T00:36:57.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.616+0000 7f916a32c640 1 -- start start 2024-02-17T00:36:57.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f916a32c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f916406ab60 0x7f9164159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f916a32c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f91640afc00 0x7f9164145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f916a32c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91641f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f916a32c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916415e040 con 0x7f916415dc60 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f916a32c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916415e320 con 0x7f916406ab60 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f916a32c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91641f43f0 con 0x7f91640afc00 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91641f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91641f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58404/0 (socket says 172.21.15.32:58404) 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 -- 172.21.15.32:0/584185721 learned_addr learned my addr 172.21.15.32:0/584185721 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91637fe640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f91640afc00 0x7f9164145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f9163fff640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f916406ab60 0x7f9164159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 -- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f91640afc00 msgr2=0x7f9164145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f91640afc00 0x7f9164145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 -- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f916406ab60 msgr2=0x7f9164159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f916406ab60 0x7f9164159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 -- 172.21.15.32:0/584185721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009400 con 0x7f916415dc60 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.617+0000 7f91688c9640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91641f3b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c7d0 tx=0x7f915c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.618+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c003b70 con 0x7f916415dc60 2024-02-17T00:36:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.618+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c003cf0 con 0x7f916415dc60 2024-02-17T00:36:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.618+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91641f46d0 con 0x7f916415dc60 2024-02-17T00:36:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.618+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c00aa90 con 0x7f916415dc60 2024-02-17T00:36:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.618+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9164146520 con 0x7f916415dc60 2024-02-17T00:36:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.619+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91641f4bf0 con 0x7f916415dc60 2024-02-17T00:36:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.619+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f915c00abf0 con 0x7f916415dc60 2024-02-17T00:36:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.619+0000 7f9160ff9640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f914406b810 0x7f914406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.620+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f915c08a1f0 con 0x7f916415dc60 2024-02-17T00:36:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.620+0000 7f9163fff640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f914406b810 0x7f914406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.620+0000 7f9163fff640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f914406b810 0x7f914406dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9154005880 tx=0x7f9154009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:57.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.624+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f915c054980 con 0x7f916415dc60 2024-02-17T00:36:57.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.806+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9164068fd0 con 0x7f916415dc60 2024-02-17T00:36:57.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.807+0000 7f9160ff9640 1 -- 172.21.15.32:0/584185721 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f915c003e60 con 0x7f916415dc60 2024-02-17T00:36:57.811 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:57.811 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f914406b810 msgr2=0x7f914406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f914406b810 0x7f914406dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9154005880 tx=0x7f9154009040 comp rx=0 tx=0).stop 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 msgr2=0x7f91641f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91641f3b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c7d0 tx=0x7f915c00cc90 comp rx=0 tx=0).stop 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 shutdown_connections 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f916415dc60 0x7f91641f3b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f914406b810 0x7f914406dcd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f91640afc00 0x7f9164145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 --2- 172.21.15.32:0/584185721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f916406ab60 0x7f9164159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 >> 172.21.15.32:0/584185721 conn(0x7f91640b5c30 msgr2=0x7f916415cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:57.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 shutdown_connections 2024-02-17T00:36:57.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.809+0000 7f916a32c640 1 -- 172.21.15.32:0/584185721 wait complete. 2024-02-17T00:36:57.824 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:36:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.921+0000 7fdcddbbc640 1 Processor -- start 2024-02-17T00:36:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.921+0000 7fdcddbbc640 1 -- start start 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcddbbc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdcd80d0a50 0x7fdcd80d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcddbbc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd80d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcddbbc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd80d1e80 con 0x7fdcd815db00 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcddbbc640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd80b5930 con 0x7fdcd80d0a50 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcddbbc640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80b5c10 con 0x7fdcd80b53b0 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcd6ffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdcd80d0a50 0x7fdcd80d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcd6ffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdcd80d0a50 0x7fdcd80d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58410/0 (socket says 172.21.15.32:58410) 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcd6ffd640 1 -- 172.21.15.32:0/3986177876 learned_addr learned my addr 172.21.15.32:0/3986177876 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.922+0000 7fdcd7fff640 1 --2- 172.21.15.32:0/3986177876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd80d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd6ffd640 1 -- 172.21.15.32:0/3986177876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 msgr2=0x7fdcd80d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd6ffd640 1 --2- 172.21.15.32:0/3986177876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd80d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd6ffd640 1 -- 172.21.15.32:0/3986177876 >> v1:172.21.15.39:6789/0 conn(0x7fdcd815db00 legacy=0x7fdcd80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd6ffd640 1 -- 172.21.15.32:0/3986177876 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80b5ef0 con 0x7fdcd80d0a50 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd6ffd640 1 --2- 172.21.15.32:0/3986177876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd80d0a50 0x7fdcd80d2330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009870 tx=0x7fdccc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b3988a96fbafb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd67fc640 1 -- 172.21.15.32:0/3986177876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc030840 con 0x7fdcd80d0a50 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd67fc640 1 -- 172.21.15.32:0/3986177876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc0309a0 con 0x7fdcd80d0a50 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.923+0000 7fdcd67fc640 1 -- 172.21.15.32:0/3986177876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc030d30 con 0x7fdcd80d0a50 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 -- 172.21.15.32:0/3986177876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd80d0a50 msgr2=0x7fdcd80d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/3986177876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd80d0a50 0x7fdcd80d2330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009870 tx=0x7fdccc02b980 comp rx=0 tx=0).stop 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 -- 172.21.15.32:0/3986177876 shutdown_connections 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/3986177876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd80d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/3986177876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd80d0a50 0x7fdcd80d2330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 -- 172.21.15.32:0/3986177876 >> 172.21.15.32:0/3986177876 conn(0x7fdcd8072290 msgr2=0x7fdcd80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:57.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 -- 172.21.15.32:0/3986177876 shutdown_connections 2024-02-17T00:36:57.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.924+0000 7fdcddbbc640 1 -- 172.21.15.32:0/3986177876 wait complete. 2024-02-17T00:36:57.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.925+0000 7fdcddbbc640 1 Processor -- start 2024-02-17T00:36:57.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.925+0000 7fdcddbbc640 1 -- start start 2024-02-17T00:36:57.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcddbbc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcddbbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcd80d0a50 0x7fdcd81496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcddbbc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 0x7fdcd80c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcddbbc640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80c85f0 con 0x7fdcd815db00 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcddbbc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8159710 con 0x7fdcd80d0a50 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcddbbc640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81599f0 con 0x7fdcd80b53b0 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcd7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 0x7fdcd80c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcd7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 0x7fdcd80c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58420/0 (socket says 172.21.15.32:58420) 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcd7fff640 1 -- 172.21.15.32:0/21549284 learned_addr learned my addr 172.21.15.32:0/21549284 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcd6ffd640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcd80d0a50 0x7fdcd81496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.926+0000 7fdcd77fe640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd7fff640 1 -- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 msgr2=0x7fdcd814deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd7fff640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd814deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd7fff640 1 -- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcd80d0a50 msgr2=0x7fdcd81496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd7fff640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcd80d0a50 0x7fdcd81496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:57.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd7fff640 1 -- 172.21.15.32:0/21549284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0094d0 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd6ffd640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcd80d0a50 0x7fdcd81496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcd7fff640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 0x7fdcd80c9c00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000efc0 tx=0x7fdcd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0009ca0 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd8159cd0 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00146c0 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.927+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd80ca140 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.928+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd8068fd0 con 0x7fdcd815db00 2024-02-17T00:36:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.928+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdcd0014820 con 0x7fdcd815db00 2024-02-17T00:36:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.929+0000 7fdcbffff640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdcc406b810 0x7fdcc406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.929+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdcd008b320 con 0x7fdcd815db00 2024-02-17T00:36:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.929+0000 7fdcd77fe640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdcc406b810 0x7fdcc406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.929+0000 7fdcd77fe640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdcc406b810 0x7fdcc406dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdcd814a890 tx=0x7fdcc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:57.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:57.933+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdcd0055ab0 con 0x7fdcd815db00 2024-02-17T00:36:58.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.117+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd80c8730 con 0x7fdcd815db00 2024-02-17T00:36:58.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.118+0000 7fdcbffff640 1 -- 172.21.15.32:0/21549284 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7fdcd0059170 con 0x7fdcd815db00 2024-02-17T00:36:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:36:58.121 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:36:58.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdcc406b810 msgr2=0x7fdcc406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:58.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdcc406b810 0x7fdcc406dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdcd814a890 tx=0x7fdcc8009040 comp rx=0 tx=0).stop 2024-02-17T00:36:58.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 msgr2=0x7fdcd80c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:58.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 0x7fdcd80c9c00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000efc0 tx=0x7fdcd000c490 comp rx=0 tx=0).stop 2024-02-17T00:36:58.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 shutdown_connections 2024-02-17T00:36:58.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd815db00 0x7fdcd80c9c00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcd80d0a50 0x7fdcd81496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdcc406b810 0x7fdcc406dcd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 --2- 172.21.15.32:0/21549284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdcd80b53b0 0x7fdcd814deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 >> 172.21.15.32:0/21549284 conn(0x7fdcd8072290 msgr2=0x7fdcd815c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:58.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 shutdown_connections 2024-02-17T00:36:58.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.120+0000 7fdcddbbc640 1 -- 172.21.15.32:0/21549284 wait complete. 2024-02-17T00:36:58.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T00:36:58.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.235+0000 7fa81e3c7640 1 Processor -- start 2024-02-17T00:36:58.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.235+0000 7fa81e3c7640 1 -- start start 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81e3c7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180d0780 0x7fa8180d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81e3c7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8180b9590 0x7fa8180b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81e3c7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180d10a0 con 0x7fa8180b9130 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81e3c7640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180b7ef0 con 0x7fa8180b9590 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81e3c7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180b81d0 con 0x7fa8180d0780 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8180b9590 0x7fa8180b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8180b9590 0x7fa8180b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58422/0 (socket says 172.21.15.32:58422) 2024-02-17T00:36:58.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 -- 172.21.15.32:0/784443093 learned_addr learned my addr 172.21.15.32:0/784443093 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa817fff640 1 --2- 172.21.15.32:0/784443093 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180d0780 0x7fa8180d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 -- 172.21.15.32:0/784443093 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180d0780 msgr2=0x7fa8180d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 --2- 172.21.15.32:0/784443093 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180d0780 0x7fa8180d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 -- 172.21.15.32:0/784443093 >> v1:172.21.15.39:6789/0 conn(0x7fa8180b9130 legacy=0x7fa8180d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.236+0000 7fa81c964640 1 -- 172.21.15.32:0/784443093 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180b84b0 con 0x7fa8180b9590 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.237+0000 7fa81c964640 1 --2- 172.21.15.32:0/784443093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180b78c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa810009e50 tx=0x7fa81002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fa721162c600e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.237+0000 7fa816ffd640 1 -- 172.21.15.32:0/784443093 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81002ca70 con 0x7fa8180b9590 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.237+0000 7fa816ffd640 1 -- 172.21.15.32:0/784443093 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81002cbd0 con 0x7fa8180b9590 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.237+0000 7fa816ffd640 1 -- 172.21.15.32:0/784443093 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100343f0 con 0x7fa8180b9590 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 -- 172.21.15.32:0/784443093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 msgr2=0x7fa8180b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/784443093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180b78c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa810009e50 tx=0x7fa81002bed0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 -- 172.21.15.32:0/784443093 shutdown_connections 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/784443093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180b78c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/784443093 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180d0780 0x7fa8180d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 -- 172.21.15.32:0/784443093 >> 172.21.15.32:0/784443093 conn(0x7fa8180726b0 msgr2=0x7fa818072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:58.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 -- 172.21.15.32:0/784443093 shutdown_connections 2024-02-17T00:36:58.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.238+0000 7fa81e3c7640 1 -- 172.21.15.32:0/784443093 wait complete. 2024-02-17T00:36:58.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.239+0000 7fa81e3c7640 1 Processor -- start 2024-02-17T00:36:58.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.239+0000 7fa81e3c7640 1 -- start start 2024-02-17T00:36:58.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180b9130 0x7fa8180cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:58.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8180d0780 0x7fa81815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180ab070 con 0x7fa8180b9590 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81815d360 con 0x7fa8180d0780 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180cb9a0 con 0x7fa8180b9130 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58434/0 (socket says 172.21.15.32:58434) 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 -- 172.21.15.32:0/2640300038 learned_addr learned my addr 172.21.15.32:0/2640300038 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81c964640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8180d0780 0x7fa81815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa817fff640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180b9130 0x7fa8180cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 -- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180b9130 msgr2=0x7fa8180cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180b9130 0x7fa8180cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 -- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8180d0780 msgr2=0x7fa81815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:58.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8180d0780 0x7fa81815bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 -- 172.21.15.32:0/2640300038 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810009b30 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa8177fe640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180aa480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c430 tx=0x7fa80800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808011790 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080118f0 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8180cbc80 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.240+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808011ce0 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.241+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8180cc240 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.241+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8180685d0 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.242+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa80801c460 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.242+0000 7fa814ff9640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa80406b810 0x7fa80406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.242+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa80808a340 con 0x7fa8180b9590 2024-02-17T00:36:58.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.243+0000 7fa817fff640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa80406b810 0x7fa80406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:58.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.243+0000 7fa817fff640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa80406b810 0x7fa80406dcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0079a0 tx=0x7fa80c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:58.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.247+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa808054ad0 con 0x7fa8180b9590 2024-02-17T00:36:58.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:58.464+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa818067420 con 0x7fa8180b9590 2024-02-17T00:36:59.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.120+0000 7fa814ff9640 1 -- 172.21.15.32:0/2640300038 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa808058190 con 0x7fa8180b9590 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa80406b810 msgr2=0x7fa80406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa80406b810 0x7fa80406dcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0079a0 tx=0x7fa80c008040 comp rx=0 tx=0).stop 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 msgr2=0x7fa8180aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180aa480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c430 tx=0x7fa80800c8f0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 shutdown_connections 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8180d0780 0x7fa81815bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8180b9590 0x7fa8180aa480 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa80406b810 0x7fa80406dcd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 --2- 172.21.15.32:0/2640300038 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8180b9130 0x7fa8180cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 >> 172.21.15.32:0/2640300038 conn(0x7fa8180726b0 msgr2=0x7fa8180b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 shutdown_connections 2024-02-17T00:36:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.122+0000 7fa81e3c7640 1 -- 172.21.15.32:0/2640300038 wait complete. 2024-02-17T00:36:59.139 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-02-17T00:36:59.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T00:36:59.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.246+0000 7f5d95f2e640 1 Processor -- start 2024-02-17T00:36:59.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.246+0000 7f5d95f2e640 1 -- start start 2024-02-17T00:36:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.247+0000 7f5d95f2e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 0x7f5d90166120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.247+0000 7f5d95f2e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d900b25e0 con 0x7f5d900cfc40 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.247+0000 7f5d95f2e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9015bec0 con 0x7f5d900b1480 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.247+0000 7f5d95f2e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b19d0 con 0x7f5d900cd590 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.247+0000 7f5d8f7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5d900cfc40 0x7f5d900d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38618/0 (socket says 172.21.15.32:38618) 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.247+0000 7f5d8f7fe640 1 -- 172.21.15.32:0/2154379194 learned_addr learned my addr 172.21.15.32:0/2154379194 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8ffff640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 0x7f5d90166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417684697 0 0) 0x7f5d900b25e0 con 0x7f5d900cfc40 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d78003520 con 0x7f5d900cfc40 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155596697 0 0) 0x7f5d9015bec0 con 0x7f5d900b1480 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d900b25e0 con 0x7f5d900b1480 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732945940 0 0) 0x7f5d78003520 con 0x7f5d900cfc40 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 msgr2=0x7f5d90166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 0x7f5d90166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 >> v1:172.21.15.39:6789/0 conn(0x7f5d900b1480 legacy=0x7f5d900b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d900b1cb0 con 0x7f5d900cfc40 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f5d80001670 con 0x7f5d900cfc40 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 >> v1:172.21.15.32:6789/0 conn(0x7f5d900cfc40 legacy=0x7f5d900d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 0x7f5d78003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d780040e0 0x7f5d780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d78004d00 0x7f5d78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b19d0 con 0x7f5d78004d00 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7800bb40 con 0x7f5d780040e0 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7800bd00 con 0x7f5d900cd590 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8ffff640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d78004d00 0x7f5d78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8f7fe640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 0x7f5d78003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8effd640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d780040e0 0x7f5d780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8ffff640 1 -- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 msgr2=0x7f5d78003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8ffff640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900cd590 0x7f5d78003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8ffff640 1 -- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d780040e0 msgr2=0x7f5d780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.248+0000 7f5d8ffff640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d780040e0 0x7f5d780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.249+0000 7f5d8ffff640 1 -- 172.21.15.32:0/2154379194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d78003520 con 0x7f5d78004d00 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.249+0000 7f5d8ffff640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d78004d00 0x7f5d78005180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009f90 tx=0x7f5d780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a1c2fbb18b64d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.249+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8802cbd0 con 0x7f5d78004d00 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.249+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800f040 con 0x7f5d78004d00 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.249+0000 7f5d8e7fc640 1 -- 172.21.15.32:0/2154379194 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88034440 con 0x7f5d78004d00 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d95f2e640 1 -- 172.21.15.32:0/2154379194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d78004d00 msgr2=0x7f5d78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/2154379194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d78004d00 0x7f5d78005180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009f90 tx=0x7f5d780057f0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d8ffff640 1 -- 172.21.15.32:0/2154379194 reap_dead start 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d95f2e640 1 -- 172.21.15.32:0/2154379194 shutdown_connections 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d95f2e640 1 -- 172.21.15.32:0/2154379194 >> 172.21.15.32:0/2154379194 conn(0x7f5d9008af80 msgr2=0x7f5d9008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d95f2e640 1 -- 172.21.15.32:0/2154379194 shutdown_connections 2024-02-17T00:36:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.250+0000 7f5d95f2e640 1 -- 172.21.15.32:0/2154379194 wait complete. 2024-02-17T00:36:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.251+0000 7f5d95f2e640 1 Processor -- start 2024-02-17T00:36:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.251+0000 7f5d95f2e640 1 -- start start 2024-02-17T00:36:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d95f2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d90155df0 0x7f5d90162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d95f2e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 0x7f5d900c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d95f2e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900ca740 0x7f5d900caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d95f2e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901631c0 con 0x7f5d9006bc70 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d95f2e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900c6640 con 0x7f5d90155df0 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d95f2e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900cb0e0 con 0x7f5d900ca740 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d8effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 0x7f5d900c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d8effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 0x7f5d900c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58452/0 (socket says 172.21.15.32:58452) 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d8effd640 1 -- 172.21.15.32:0/3700992100 learned_addr learned my addr 172.21.15.32:0/3700992100 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d8f7fe640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d90155df0 0x7f5d90162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.252+0000 7f5d8ffff640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900ca740 0x7f5d900caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d8effd640 1 -- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900ca740 msgr2=0x7f5d900caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d8effd640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900ca740 0x7f5d900caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d8effd640 1 -- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d90155df0 msgr2=0x7f5d90162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d8effd640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d90155df0 0x7f5d90162c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d8effd640 1 -- 172.21.15.32:0/3700992100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9006cc60 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d8effd640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 0x7f5d900c6100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400f910 tx=0x7f5d8400fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84001560 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840052e0 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9006c3c0 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400d970 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.253+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9006c980 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.254+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d900cf650 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.254+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5d8400dad0 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.255+0000 7f5d77fff640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d7c06b840 0x7f5d7c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.255+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5d8408a5b0 con 0x7f5d9006bc70 2024-02-17T00:36:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.255+0000 7f5d8f7fe640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d7c06b840 0x7f5d7c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:36:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.256+0000 7f5d8f7fe640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d7c06b840 0x7f5d7c06dd00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004840 tx=0x7f5d80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:36:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.259+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d84054d20 con 0x7f5d9006bc70 2024-02-17T00:36:59.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:36:59.477+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d90067c90 con 0x7f5d9006bc70 2024-02-17T00:37:00.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.131+0000 7f5d77fff640 1 -- 172.21.15.32:0/3700992100 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d840583e0 con 0x7f5d9006bc70 2024-02-17T00:37:00.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d7c06b840 msgr2=0x7f5d7c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d7c06b840 0x7f5d7c06dd00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004840 tx=0x7f5d80009040 comp rx=0 tx=0).stop 2024-02-17T00:37:00.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 msgr2=0x7f5d900c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 0x7f5d900c6100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400f910 tx=0x7f5d8400fdd0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 shutdown_connections 2024-02-17T00:37:00.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d7c06b840 0x7f5d7c06dd00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d900ca740 0x7f5d900caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d9006bc70 0x7f5d900c6100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 --2- 172.21.15.32:0/3700992100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d90155df0 0x7f5d90162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 >> 172.21.15.32:0/3700992100 conn(0x7f5d9008af80 msgr2=0x7f5d900d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:00.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 shutdown_connections 2024-02-17T00:37:00.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.134+0000 7f5d95f2e640 1 -- 172.21.15.32:0/3700992100 wait complete. 2024-02-17T00:37:00.150 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T00:37:00.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:00.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.255+0000 7f1b35fe2640 1 Processor -- start 2024-02-17T00:37:00.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.255+0000 7f1b35fe2640 1 -- start start 2024-02-17T00:37:00.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.255+0000 7f1b35fe2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 0x7f1b300ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.255+0000 7f1b35fe2640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b300d1de0 con 0x7f1b3015dd00 2024-02-17T00:37:00.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.255+0000 7f1b35fe2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b30162560 con 0x7f1b3015d920 2024-02-17T00:37:00.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.255+0000 7f1b35fe2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30161d40 con 0x7f1b300b9250 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2ffff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1b3015dd00 0x7f1b300d2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38632/0 (socket says 172.21.15.32:38632) 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2ffff640 1 -- 172.21.15.32:0/2261889412 learned_addr learned my addr 172.21.15.32:0/2261889412 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2effd640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 0x7f1b300ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483829121 0 0) 0x7f1b300d1de0 con 0x7f1b3015dd00 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b18003520 con 0x7f1b3015dd00 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 514951083 0 0) 0x7f1b18003520 con 0x7f1b3015dd00 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 msgr2=0x7f1b300ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 0x7f1b300ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 >> v1:172.21.15.39:6789/0 conn(0x7f1b3015d920 legacy=0x7f1b30161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30161fa0 con 0x7f1b3015dd00 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f1b280019f0 con 0x7f1b3015dd00 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 >> v1:172.21.15.32:6789/0 conn(0x7f1b3015dd00 legacy=0x7f1b300d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b180039a0 0x7f1b18003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b18004350 0x7f1b18004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 0x7f1b18005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30161d40 con 0x7f1b18004350 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1800ba30 con 0x7f1b180039a0 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1800bbf0 con 0x7f1b300b9250 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2effd640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b18004350 0x7f1b18004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2f7fe640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b180039a0 0x7f1b18003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.256+0000 7f1b2ffff640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 0x7f1b18005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2effd640 1 -- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 msgr2=0x7f1b18005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2effd640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300b9250 0x7f1b18005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2effd640 1 -- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b180039a0 msgr2=0x7f1b18003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2effd640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b180039a0 0x7f1b18003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2effd640 1 -- 172.21.15.32:0/2261889412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18003520 con 0x7f1b18004350 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2effd640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b18004350 0x7f1b18004820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009a90 tx=0x7f1b180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e548ac00786052 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2402c680 con 0x7f1b18004350 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2402c7e0 con 0x7f1b18004350 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.257+0000 7f1b2e7fc640 1 -- 172.21.15.32:0/2261889412 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2402cb90 con 0x7f1b18004350 2024-02-17T00:37:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b35fe2640 1 -- 172.21.15.32:0/2261889412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b18004350 msgr2=0x7f1b18004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/2261889412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b18004350 0x7f1b18004820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009a90 tx=0x7f1b180057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b2ffff640 1 -- 172.21.15.32:0/2261889412 reap_dead start 2024-02-17T00:37:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b35fe2640 1 -- 172.21.15.32:0/2261889412 shutdown_connections 2024-02-17T00:37:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b35fe2640 1 -- 172.21.15.32:0/2261889412 >> 172.21.15.32:0/2261889412 conn(0x7f1b3006bfe0 msgr2=0x7f1b3006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b35fe2640 1 -- 172.21.15.32:0/2261889412 shutdown_connections 2024-02-17T00:37:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.258+0000 7f1b35fe2640 1 -- 172.21.15.32:0/2261889412 wait complete. 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.259+0000 7f1b35fe2640 1 Processor -- start 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.259+0000 7f1b35fe2640 1 -- start start 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b35fe2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b18004350 0x7f1b30154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b35fe2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 0x7f1b30151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b35fe2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300cc3a0 0x7f1b300cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b35fe2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300ccd40 con 0x7f1b3015c940 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b35fe2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300cb330 con 0x7f1b18004350 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b35fe2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300cb580 con 0x7f1b300cc3a0 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 0x7f1b30151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 0x7f1b30151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58480/0 (socket says 172.21.15.32:58480) 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b2effd640 1 -- 172.21.15.32:0/3033500220 learned_addr learned my addr 172.21.15.32:0/3033500220 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:00.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b2f7fe640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b18004350 0x7f1b30154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.260+0000 7f1b2ffff640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300cc3a0 0x7f1b300cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2effd640 1 -- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300cc3a0 msgr2=0x7f1b300cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2effd640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300cc3a0 0x7f1b300cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2effd640 1 -- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b18004350 msgr2=0x7f1b30154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2effd640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b18004350 0x7f1b30154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2effd640 1 -- 172.21.15.32:0/3033500220 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300cb860 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2ffff640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300cc3a0 0x7f1b300cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b2effd640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 0x7f1b30151b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009bb0 tx=0x7f1b24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24034990 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24034af0 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b300cbb40 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24034e80 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.261+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b30152050 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.262+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b30068fd0 con 0x7f1b3015c940 2024-02-17T00:37:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.262+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1b24040450 con 0x7f1b3015c940 2024-02-17T00:37:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.263+0000 7f1b17fff640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b1c06b810 0x7f1b1c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.263+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1b240ac600 con 0x7f1b3015c940 2024-02-17T00:37:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.263+0000 7f1b2f7fe640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b1c06b810 0x7f1b1c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.263+0000 7f1b2f7fe640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b1c06b810 0x7f1b1c06dcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b20001910 tx=0x7f1b20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.267+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b24076e20 con 0x7f1b3015c940 2024-02-17T00:37:00.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.485+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b301527b0 con 0x7f1b3015c940 2024-02-17T00:37:00.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.485+0000 7f1b17fff640 1 -- 172.21.15.32:0/3033500220 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f1b2407a4e0 con 0x7f1b3015c940 2024-02-17T00:37:00.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:00.489 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:00.489 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:00.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b1c06b810 msgr2=0x7f1b1c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b1c06b810 0x7f1b1c06dcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b20001910 tx=0x7f1b20009040 comp rx=0 tx=0).stop 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 msgr2=0x7f1b30151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 0x7f1b30151b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009bb0 tx=0x7f1b24004730 comp rx=0 tx=0).stop 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 shutdown_connections 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b1c06b810 0x7f1b1c06dcd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b300cc3a0 0x7f1b300cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b3015c940 0x7f1b30151b10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 --2- 172.21.15.32:0/3033500220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b18004350 0x7f1b30154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 >> 172.21.15.32:0/3033500220 conn(0x7f1b3006bfe0 msgr2=0x7f1b3015e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 shutdown_connections 2024-02-17T00:37:00.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.487+0000 7f1b35fe2640 1 -- 172.21.15.32:0/3033500220 wait complete. 2024-02-17T00:37:00.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:00.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 Processor -- start 2024-02-17T00:37:00.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 -- start start 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f926015dd00 0x7f92600b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92600b6a40 0x7f92600b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926006bfb0 0x7f926006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926015e0e0 con 0x7f926015dd00 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926006cfe0 con 0x7f92600b6a40 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.600+0000 7f9265888640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926006cd00 con 0x7f926006bfb0 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f926015dd00 0x7f92600b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f926015dd00 0x7f92600b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58488/0 (socket says 172.21.15.32:58488) 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 -- 172.21.15.32:0/2372101804 learned_addr learned my addr 172.21.15.32:0/2372101804 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:00.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925e7fc640 1 --2- 172.21.15.32:0/2372101804 >> v2:172.21.15.39:3300/0 conn(0x7f92600b6a40 0x7f92600b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925f7fe640 1 --2- 172.21.15.32:0/2372101804 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926006bfb0 0x7f926006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 -- 172.21.15.32:0/2372101804 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926006bfb0 msgr2=0x7f926006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 --2- 172.21.15.32:0/2372101804 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926006bfb0 0x7f926006c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 -- 172.21.15.32:0/2372101804 >> v2:172.21.15.39:3300/0 conn(0x7f92600b6a40 msgr2=0x7f92600b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 --2- 172.21.15.32:0/2372101804 >> v2:172.21.15.39:3300/0 conn(0x7f92600b6a40 0x7f92600b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.601+0000 7f925effd640 1 -- 172.21.15.32:0/2372101804 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600d1ca0 con 0x7f926015dd00 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f925effd640 1 --2- 172.21.15.32:0/2372101804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f926015dd00 0x7f92600b5750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f926008c540 tx=0x7f925002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3759055b0d79d960 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f925dffb640 1 -- 172.21.15.32:0/2372101804 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250030860 con 0x7f926015dd00 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f925dffb640 1 -- 172.21.15.32:0/2372101804 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500309c0 con 0x7f926015dd00 2024-02-17T00:37:00.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f925dffb640 1 -- 172.21.15.32:0/2372101804 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250030d50 con 0x7f926015dd00 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 -- 172.21.15.32:0/2372101804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f926015dd00 msgr2=0x7f92600b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 --2- 172.21.15.32:0/2372101804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f926015dd00 0x7f92600b5750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f926008c540 tx=0x7f925002b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 -- 172.21.15.32:0/2372101804 shutdown_connections 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 --2- 172.21.15.32:0/2372101804 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926006bfb0 0x7f926006c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 --2- 172.21.15.32:0/2372101804 >> v2:172.21.15.39:3300/0 conn(0x7f92600b6a40 0x7f92600b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 --2- 172.21.15.32:0/2372101804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f926015dd00 0x7f92600b5750 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 -- 172.21.15.32:0/2372101804 >> 172.21.15.32:0/2372101804 conn(0x7f92600d07b0 msgr2=0x7f92600d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 -- 172.21.15.32:0/2372101804 shutdown_connections 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.602+0000 7f9265888640 1 -- 172.21.15.32:0/2372101804 wait complete. 2024-02-17T00:37:00.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 Processor -- start 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 -- start start 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f926006bfb0 0x7f92600c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 0x7f92601f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926015dd00 0x7f926014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601f3f20 con 0x7f92600b6a40 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601f49d0 con 0x7f926006bfb0 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.604+0000 7f9265888640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926015f630 con 0x7f926015dd00 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 0x7f92601f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 0x7f92601f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58498/0 (socket says 172.21.15.32:58498) 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 -- 172.21.15.32:0/1676968864 learned_addr learned my addr 172.21.15.32:0/1676968864 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925f7fe640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926015dd00 0x7f926014aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925effd640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f926006bfb0 0x7f92600c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 -- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926015dd00 msgr2=0x7f926014aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926015dd00 0x7f926014aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 -- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f926006bfb0 msgr2=0x7f92600c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f926006bfb0 0x7f92600c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 -- 172.21.15.32:0/1676968864 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500094d0 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925effd640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f926006bfb0 0x7f92600c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f925e7fc640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 0x7f92601f39e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f925400d830 tx=0x7f925400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400b6c0 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925400b820 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926014af50 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400bbb0 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.605+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92601f4410 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.606+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926015f400 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.606+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f925400bd10 con 0x7f92600b6a40 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.607+0000 7f9247fff640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f924c06b840 0x7f924c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.607+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f925408a9e0 con 0x7f92600b6a40 2024-02-17T00:37:00.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.607+0000 7f925effd640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f924c06b840 0x7f924c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.607+0000 7f925effd640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f924c06b840 0x7f924c06dd00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9250036000 tx=0x7f925003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.611+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f926015f400 con 0x7f92600b6a40 2024-02-17T00:37:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.793+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f926015f400 con 0x7f92600b6a40 2024-02-17T00:37:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.794+0000 7f9247fff640 1 -- 172.21.15.32:0/1676968864 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f926015f400 con 0x7f92600b6a40 2024-02-17T00:37:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:00.798 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f924c06b840 msgr2=0x7f924c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f924c06b840 0x7f924c06dd00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9250036000 tx=0x7f925003b040 comp rx=0 tx=0).stop 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 msgr2=0x7f92601f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 0x7f92601f39e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f925400d830 tx=0x7f925400dcf0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 shutdown_connections 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f924c06b840 0x7f924c06dd00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f926015dd00 0x7f926014aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92600b6a40 0x7f92601f39e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 --2- 172.21.15.32:0/1676968864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f926006bfb0 0x7f92600c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 >> 172.21.15.32:0/1676968864 conn(0x7f92600d07b0 msgr2=0x7f92600b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 shutdown_connections 2024-02-17T00:37:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.796+0000 7f9265888640 1 -- 172.21.15.32:0/1676968864 wait complete. 2024-02-17T00:37:00.810 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T00:37:00.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:00.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.908+0000 7fcc348df640 1 Processor -- start 2024-02-17T00:37:00.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.908+0000 7fcc348df640 1 -- start start 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.909+0000 7fcc348df640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc30071380 0x7fcc300ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.909+0000 7fcc348df640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc301450a0 con 0x7fcc30144610 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.909+0000 7fcc348df640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc300ce870 con 0x7fcc30145270 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.909+0000 7fcc348df640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc300cf240 con 0x7fcc30071380 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2dd9b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc30071380 0x7fcc300ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2e59c640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcc30144610 0x7fcc30070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38642/0 (socket says 172.21.15.32:38642) 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2e59c640 1 -- 172.21.15.32:0/2576118074 learned_addr learned my addr 172.21.15.32:0/2576118074 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2dd9b640 1 -- 172.21.15.32:0/2576118074 >> v1:172.21.15.39:6789/0 conn(0x7fcc30145270 legacy=0x7fcc300b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2dd9b640 1 -- 172.21.15.32:0/2576118074 >> v1:172.21.15.32:6789/0 conn(0x7fcc30144610 legacy=0x7fcc30070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2dd9b640 1 -- 172.21.15.32:0/2576118074 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30144dc0 con 0x7fcc30071380 2024-02-17T00:37:00.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.910+0000 7fcc2d59a640 1 -- 172.21.15.32:0/2576118074 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844159973 0 0) 0x7fcc301450a0 con 0x7fcc30144610 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc2dd9b640 1 --2- 172.21.15.32:0/2576118074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc300ced00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097a0 tx=0x7fcc1802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1382b4d58679dd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc2d59a640 1 -- 172.21.15.32:0/2576118074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18030610 con 0x7fcc30071380 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc2d59a640 1 -- 172.21.15.32:0/2576118074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc18030770 con 0x7fcc30071380 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc2d59a640 1 -- 172.21.15.32:0/2576118074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18030b00 con 0x7fcc30071380 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 -- 172.21.15.32:0/2576118074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 msgr2=0x7fcc300ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 --2- 172.21.15.32:0/2576118074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc300ced00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097a0 tx=0x7fcc1802b960 comp rx=0 tx=0).stop 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 -- 172.21.15.32:0/2576118074 shutdown_connections 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 --2- 172.21.15.32:0/2576118074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc300ced00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 -- 172.21.15.32:0/2576118074 >> 172.21.15.32:0/2576118074 conn(0x7fcc300b3390 msgr2=0x7fcc300b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 -- 172.21.15.32:0/2576118074 shutdown_connections 2024-02-17T00:37:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.911+0000 7fcc348df640 1 -- 172.21.15.32:0/2576118074 wait complete. 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 Processor -- start 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 -- start start 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc3013ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc30144610 0x7fcc301e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc30145270 0x7fcc301e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300ccf80 con 0x7fcc30071380 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300cc300 con 0x7fcc30145270 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc348df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300cc5e0 con 0x7fcc30144610 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc2e59c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc3013ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc2e59c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc3013ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58518/0 (socket says 172.21.15.32:58518) 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.913+0000 7fcc2e59c640 1 -- 172.21.15.32:0/4258757753 learned_addr learned my addr 172.21.15.32:0/4258757753 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2ed9d640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc30145270 0x7fcc301e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2dd9b640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc30144610 0x7fcc301e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2e59c640 1 -- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc30144610 msgr2=0x7fcc301e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2e59c640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc30144610 0x7fcc301e4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2e59c640 1 -- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc30145270 msgr2=0x7fcc301e51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2e59c640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc30145270 0x7fcc301e51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2e59c640 1 -- 172.21.15.32:0/4258757753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009400 con 0x7fcc30071380 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2dd9b640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc30144610 0x7fcc301e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc2e59c640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc3013ffa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c8c0 tx=0x7fcc2000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000a640 con 0x7fcc30071380 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000a7a0 con 0x7fcc30071380 2024-02-17T00:37:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000ab90 con 0x7fcc30071380 2024-02-17T00:37:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc300cc8c0 con 0x7fcc30071380 2024-02-17T00:37:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.914+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc301404e0 con 0x7fcc30071380 2024-02-17T00:37:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.915+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3006f1f0 con 0x7fcc30071380 2024-02-17T00:37:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.916+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcc2000acf0 con 0x7fcc30071380 2024-02-17T00:37:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.916+0000 7fcc26ffd640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc1006b810 0x7fcc1006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.916+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcc20089c70 con 0x7fcc30071380 2024-02-17T00:37:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.916+0000 7fcc2dd9b640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc1006b810 0x7fcc1006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.917+0000 7fcc2dd9b640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc1006b810 0x7fcc1006dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc18036000 tx=0x7fcc18008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:00.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:00.920+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc20054490 con 0x7fcc30071380 2024-02-17T00:37:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.096+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc30071d20 con 0x7fcc1006b810 2024-02-17T00:37:01.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.107+0000 7fcc26ffd640 1 -- 172.21.15.32:0/4258757753 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345271 (secure 0 0 0) 0x7fcc180305f0 con 0x7fcc1006b810 2024-02-17T00:37:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:01.116 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc1006b810 msgr2=0x7fcc1006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc1006b810 0x7fcc1006dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc18036000 tx=0x7fcc18008030 comp rx=0 tx=0).stop 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 msgr2=0x7fcc3013ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc3013ffa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c8c0 tx=0x7fcc2000cd80 comp rx=0 tx=0).stop 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 shutdown_connections 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc30145270 0x7fcc301e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc1006b810 0x7fcc1006dcd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc30144610 0x7fcc301e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 --2- 172.21.15.32:0/4258757753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc30071380 0x7fcc3013ffa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 >> 172.21.15.32:0/4258757753 conn(0x7fcc300b3390 msgr2=0x7fcc301433f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 shutdown_connections 2024-02-17T00:37:01.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.110+0000 7fcc348df640 1 -- 172.21.15.32:0/4258757753 wait complete. 2024-02-17T00:37:01.124 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-02-17T00:36:59.950940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248732,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725988,"statfs":{"total":773094113280,"available":772839411712,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003158"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831592+0000","last_change":"2024-02-17T00:36:37.030662+0000","last_active":"2024-02-17T00:36:43.831592+0000","last_peered":"2024-02-17T00:36:43.831592+0000","last_clean":"2024-02-17T00:36:43.831592+0000","last_became_active":"2024-02-17T00:36:37.030370+0000","last_became_peered":"2024-02-17T00:36:37.030370+0000","last_unstale":"2024-02-17T00:36:43.831592+0000","last_undegraded":"2024-02-17T00:36:43.831592+0000","last_fullsized":"2024-02-17T00:36:43.831592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097375+0000","last_change":"2024-02-17T00:36:38.055521+0000","last_active":"2024-02-17T00:36:43.097375+0000","last_peered":"2024-02-17T00:36:43.097375+0000","last_clean":"2024-02-17T00:36:43.097375+0000","last_became_active":"2024-02-17T00:36:38.054923+0000","last_became_peered":"2024-02-17T00:36:38.054923+0000","last_unstale":"2024-02-17T00:36:43.097375+0000","last_undegraded":"2024-02-17T00:36:43.097375+0000","last_fullsized":"2024-02-17T00:36:43.097375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068785+0000","last_change":"2024-02-17T00:36:42.106155+0000","last_active":"2024-02-17T00:36:43.068785+0000","last_peered":"2024-02-17T00:36:43.068785+0000","last_clean":"2024-02-17T00:36:43.068785+0000","last_became_active":"2024-02-17T00:36:42.105538+0000","last_became_peered":"2024-02-17T00:36:42.105538+0000","last_unstale":"2024-02-17T00:36:43.068785+0000","last_undegraded":"2024-02-17T00:36:43.068785+0000","last_fullsized":"2024-02-17T00:36:43.068785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:31:04.425166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097461+0000","last_change":"2024-02-17T00:36:37.028529+0000","last_active":"2024-02-17T00:36:43.097461+0000","last_peered":"2024-02-17T00:36:43.097461+0000","last_clean":"2024-02-17T00:36:43.097461+0000","last_became_active":"2024-02-17T00:36:37.027869+0000","last_became_peered":"2024-02-17T00:36:37.027869+0000","last_unstale":"2024-02-17T00:36:43.097461+0000","last_undegraded":"2024-02-17T00:36:43.097461+0000","last_fullsized":"2024-02-17T00:36:43.097461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097406+0000","last_change":"2024-02-17T00:36:38.049523+0000","last_active":"2024-02-17T00:36:43.097406+0000","last_peered":"2024-02-17T00:36:43.097406+0000","last_clean":"2024-02-17T00:36:43.097406+0000","last_became_active":"2024-02-17T00:36:38.048836+0000","last_became_peered":"2024-02-17T00:36:38.048836+0000","last_unstale":"2024-02-17T00:36:43.097406+0000","last_undegraded":"2024-02-17T00:36:43.097406+0000","last_fullsized":"2024-02-17T00:36:43.097406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068282+0000","last_change":"2024-02-17T00:36:42.106437+0000","last_active":"2024-02-17T00:36:43.068282+0000","last_peered":"2024-02-17T00:36:43.068282+0000","last_clean":"2024-02-17T00:36:43.068282+0000","last_became_active":"2024-02-17T00:36:42.105260+0000","last_became_peered":"2024-02-17T00:36:42.105260+0000","last_unstale":"2024-02-17T00:36:43.068282+0000","last_undegraded":"2024-02-17T00:36:43.068282+0000","last_fullsized":"2024-02-17T00:36:43.068282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:43.059445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831042+0000","last_change":"2024-02-17T00:36:37.031714+0000","last_active":"2024-02-17T00:36:43.831042+0000","last_peered":"2024-02-17T00:36:43.831042+0000","last_clean":"2024-02-17T00:36:43.831042+0000","last_became_active":"2024-02-17T00:36:37.031420+0000","last_became_peered":"2024-02-17T00:36:37.031420+0000","last_unstale":"2024-02-17T00:36:43.831042+0000","last_undegraded":"2024-02-17T00:36:43.831042+0000","last_fullsized":"2024-02-17T00:36:43.831042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069643+0000","last_change":"2024-02-17T00:36:38.056370+0000","last_active":"2024-02-17T00:36:43.069643+0000","last_peered":"2024-02-17T00:36:43.069643+0000","last_clean":"2024-02-17T00:36:43.069643+0000","last_became_active":"2024-02-17T00:36:38.056088+0000","last_became_peered":"2024-02-17T00:36:38.056088+0000","last_unstale":"2024-02-17T00:36:43.069643+0000","last_undegraded":"2024-02-17T00:36:43.069643+0000","last_fullsized":"2024-02-17T00:36:43.069643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068302+0000","last_change":"2024-02-17T00:36:42.102716+0000","last_active":"2024-02-17T00:36:43.068302+0000","last_peered":"2024-02-17T00:36:43.068302+0000","last_clean":"2024-02-17T00:36:43.068302+0000","last_became_active":"2024-02-17T00:36:42.102320+0000","last_became_peered":"2024-02-17T00:36:42.102320+0000","last_unstale":"2024-02-17T00:36:43.068302+0000","last_undegraded":"2024-02-17T00:36:43.068302+0000","last_fullsized":"2024-02-17T00:36:43.068302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832076+0000","last_change":"2024-02-17T00:36:37.030968+0000","last_active":"2024-02-17T00:36:43.832076+0000","last_peered":"2024-02-17T00:36:43.832076+0000","last_clean":"2024-02-17T00:36:43.832076+0000","last_became_active":"2024-02-17T00:36:37.030633+0000","last_became_peered":"2024-02-17T00:36:37.030633+0000","last_unstale":"2024-02-17T00:36:43.832076+0000","last_undegraded":"2024-02-17T00:36:43.832076+0000","last_fullsized":"2024-02-17T00:36:43.832076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832222+0000","last_change":"2024-02-17T00:36:38.059509+0000","last_active":"2024-02-17T00:36:43.832222+0000","last_peered":"2024-02-17T00:36:43.832222+0000","last_clean":"2024-02-17T00:36:43.832222+0000","last_became_active":"2024-02-17T00:36:38.059254+0000","last_became_peered":"2024-02-17T00:36:38.059254+0000","last_unstale":"2024-02-17T00:36:43.832222+0000","last_undegraded":"2024-02-17T00:36:43.832222+0000","last_fullsized":"2024-02-17T00:36:43.832222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:03.666531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068026+0000","last_change":"2024-02-17T00:36:42.104635+0000","last_active":"2024-02-17T00:36:43.068026+0000","last_peered":"2024-02-17T00:36:43.068026+0000","last_clean":"2024-02-17T00:36:43.068026+0000","last_became_active":"2024-02-17T00:36:42.104078+0000","last_became_peered":"2024-02-17T00:36:42.104078+0000","last_unstale":"2024-02-17T00:36:43.068026+0000","last_undegraded":"2024-02-17T00:36:43.068026+0000","last_fullsized":"2024-02-17T00:36:43.068026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831402+0000","last_change":"2024-02-17T00:36:38.044922+0000","last_active":"2024-02-17T00:36:43.831402+0000","last_peered":"2024-02-17T00:36:43.831402+0000","last_clean":"2024-02-17T00:36:43.831402+0000","last_became_active":"2024-02-17T00:36:38.044635+0000","last_became_peered":"2024-02-17T00:36:38.044635+0000","last_unstale":"2024-02-17T00:36:43.831402+0000","last_undegraded":"2024-02-17T00:36:43.831402+0000","last_fullsized":"2024-02-17T00:36:43.831402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:07:57.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831908+0000","last_change":"2024-02-17T00:36:37.027914+0000","last_active":"2024-02-17T00:36:43.831908+0000","last_peered":"2024-02-17T00:36:43.831908+0000","last_clean":"2024-02-17T00:36:43.831908+0000","last_became_active":"2024-02-17T00:36:37.027428+0000","last_became_peered":"2024-02-17T00:36:37.027428+0000","last_unstale":"2024-02-17T00:36:43.831908+0000","last_undegraded":"2024-02-17T00:36:43.831908+0000","last_fullsized":"2024-02-17T00:36:43.831908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:41.254351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832120+0000","last_change":"2024-02-17T00:36:42.112759+0000","last_active":"2024-02-17T00:36:43.832120+0000","last_peered":"2024-02-17T00:36:43.832120+0000","last_clean":"2024-02-17T00:36:43.832120+0000","last_became_active":"2024-02-17T00:36:42.112040+0000","last_became_peered":"2024-02-17T00:36:42.112040+0000","last_unstale":"2024-02-17T00:36:43.832120+0000","last_undegraded":"2024-02-17T00:36:43.832120+0000","last_fullsized":"2024-02-17T00:36:43.832120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:15.987819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069089+0000","last_change":"2024-02-17T00:36:38.057079+0000","last_active":"2024-02-17T00:36:43.069089+0000","last_peered":"2024-02-17T00:36:43.069089+0000","last_clean":"2024-02-17T00:36:43.069089+0000","last_became_active":"2024-02-17T00:36:38.056788+0000","last_became_peered":"2024-02-17T00:36:38.056788+0000","last_unstale":"2024-02-17T00:36:43.069089+0000","last_undegraded":"2024-02-17T00:36:43.069089+0000","last_fullsized":"2024-02-17T00:36:43.069089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:56:11.007052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832223+0000","last_change":"2024-02-17T00:36:37.032242+0000","last_active":"2024-02-17T00:36:43.832223+0000","last_peered":"2024-02-17T00:36:43.832223+0000","last_clean":"2024-02-17T00:36:43.832223+0000","last_became_active":"2024-02-17T00:36:37.031951+0000","last_became_peered":"2024-02-17T00:36:37.031951+0000","last_unstale":"2024-02-17T00:36:43.832223+0000","last_undegraded":"2024-02-17T00:36:43.832223+0000","last_fullsized":"2024-02-17T00:36:43.832223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831617+0000","last_change":"2024-02-17T00:36:42.105780+0000","last_active":"2024-02-17T00:36:43.831617+0000","last_peered":"2024-02-17T00:36:43.831617+0000","last_clean":"2024-02-17T00:36:43.831617+0000","last_became_active":"2024-02-17T00:36:42.105405+0000","last_became_peered":"2024-02-17T00:36:42.105405+0000","last_unstale":"2024-02-17T00:36:43.831617+0000","last_undegraded":"2024-02-17T00:36:43.831617+0000","last_fullsized":"2024-02-17T00:36:43.831617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:40.401581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831013+0000","last_change":"2024-02-17T00:36:38.053301+0000","last_active":"2024-02-17T00:36:43.831013+0000","last_peered":"2024-02-17T00:36:43.831013+0000","last_clean":"2024-02-17T00:36:43.831013+0000","last_became_active":"2024-02-17T00:36:38.052981+0000","last_became_peered":"2024-02-17T00:36:38.052981+0000","last_unstale":"2024-02-17T00:36:43.831013+0000","last_undegraded":"2024-02-17T00:36:43.831013+0000","last_fullsized":"2024-02-17T00:36:43.831013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831734+0000","last_change":"2024-02-17T00:36:37.032841+0000","last_active":"2024-02-17T00:36:43.831734+0000","last_peered":"2024-02-17T00:36:43.831734+0000","last_clean":"2024-02-17T00:36:43.831734+0000","last_became_active":"2024-02-17T00:36:37.032569+0000","last_became_peered":"2024-02-17T00:36:37.032569+0000","last_unstale":"2024-02-17T00:36:43.831734+0000","last_undegraded":"2024-02-17T00:36:43.831734+0000","last_fullsized":"2024-02-17T00:36:43.831734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069627+0000","last_change":"2024-02-17T00:36:42.110199+0000","last_active":"2024-02-17T00:36:43.069627+0000","last_peered":"2024-02-17T00:36:43.069627+0000","last_clean":"2024-02-17T00:36:43.069627+0000","last_became_active":"2024-02-17T00:36:42.109821+0000","last_became_peered":"2024-02-17T00:36:42.109821+0000","last_unstale":"2024-02-17T00:36:43.069627+0000","last_undegraded":"2024-02-17T00:36:43.069627+0000","last_fullsized":"2024-02-17T00:36:43.069627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:09:09.535328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830918+0000","last_change":"2024-02-17T00:36:38.054753+0000","last_active":"2024-02-17T00:36:43.830918+0000","last_peered":"2024-02-17T00:36:43.830918+0000","last_clean":"2024-02-17T00:36:43.830918+0000","last_became_active":"2024-02-17T00:36:38.054461+0000","last_became_peered":"2024-02-17T00:36:38.054461+0000","last_unstale":"2024-02-17T00:36:43.830918+0000","last_undegraded":"2024-02-17T00:36:43.830918+0000","last_fullsized":"2024-02-17T00:36:43.830918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:40.337939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830476+0000","last_change":"2024-02-17T00:36:37.036152+0000","last_active":"2024-02-17T00:36:43.830476+0000","last_peered":"2024-02-17T00:36:43.830476+0000","last_clean":"2024-02-17T00:36:43.830476+0000","last_became_active":"2024-02-17T00:36:37.035247+0000","last_became_peered":"2024-02-17T00:36:37.035247+0000","last_unstale":"2024-02-17T00:36:43.830476+0000","last_undegraded":"2024-02-17T00:36:43.830476+0000","last_fullsized":"2024-02-17T00:36:43.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068880+0000","last_change":"2024-02-17T00:36:42.107390+0000","last_active":"2024-02-17T00:36:43.068880+0000","last_peered":"2024-02-17T00:36:43.068880+0000","last_clean":"2024-02-17T00:36:43.068880+0000","last_became_active":"2024-02-17T00:36:42.106991+0000","last_became_peered":"2024-02-17T00:36:42.106991+0000","last_unstale":"2024-02-17T00:36:43.068880+0000","last_undegraded":"2024-02-17T00:36:43.068880+0000","last_fullsized":"2024-02-17T00:36:43.068880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831870+0000","last_change":"2024-02-17T00:36:38.056121+0000","last_active":"2024-02-17T00:36:43.831870+0000","last_peered":"2024-02-17T00:36:43.831870+0000","last_clean":"2024-02-17T00:36:43.831870+0000","last_became_active":"2024-02-17T00:36:38.055860+0000","last_became_peered":"2024-02-17T00:36:38.055860+0000","last_unstale":"2024-02-17T00:36:43.831870+0000","last_undegraded":"2024-02-17T00:36:43.831870+0000","last_fullsized":"2024-02-17T00:36:43.831870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832500+0000","last_change":"2024-02-17T00:36:37.038395+0000","last_active":"2024-02-17T00:36:43.832500+0000","last_peered":"2024-02-17T00:36:43.832500+0000","last_clean":"2024-02-17T00:36:43.832500+0000","last_became_active":"2024-02-17T00:36:37.038139+0000","last_became_peered":"2024-02-17T00:36:37.038139+0000","last_unstale":"2024-02-17T00:36:43.832500+0000","last_undegraded":"2024-02-17T00:36:43.832500+0000","last_fullsized":"2024-02-17T00:36:43.832500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068014+0000","last_change":"2024-02-17T00:36:42.106502+0000","last_active":"2024-02-17T00:36:43.068014+0000","last_peered":"2024-02-17T00:36:43.068014+0000","last_clean":"2024-02-17T00:36:43.068014+0000","last_became_active":"2024-02-17T00:36:42.104704+0000","last_became_peered":"2024-02-17T00:36:42.104704+0000","last_unstale":"2024-02-17T00:36:43.068014+0000","last_undegraded":"2024-02-17T00:36:43.068014+0000","last_fullsized":"2024-02-17T00:36:43.068014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831529+0000","last_change":"2024-02-17T00:36:38.047108+0000","last_active":"2024-02-17T00:36:43.831529+0000","last_peered":"2024-02-17T00:36:43.831529+0000","last_clean":"2024-02-17T00:36:43.831529+0000","last_became_active":"2024-02-17T00:36:38.046838+0000","last_became_peered":"2024-02-17T00:36:38.046838+0000","last_unstale":"2024-02-17T00:36:43.831529+0000","last_undegraded":"2024-02-17T00:36:43.831529+0000","last_fullsized":"2024-02-17T00:36:43.831529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832108+0000","last_change":"2024-02-17T00:36:37.029498+0000","last_active":"2024-02-17T00:36:43.832108+0000","last_peered":"2024-02-17T00:36:43.832108+0000","last_clean":"2024-02-17T00:36:43.832108+0000","last_became_active":"2024-02-17T00:36:37.029197+0000","last_became_peered":"2024-02-17T00:36:37.029197+0000","last_unstale":"2024-02-17T00:36:43.832108+0000","last_undegraded":"2024-02-17T00:36:43.832108+0000","last_fullsized":"2024-02-17T00:36:43.832108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831904+0000","last_change":"2024-02-17T00:36:42.107429+0000","last_active":"2024-02-17T00:36:43.831904+0000","last_peered":"2024-02-17T00:36:43.831904+0000","last_clean":"2024-02-17T00:36:43.831904+0000","last_became_active":"2024-02-17T00:36:42.105692+0000","last_became_peered":"2024-02-17T00:36:42.105692+0000","last_unstale":"2024-02-17T00:36:43.831904+0000","last_undegraded":"2024-02-17T00:36:43.831904+0000","last_fullsized":"2024-02-17T00:36:43.831904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:14.318951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832572+0000","last_change":"2024-02-17T00:36:38.049191+0000","last_active":"2024-02-17T00:36:43.832572+0000","last_peered":"2024-02-17T00:36:43.832572+0000","last_clean":"2024-02-17T00:36:43.832572+0000","last_became_active":"2024-02-17T00:36:38.048889+0000","last_became_peered":"2024-02-17T00:36:38.048889+0000","last_unstale":"2024-02-17T00:36:43.832572+0000","last_undegraded":"2024-02-17T00:36:43.832572+0000","last_fullsized":"2024-02-17T00:36:43.832572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832472+0000","last_change":"2024-02-17T00:36:37.034662+0000","last_active":"2024-02-17T00:36:43.832472+0000","last_peered":"2024-02-17T00:36:43.832472+0000","last_clean":"2024-02-17T00:36:43.832472+0000","last_became_active":"2024-02-17T00:36:37.034377+0000","last_became_peered":"2024-02-17T00:36:37.034377+0000","last_unstale":"2024-02-17T00:36:43.832472+0000","last_undegraded":"2024-02-17T00:36:43.832472+0000","last_fullsized":"2024-02-17T00:36:43.832472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:46.302658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832390+0000","last_change":"2024-02-17T00:36:42.102832+0000","last_active":"2024-02-17T00:36:43.832390+0000","last_peered":"2024-02-17T00:36:43.832390+0000","last_clean":"2024-02-17T00:36:43.832390+0000","last_became_active":"2024-02-17T00:36:42.102261+0000","last_became_peered":"2024-02-17T00:36:42.102261+0000","last_unstale":"2024-02-17T00:36:43.832390+0000","last_undegraded":"2024-02-17T00:36:43.832390+0000","last_fullsized":"2024-02-17T00:36:43.832390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068321+0000","last_change":"2024-02-17T00:36:38.040343+0000","last_active":"2024-02-17T00:36:43.068321+0000","last_peered":"2024-02-17T00:36:43.068321+0000","last_clean":"2024-02-17T00:36:43.068321+0000","last_became_active":"2024-02-17T00:36:38.039985+0000","last_became_peered":"2024-02-17T00:36:38.039985+0000","last_unstale":"2024-02-17T00:36:43.068321+0000","last_undegraded":"2024-02-17T00:36:43.068321+0000","last_fullsized":"2024-02-17T00:36:43.068321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096964+0000","last_change":"2024-02-17T00:36:37.031000+0000","last_active":"2024-02-17T00:36:43.096964+0000","last_peered":"2024-02-17T00:36:43.096964+0000","last_clean":"2024-02-17T00:36:43.096964+0000","last_became_active":"2024-02-17T00:36:37.028403+0000","last_became_peered":"2024-02-17T00:36:37.028403+0000","last_unstale":"2024-02-17T00:36:43.096964+0000","last_undegraded":"2024-02-17T00:36:43.096964+0000","last_fullsized":"2024-02-17T00:36:43.096964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831801+0000","last_change":"2024-02-17T00:36:42.106983+0000","last_active":"2024-02-17T00:36:43.831801+0000","last_peered":"2024-02-17T00:36:43.831801+0000","last_clean":"2024-02-17T00:36:43.831801+0000","last_became_active":"2024-02-17T00:36:42.106220+0000","last_became_peered":"2024-02-17T00:36:42.106220+0000","last_unstale":"2024-02-17T00:36:43.831801+0000","last_undegraded":"2024-02-17T00:36:43.831801+0000","last_fullsized":"2024-02-17T00:36:43.831801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831273+0000","last_change":"2024-02-17T00:36:38.064921+0000","last_active":"2024-02-17T00:36:43.831273+0000","last_peered":"2024-02-17T00:36:43.831273+0000","last_clean":"2024-02-17T00:36:43.831273+0000","last_became_active":"2024-02-17T00:36:38.064609+0000","last_became_peered":"2024-02-17T00:36:38.064609+0000","last_unstale":"2024-02-17T00:36:43.831273+0000","last_undegraded":"2024-02-17T00:36:43.831273+0000","last_fullsized":"2024-02-17T00:36:43.831273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831743+0000","last_change":"2024-02-17T00:36:37.027393+0000","last_active":"2024-02-17T00:36:43.831743+0000","last_peered":"2024-02-17T00:36:43.831743+0000","last_clean":"2024-02-17T00:36:43.831743+0000","last_became_active":"2024-02-17T00:36:37.027115+0000","last_became_peered":"2024-02-17T00:36:37.027115+0000","last_unstale":"2024-02-17T00:36:43.831743+0000","last_undegraded":"2024-02-17T00:36:43.831743+0000","last_fullsized":"2024-02-17T00:36:43.831743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:53.731912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832512+0000","last_change":"2024-02-17T00:36:42.104622+0000","last_active":"2024-02-17T00:36:43.832512+0000","last_peered":"2024-02-17T00:36:43.832512+0000","last_clean":"2024-02-17T00:36:43.832512+0000","last_became_active":"2024-02-17T00:36:42.104221+0000","last_became_peered":"2024-02-17T00:36:42.104221+0000","last_unstale":"2024-02-17T00:36:43.832512+0000","last_undegraded":"2024-02-17T00:36:43.832512+0000","last_fullsized":"2024-02-17T00:36:43.832512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096468+0000","last_change":"2024-02-17T00:36:38.059189+0000","last_active":"2024-02-17T00:36:43.096468+0000","last_peered":"2024-02-17T00:36:43.096468+0000","last_clean":"2024-02-17T00:36:43.096468+0000","last_became_active":"2024-02-17T00:36:38.058901+0000","last_became_peered":"2024-02-17T00:36:38.058901+0000","last_unstale":"2024-02-17T00:36:43.096468+0000","last_undegraded":"2024-02-17T00:36:43.096468+0000","last_fullsized":"2024-02-17T00:36:43.096468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068931+0000","last_change":"2024-02-17T00:36:37.030700+0000","last_active":"2024-02-17T00:36:43.068931+0000","last_peered":"2024-02-17T00:36:43.068931+0000","last_clean":"2024-02-17T00:36:43.068931+0000","last_became_active":"2024-02-17T00:36:37.030397+0000","last_became_peered":"2024-02-17T00:36:37.030397+0000","last_unstale":"2024-02-17T00:36:43.068931+0000","last_undegraded":"2024-02-17T00:36:43.068931+0000","last_fullsized":"2024-02-17T00:36:43.068931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:05.382965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832374+0000","last_change":"2024-02-17T00:36:42.107289+0000","last_active":"2024-02-17T00:36:43.832374+0000","last_peered":"2024-02-17T00:36:43.832374+0000","last_clean":"2024-02-17T00:36:43.832374+0000","last_became_active":"2024-02-17T00:36:42.106838+0000","last_became_peered":"2024-02-17T00:36:42.106838+0000","last_unstale":"2024-02-17T00:36:43.832374+0000","last_undegraded":"2024-02-17T00:36:43.832374+0000","last_fullsized":"2024-02-17T00:36:43.832374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831254+0000","last_change":"2024-02-17T00:36:38.040509+0000","last_active":"2024-02-17T00:36:43.831254+0000","last_peered":"2024-02-17T00:36:43.831254+0000","last_clean":"2024-02-17T00:36:43.831254+0000","last_became_active":"2024-02-17T00:36:38.040220+0000","last_became_peered":"2024-02-17T00:36:38.040220+0000","last_unstale":"2024-02-17T00:36:43.831254+0000","last_undegraded":"2024-02-17T00:36:43.831254+0000","last_fullsized":"2024-02-17T00:36:43.831254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831090+0000","last_change":"2024-02-17T00:36:37.029628+0000","last_active":"2024-02-17T00:36:43.831090+0000","last_peered":"2024-02-17T00:36:43.831090+0000","last_clean":"2024-02-17T00:36:43.831090+0000","last_became_active":"2024-02-17T00:36:37.029322+0000","last_became_peered":"2024-02-17T00:36:37.029322+0000","last_unstale":"2024-02-17T00:36:43.831090+0000","last_undegraded":"2024-02-17T00:36:43.831090+0000","last_fullsized":"2024-02-17T00:36:43.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:29.219599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097224+0000","last_change":"2024-02-17T00:36:42.110170+0000","last_active":"2024-02-17T00:36:43.097224+0000","last_peered":"2024-02-17T00:36:43.097224+0000","last_clean":"2024-02-17T00:36:43.097224+0000","last_became_active":"2024-02-17T00:36:42.109713+0000","last_became_peered":"2024-02-17T00:36:42.109713+0000","last_unstale":"2024-02-17T00:36:43.097224+0000","last_undegraded":"2024-02-17T00:36:43.097224+0000","last_fullsized":"2024-02-17T00:36:43.097224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:07.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831262+0000","last_change":"2024-02-17T00:36:38.041003+0000","last_active":"2024-02-17T00:36:43.831262+0000","last_peered":"2024-02-17T00:36:43.831262+0000","last_clean":"2024-02-17T00:36:43.831262+0000","last_became_active":"2024-02-17T00:36:38.040700+0000","last_became_peered":"2024-02-17T00:36:38.040700+0000","last_unstale":"2024-02-17T00:36:43.831262+0000","last_undegraded":"2024-02-17T00:36:43.831262+0000","last_fullsized":"2024-02-17T00:36:43.831262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:15:02.009972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831922+0000","last_change":"2024-02-17T00:36:37.027694+0000","last_active":"2024-02-17T00:36:43.831922+0000","last_peered":"2024-02-17T00:36:43.831922+0000","last_clean":"2024-02-17T00:36:43.831922+0000","last_became_active":"2024-02-17T00:36:37.027061+0000","last_became_peered":"2024-02-17T00:36:37.027061+0000","last_unstale":"2024-02-17T00:36:43.831922+0000","last_undegraded":"2024-02-17T00:36:43.831922+0000","last_fullsized":"2024-02-17T00:36:43.831922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069046+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:36:43.069046+0000","last_peered":"2024-02-17T00:36:43.069046+0000","last_clean":"2024-02-17T00:36:43.069046+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:36:43.069046+0000","last_undegraded":"2024-02-17T00:36:43.069046+0000","last_fullsized":"2024-02-17T00:36:43.069046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832461+0000","last_change":"2024-02-17T00:36:42.105550+0000","last_active":"2024-02-17T00:36:43.832461+0000","last_peered":"2024-02-17T00:36:43.832461+0000","last_clean":"2024-02-17T00:36:43.832461+0000","last_became_active":"2024-02-17T00:36:42.105076+0000","last_became_peered":"2024-02-17T00:36:42.105076+0000","last_unstale":"2024-02-17T00:36:43.832461+0000","last_undegraded":"2024-02-17T00:36:43.832461+0000","last_fullsized":"2024-02-17T00:36:43.832461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:06:27.497749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832306+0000","last_change":"2024-02-17T00:36:38.045045+0000","last_active":"2024-02-17T00:36:43.832306+0000","last_peered":"2024-02-17T00:36:43.832306+0000","last_clean":"2024-02-17T00:36:43.832306+0000","last_became_active":"2024-02-17T00:36:38.044771+0000","last_became_peered":"2024-02-17T00:36:38.044771+0000","last_unstale":"2024-02-17T00:36:43.832306+0000","last_undegraded":"2024-02-17T00:36:43.832306+0000","last_fullsized":"2024-02-17T00:36:43.832306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:37.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832582+0000","last_change":"2024-02-17T00:36:37.032742+0000","last_active":"2024-02-17T00:36:43.832582+0000","last_peered":"2024-02-17T00:36:43.832582+0000","last_clean":"2024-02-17T00:36:43.832582+0000","last_became_active":"2024-02-17T00:36:37.032468+0000","last_became_peered":"2024-02-17T00:36:37.032468+0000","last_unstale":"2024-02-17T00:36:43.832582+0000","last_undegraded":"2024-02-17T00:36:43.832582+0000","last_fullsized":"2024-02-17T00:36:43.832582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068115+0000","last_change":"2024-02-17T00:36:42.103839+0000","last_active":"2024-02-17T00:36:43.068115+0000","last_peered":"2024-02-17T00:36:43.068115+0000","last_clean":"2024-02-17T00:36:43.068115+0000","last_became_active":"2024-02-17T00:36:42.103440+0000","last_became_peered":"2024-02-17T00:36:42.103440+0000","last_unstale":"2024-02-17T00:36:43.068115+0000","last_undegraded":"2024-02-17T00:36:43.068115+0000","last_fullsized":"2024-02-17T00:36:43.068115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831939+0000","last_change":"2024-02-17T00:36:38.062320+0000","last_active":"2024-02-17T00:36:43.831939+0000","last_peered":"2024-02-17T00:36:43.831939+0000","last_clean":"2024-02-17T00:36:43.831939+0000","last_became_active":"2024-02-17T00:36:38.062072+0000","last_became_peered":"2024-02-17T00:36:38.062072+0000","last_unstale":"2024-02-17T00:36:43.831939+0000","last_undegraded":"2024-02-17T00:36:43.831939+0000","last_fullsized":"2024-02-17T00:36:43.831939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097214+0000","last_change":"2024-02-17T00:36:37.027607+0000","last_active":"2024-02-17T00:36:43.097214+0000","last_peered":"2024-02-17T00:36:43.097214+0000","last_clean":"2024-02-17T00:36:43.097214+0000","last_became_active":"2024-02-17T00:36:37.025882+0000","last_became_peered":"2024-02-17T00:36:37.025882+0000","last_unstale":"2024-02-17T00:36:43.097214+0000","last_undegraded":"2024-02-17T00:36:43.097214+0000","last_fullsized":"2024-02-17T00:36:43.097214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096933+0000","last_change":"2024-02-17T00:36:42.108808+0000","last_active":"2024-02-17T00:36:43.096933+0000","last_peered":"2024-02-17T00:36:43.096933+0000","last_clean":"2024-02-17T00:36:43.096933+0000","last_became_active":"2024-02-17T00:36:42.108343+0000","last_became_peered":"2024-02-17T00:36:42.108343+0000","last_unstale":"2024-02-17T00:36:43.096933+0000","last_undegraded":"2024-02-17T00:36:43.096933+0000","last_fullsized":"2024-02-17T00:36:43.096933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:08:01.687705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831483+0000","last_change":"2024-02-17T00:36:38.059195+0000","last_active":"2024-02-17T00:36:43.831483+0000","last_peered":"2024-02-17T00:36:43.831483+0000","last_clean":"2024-02-17T00:36:43.831483+0000","last_became_active":"2024-02-17T00:36:38.058923+0000","last_became_peered":"2024-02-17T00:36:38.058923+0000","last_unstale":"2024-02-17T00:36:43.831483+0000","last_undegraded":"2024-02-17T00:36:43.831483+0000","last_fullsized":"2024-02-17T00:36:43.831483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831998+0000","last_change":"2024-02-17T00:36:37.030669+0000","last_active":"2024-02-17T00:36:43.831998+0000","last_peered":"2024-02-17T00:36:43.831998+0000","last_clean":"2024-02-17T00:36:43.831998+0000","last_became_active":"2024-02-17T00:36:37.029671+0000","last_became_peered":"2024-02-17T00:36:37.029671+0000","last_unstale":"2024-02-17T00:36:43.831998+0000","last_undegraded":"2024-02-17T00:36:43.831998+0000","last_fullsized":"2024-02-17T00:36:43.831998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830669+0000","last_change":"2024-02-17T00:36:42.106377+0000","last_active":"2024-02-17T00:36:43.830669+0000","last_peered":"2024-02-17T00:36:43.830669+0000","last_clean":"2024-02-17T00:36:43.830669+0000","last_became_active":"2024-02-17T00:36:42.105980+0000","last_became_peered":"2024-02-17T00:36:42.105980+0000","last_unstale":"2024-02-17T00:36:43.830669+0000","last_undegraded":"2024-02-17T00:36:43.830669+0000","last_fullsized":"2024-02-17T00:36:43.830669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:14:16.476031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069144+0000","last_change":"2024-02-17T00:36:38.056738+0000","last_active":"2024-02-17T00:36:43.069144+0000","last_peered":"2024-02-17T00:36:43.069144+0000","last_clean":"2024-02-17T00:36:43.069144+0000","last_became_active":"2024-02-17T00:36:38.056342+0000","last_became_peered":"2024-02-17T00:36:38.056342+0000","last_unstale":"2024-02-17T00:36:43.069144+0000","last_undegraded":"2024-02-17T00:36:43.069144+0000","last_fullsized":"2024-02-17T00:36:43.069144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831546+0000","last_change":"2024-02-17T00:36:37.037085+0000","last_active":"2024-02-17T00:36:43.831546+0000","last_peered":"2024-02-17T00:36:43.831546+0000","last_clean":"2024-02-17T00:36:43.831546+0000","last_became_active":"2024-02-17T00:36:37.036719+0000","last_became_peered":"2024-02-17T00:36:37.036719+0000","last_unstale":"2024-02-17T00:36:43.831546+0000","last_undegraded":"2024-02-17T00:36:43.831546+0000","last_fullsized":"2024-02-17T00:36:43.831546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069663+0000","last_change":"2024-02-17T00:36:42.109922+0000","last_active":"2024-02-17T00:36:43.069663+0000","last_peered":"2024-02-17T00:36:43.069663+0000","last_clean":"2024-02-17T00:36:43.069663+0000","last_became_active":"2024-02-17T00:36:42.109554+0000","last_became_peered":"2024-02-17T00:36:42.109554+0000","last_unstale":"2024-02-17T00:36:43.069663+0000","last_undegraded":"2024-02-17T00:36:43.069663+0000","last_fullsized":"2024-02-17T00:36:43.069663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:14.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:38.039174+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:38.038826+0000","last_became_peered":"2024-02-17T00:36:38.038826+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831131+0000","last_change":"2024-02-17T00:36:37.026636+0000","last_active":"2024-02-17T00:36:43.831131+0000","last_peered":"2024-02-17T00:36:43.831131+0000","last_clean":"2024-02-17T00:36:43.831131+0000","last_became_active":"2024-02-17T00:36:37.026356+0000","last_became_peered":"2024-02-17T00:36:37.026356+0000","last_unstale":"2024-02-17T00:36:43.831131+0000","last_undegraded":"2024-02-17T00:36:43.831131+0000","last_fullsized":"2024-02-17T00:36:43.831131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097409+0000","last_change":"2024-02-17T00:36:42.109160+0000","last_active":"2024-02-17T00:36:43.097409+0000","last_peered":"2024-02-17T00:36:43.097409+0000","last_clean":"2024-02-17T00:36:43.097409+0000","last_became_active":"2024-02-17T00:36:42.108726+0000","last_became_peered":"2024-02-17T00:36:42.108726+0000","last_unstale":"2024-02-17T00:36:43.097409+0000","last_undegraded":"2024-02-17T00:36:43.097409+0000","last_fullsized":"2024-02-17T00:36:43.097409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:41.664699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068896+0000","last_change":"2024-02-17T00:36:38.050032+0000","last_active":"2024-02-17T00:36:43.068896+0000","last_peered":"2024-02-17T00:36:43.068896+0000","last_clean":"2024-02-17T00:36:43.068896+0000","last_became_active":"2024-02-17T00:36:38.049764+0000","last_became_peered":"2024-02-17T00:36:38.049764+0000","last_unstale":"2024-02-17T00:36:43.068896+0000","last_undegraded":"2024-02-17T00:36:43.068896+0000","last_fullsized":"2024-02-17T00:36:43.068896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:04.316331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830633+0000","last_change":"2024-02-17T00:36:37.039587+0000","last_active":"2024-02-17T00:36:43.830633+0000","last_peered":"2024-02-17T00:36:43.830633+0000","last_clean":"2024-02-17T00:36:43.830633+0000","last_became_active":"2024-02-17T00:36:37.039306+0000","last_became_peered":"2024-02-17T00:36:37.039306+0000","last_unstale":"2024-02-17T00:36:43.830633+0000","last_undegraded":"2024-02-17T00:36:43.830633+0000","last_fullsized":"2024-02-17T00:36:43.830633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097441+0000","last_change":"2024-02-17T00:36:42.110028+0000","last_active":"2024-02-17T00:36:43.097441+0000","last_peered":"2024-02-17T00:36:43.097441+0000","last_clean":"2024-02-17T00:36:43.097441+0000","last_became_active":"2024-02-17T00:36:42.109169+0000","last_became_peered":"2024-02-17T00:36:42.109169+0000","last_unstale":"2024-02-17T00:36:43.097441+0000","last_undegraded":"2024-02-17T00:36:43.097441+0000","last_fullsized":"2024-02-17T00:36:43.097441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:50.471622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831820+0000","last_change":"2024-02-17T00:36:38.058168+0000","last_active":"2024-02-17T00:36:43.831820+0000","last_peered":"2024-02-17T00:36:43.831820+0000","last_clean":"2024-02-17T00:36:43.831820+0000","last_became_active":"2024-02-17T00:36:38.057867+0000","last_became_peered":"2024-02-17T00:36:38.057867+0000","last_unstale":"2024-02-17T00:36:43.831820+0000","last_undegraded":"2024-02-17T00:36:43.831820+0000","last_fullsized":"2024-02-17T00:36:43.831820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:03:31.843189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831661+0000","last_change":"2024-02-17T00:36:37.033408+0000","last_active":"2024-02-17T00:36:43.831661+0000","last_peered":"2024-02-17T00:36:43.831661+0000","last_clean":"2024-02-17T00:36:43.831661+0000","last_became_active":"2024-02-17T00:36:37.031691+0000","last_became_peered":"2024-02-17T00:36:37.031691+0000","last_unstale":"2024-02-17T00:36:43.831661+0000","last_undegraded":"2024-02-17T00:36:43.831661+0000","last_fullsized":"2024-02-17T00:36:43.831661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:09.449647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832315+0000","last_change":"2024-02-17T00:36:42.105315+0000","last_active":"2024-02-17T00:36:43.832315+0000","last_peered":"2024-02-17T00:36:43.832315+0000","last_clean":"2024-02-17T00:36:43.832315+0000","last_became_active":"2024-02-17T00:36:42.104846+0000","last_became_peered":"2024-02-17T00:36:42.104846+0000","last_unstale":"2024-02-17T00:36:43.832315+0000","last_undegraded":"2024-02-17T00:36:43.832315+0000","last_fullsized":"2024-02-17T00:36:43.832315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831976+0000","last_change":"2024-02-17T00:36:38.038475+0000","last_active":"2024-02-17T00:36:43.831976+0000","last_peered":"2024-02-17T00:36:43.831976+0000","last_clean":"2024-02-17T00:36:43.831976+0000","last_became_active":"2024-02-17T00:36:38.038146+0000","last_became_peered":"2024-02-17T00:36:38.038146+0000","last_unstale":"2024-02-17T00:36:43.831976+0000","last_undegraded":"2024-02-17T00:36:43.831976+0000","last_fullsized":"2024-02-17T00:36:43.831976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069341+0000","last_change":"2024-02-17T00:36:37.035415+0000","last_active":"2024-02-17T00:36:43.069341+0000","last_peered":"2024-02-17T00:36:43.069341+0000","last_clean":"2024-02-17T00:36:43.069341+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.069341+0000","last_undegraded":"2024-02-17T00:36:43.069341+0000","last_fullsized":"2024-02-17T00:36:43.069341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:57:22.735661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832312+0000","last_change":"2024-02-17T00:36:42.102660+0000","last_active":"2024-02-17T00:36:43.832312+0000","last_peered":"2024-02-17T00:36:43.832312+0000","last_clean":"2024-02-17T00:36:43.832312+0000","last_became_active":"2024-02-17T00:36:42.102164+0000","last_became_peered":"2024-02-17T00:36:42.102164+0000","last_unstale":"2024-02-17T00:36:43.832312+0000","last_undegraded":"2024-02-17T00:36:43.832312+0000","last_fullsized":"2024-02-17T00:36:43.832312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:22:56.783330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830955+0000","last_change":"2024-02-17T00:36:38.051782+0000","last_active":"2024-02-17T00:36:43.830955+0000","last_peered":"2024-02-17T00:36:43.830955+0000","last_clean":"2024-02-17T00:36:43.830955+0000","last_became_active":"2024-02-17T00:36:38.051484+0000","last_became_peered":"2024-02-17T00:36:38.051484+0000","last_unstale":"2024-02-17T00:36:43.830955+0000","last_undegraded":"2024-02-17T00:36:43.830955+0000","last_fullsized":"2024-02-17T00:36:43.830955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:47.435702+0000","last_change":"2024-02-17T00:36:37.024838+0000","last_active":"2024-02-17T00:36:47.435702+0000","last_peered":"2024-02-17T00:36:47.435702+0000","last_clean":"2024-02-17T00:36:47.435702+0000","last_became_active":"2024-02-17T00:36:37.024507+0000","last_became_peered":"2024-02-17T00:36:37.024507+0000","last_unstale":"2024-02-17T00:36:47.435702+0000","last_undegraded":"2024-02-17T00:36:47.435702+0000","last_fullsized":"2024-02-17T00:36:47.435702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:42.108161+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:42.107414+0000","last_became_peered":"2024-02-17T00:36:42.107414+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:44.381216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831001+0000","last_change":"2024-02-17T00:36:38.040658+0000","last_active":"2024-02-17T00:36:43.831001+0000","last_peered":"2024-02-17T00:36:43.831001+0000","last_clean":"2024-02-17T00:36:43.831001+0000","last_became_active":"2024-02-17T00:36:38.040361+0000","last_became_peered":"2024-02-17T00:36:38.040361+0000","last_unstale":"2024-02-17T00:36:43.831001+0000","last_undegraded":"2024-02-17T00:36:43.831001+0000","last_fullsized":"2024-02-17T00:36:43.831001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069426+0000","last_change":"2024-02-17T00:36:37.030364+0000","last_active":"2024-02-17T00:36:43.069426+0000","last_peered":"2024-02-17T00:36:43.069426+0000","last_clean":"2024-02-17T00:36:43.069426+0000","last_became_active":"2024-02-17T00:36:37.030047+0000","last_became_peered":"2024-02-17T00:36:37.030047+0000","last_unstale":"2024-02-17T00:36:43.069426+0000","last_undegraded":"2024-02-17T00:36:43.069426+0000","last_fullsized":"2024-02-17T00:36:43.069426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:26:31.440572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068488+0000","last_change":"2024-02-17T00:36:42.109162+0000","last_active":"2024-02-17T00:36:43.068488+0000","last_peered":"2024-02-17T00:36:43.068488+0000","last_clean":"2024-02-17T00:36:43.068488+0000","last_became_active":"2024-02-17T00:36:42.107077+0000","last_became_peered":"2024-02-17T00:36:42.107077+0000","last_unstale":"2024-02-17T00:36:43.068488+0000","last_undegraded":"2024-02-17T00:36:43.068488+0000","last_fullsized":"2024-02-17T00:36:43.068488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097502+0000","last_change":"2024-02-17T00:36:38.044311+0000","last_active":"2024-02-17T00:36:43.097502+0000","last_peered":"2024-02-17T00:36:43.097502+0000","last_clean":"2024-02-17T00:36:43.097502+0000","last_became_active":"2024-02-17T00:36:38.044043+0000","last_became_peered":"2024-02-17T00:36:38.044043+0000","last_unstale":"2024-02-17T00:36:43.097502+0000","last_undegraded":"2024-02-17T00:36:43.097502+0000","last_fullsized":"2024-02-17T00:36:43.097502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831305+0000","last_change":"2024-02-17T00:36:37.035871+0000","last_active":"2024-02-17T00:36:43.831305+0000","last_peered":"2024-02-17T00:36:43.831305+0000","last_clean":"2024-02-17T00:36:43.831305+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.831305+0000","last_undegraded":"2024-02-17T00:36:43.831305+0000","last_fullsized":"2024-02-17T00:36:43.831305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068707+0000","last_change":"2024-02-17T00:36:42.111490+0000","last_active":"2024-02-17T00:36:43.068707+0000","last_peered":"2024-02-17T00:36:43.068707+0000","last_clean":"2024-02-17T00:36:43.068707+0000","last_became_active":"2024-02-17T00:36:42.110829+0000","last_became_peered":"2024-02-17T00:36:42.110829+0000","last_unstale":"2024-02-17T00:36:43.068707+0000","last_undegraded":"2024-02-17T00:36:43.068707+0000","last_fullsized":"2024-02-17T00:36:43.068707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:23:34.160962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068936+0000","last_change":"2024-02-17T00:36:38.035374+0000","last_active":"2024-02-17T00:36:43.068936+0000","last_peered":"2024-02-17T00:36:43.068936+0000","last_clean":"2024-02-17T00:36:43.068936+0000","last_became_active":"2024-02-17T00:36:38.035048+0000","last_became_peered":"2024-02-17T00:36:38.035048+0000","last_unstale":"2024-02-17T00:36:43.068936+0000","last_undegraded":"2024-02-17T00:36:43.068936+0000","last_fullsized":"2024-02-17T00:36:43.068936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070032+0000","last_change":"2024-02-17T00:36:37.028771+0000","last_active":"2024-02-17T00:36:43.070032+0000","last_peered":"2024-02-17T00:36:43.070032+0000","last_clean":"2024-02-17T00:36:43.070032+0000","last_became_active":"2024-02-17T00:36:37.028466+0000","last_became_peered":"2024-02-17T00:36:37.028466+0000","last_unstale":"2024-02-17T00:36:43.070032+0000","last_undegraded":"2024-02-17T00:36:43.070032+0000","last_fullsized":"2024-02-17T00:36:43.070032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831980+0000","last_change":"2024-02-17T00:36:42.102858+0000","last_active":"2024-02-17T00:36:43.831980+0000","last_peered":"2024-02-17T00:36:43.831980+0000","last_clean":"2024-02-17T00:36:43.831980+0000","last_became_active":"2024-02-17T00:36:42.102467+0000","last_became_peered":"2024-02-17T00:36:42.102467+0000","last_unstale":"2024-02-17T00:36:43.831980+0000","last_undegraded":"2024-02-17T00:36:43.831980+0000","last_fullsized":"2024-02-17T00:36:43.831980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:16.339508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831808+0000","last_change":"2024-02-17T00:36:42.107030+0000","last_active":"2024-02-17T00:36:43.831808+0000","last_peered":"2024-02-17T00:36:43.831808+0000","last_clean":"2024-02-17T00:36:43.831808+0000","last_became_active":"2024-02-17T00:36:42.106372+0000","last_became_peered":"2024-02-17T00:36:42.106372+0000","last_unstale":"2024-02-17T00:36:43.831808+0000","last_undegraded":"2024-02-17T00:36:43.831808+0000","last_fullsized":"2024-02-17T00:36:43.831808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831130+0000","last_change":"2024-02-17T00:36:38.044613+0000","last_active":"2024-02-17T00:36:43.831130+0000","last_peered":"2024-02-17T00:36:43.831130+0000","last_clean":"2024-02-17T00:36:43.831130+0000","last_became_active":"2024-02-17T00:36:38.043593+0000","last_became_peered":"2024-02-17T00:36:38.043593+0000","last_unstale":"2024-02-17T00:36:43.831130+0000","last_undegraded":"2024-02-17T00:36:43.831130+0000","last_fullsized":"2024-02-17T00:36:43.831130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830995+0000","last_change":"2024-02-17T00:36:37.022022+0000","last_active":"2024-02-17T00:36:43.830995+0000","last_peered":"2024-02-17T00:36:43.830995+0000","last_clean":"2024-02-17T00:36:43.830995+0000","last_became_active":"2024-02-17T00:36:37.021271+0000","last_became_peered":"2024-02-17T00:36:37.021271+0000","last_unstale":"2024-02-17T00:36:43.830995+0000","last_undegraded":"2024-02-17T00:36:43.830995+0000","last_fullsized":"2024-02-17T00:36:43.830995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:45.683932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832391+0000","last_change":"2024-02-17T00:36:42.105409+0000","last_active":"2024-02-17T00:36:43.832391+0000","last_peered":"2024-02-17T00:36:43.832391+0000","last_clean":"2024-02-17T00:36:43.832391+0000","last_became_active":"2024-02-17T00:36:42.104989+0000","last_became_peered":"2024-02-17T00:36:42.104989+0000","last_unstale":"2024-02-17T00:36:43.832391+0000","last_undegraded":"2024-02-17T00:36:43.832391+0000","last_fullsized":"2024-02-17T00:36:43.832391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:41.477918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096723+0000","last_change":"2024-02-17T00:36:38.052345+0000","last_active":"2024-02-17T00:36:43.096723+0000","last_peered":"2024-02-17T00:36:43.096723+0000","last_clean":"2024-02-17T00:36:43.096723+0000","last_became_active":"2024-02-17T00:36:38.052051+0000","last_became_peered":"2024-02-17T00:36:38.052051+0000","last_unstale":"2024-02-17T00:36:43.096723+0000","last_undegraded":"2024-02-17T00:36:43.096723+0000","last_fullsized":"2024-02-17T00:36:43.096723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831372+0000","last_change":"2024-02-17T00:36:37.032305+0000","last_active":"2024-02-17T00:36:43.831372+0000","last_peered":"2024-02-17T00:36:43.831372+0000","last_clean":"2024-02-17T00:36:43.831372+0000","last_became_active":"2024-02-17T00:36:37.031977+0000","last_became_peered":"2024-02-17T00:36:37.031977+0000","last_unstale":"2024-02-17T00:36:43.831372+0000","last_undegraded":"2024-02-17T00:36:43.831372+0000","last_fullsized":"2024-02-17T00:36:43.831372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:45.670660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831564+0000","last_change":"2024-02-17T00:36:37.037062+0000","last_active":"2024-02-17T00:36:43.831564+0000","last_peered":"2024-02-17T00:36:43.831564+0000","last_clean":"2024-02-17T00:36:43.831564+0000","last_became_active":"2024-02-17T00:36:37.036814+0000","last_became_peered":"2024-02-17T00:36:37.036814+0000","last_unstale":"2024-02-17T00:36:43.831564+0000","last_undegraded":"2024-02-17T00:36:43.831564+0000","last_fullsized":"2024-02-17T00:36:43.831564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831622+0000","last_change":"2024-02-17T00:36:38.055091+0000","last_active":"2024-02-17T00:36:43.831622+0000","last_peered":"2024-02-17T00:36:43.831622+0000","last_clean":"2024-02-17T00:36:43.831622+0000","last_became_active":"2024-02-17T00:36:38.054773+0000","last_became_peered":"2024-02-17T00:36:38.054773+0000","last_unstale":"2024-02-17T00:36:43.831622+0000","last_undegraded":"2024-02-17T00:36:43.831622+0000","last_fullsized":"2024-02-17T00:36:43.831622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831612+0000","last_change":"2024-02-17T00:36:42.103625+0000","last_active":"2024-02-17T00:36:43.831612+0000","last_peered":"2024-02-17T00:36:43.831612+0000","last_clean":"2024-02-17T00:36:43.831612+0000","last_became_active":"2024-02-17T00:36:42.103248+0000","last_became_peered":"2024-02-17T00:36:42.103248+0000","last_unstale":"2024-02-17T00:36:43.831612+0000","last_undegraded":"2024-02-17T00:36:43.831612+0000","last_fullsized":"2024-02-17T00:36:43.831612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096932+0000","last_change":"2024-02-17T00:36:37.030983+0000","last_active":"2024-02-17T00:36:43.096932+0000","last_peered":"2024-02-17T00:36:43.096932+0000","last_clean":"2024-02-17T00:36:43.096932+0000","last_became_active":"2024-02-17T00:36:37.028330+0000","last_became_peered":"2024-02-17T00:36:37.028330+0000","last_unstale":"2024-02-17T00:36:43.096932+0000","last_undegraded":"2024-02-17T00:36:43.096932+0000","last_fullsized":"2024-02-17T00:36:43.096932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069391+0000","last_change":"2024-02-17T00:36:38.049295+0000","last_active":"2024-02-17T00:36:43.069391+0000","last_peered":"2024-02-17T00:36:43.069391+0000","last_clean":"2024-02-17T00:36:43.069391+0000","last_became_active":"2024-02-17T00:36:38.048946+0000","last_became_peered":"2024-02-17T00:36:38.048946+0000","last_unstale":"2024-02-17T00:36:43.069391+0000","last_undegraded":"2024-02-17T00:36:43.069391+0000","last_fullsized":"2024-02-17T00:36:43.069391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069192+0000","last_change":"2024-02-17T00:36:42.105857+0000","last_active":"2024-02-17T00:36:43.069192+0000","last_peered":"2024-02-17T00:36:43.069192+0000","last_clean":"2024-02-17T00:36:43.069192+0000","last_became_active":"2024-02-17T00:36:42.105256+0000","last_became_peered":"2024-02-17T00:36:42.105256+0000","last_unstale":"2024-02-17T00:36:43.069192+0000","last_undegraded":"2024-02-17T00:36:43.069192+0000","last_fullsized":"2024-02-17T00:36:43.069192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:00:11.474820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068081+0000","last_change":"2024-02-17T00:36:38.040290+0000","last_active":"2024-02-17T00:36:43.068081+0000","last_peered":"2024-02-17T00:36:43.068081+0000","last_clean":"2024-02-17T00:36:43.068081+0000","last_became_active":"2024-02-17T00:36:38.039955+0000","last_became_peered":"2024-02-17T00:36:38.039955+0000","last_unstale":"2024-02-17T00:36:43.068081+0000","last_undegraded":"2024-02-17T00:36:43.068081+0000","last_fullsized":"2024-02-17T00:36:43.068081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068817+0000","last_change":"2024-02-17T00:36:38.056307+0000","last_active":"2024-02-17T00:36:43.068817+0000","last_peered":"2024-02-17T00:36:43.068817+0000","last_clean":"2024-02-17T00:36:43.068817+0000","last_became_active":"2024-02-17T00:36:38.055992+0000","last_became_peered":"2024-02-17T00:36:38.055992+0000","last_unstale":"2024-02-17T00:36:43.068817+0000","last_undegraded":"2024-02-17T00:36:43.068817+0000","last_fullsized":"2024-02-17T00:36:43.068817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:56:01.530703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831314+0000","last_change":"2024-02-17T00:36:38.043893+0000","last_active":"2024-02-17T00:36:43.831314+0000","last_peered":"2024-02-17T00:36:43.831314+0000","last_clean":"2024-02-17T00:36:43.831314+0000","last_became_active":"2024-02-17T00:36:38.043507+0000","last_became_peered":"2024-02-17T00:36:38.043507+0000","last_unstale":"2024-02-17T00:36:43.831314+0000","last_undegraded":"2024-02-17T00:36:43.831314+0000","last_fullsized":"2024-02-17T00:36:43.831314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:57:48.954988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096825+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.096825+0000","last_peered":"2024-02-17T00:36:43.096825+0000","last_clean":"2024-02-17T00:36:43.096825+0000","last_became_active":"2024-02-17T00:36:38.057544+0000","last_became_peered":"2024-02-17T00:36:38.057544+0000","last_unstale":"2024-02-17T00:36:43.096825+0000","last_undegraded":"2024-02-17T00:36:43.096825+0000","last_fullsized":"2024-02-17T00:36:43.096825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832520+0000","last_change":"2024-02-17T00:36:38.054267+0000","last_active":"2024-02-17T00:36:43.832520+0000","last_peered":"2024-02-17T00:36:43.832520+0000","last_clean":"2024-02-17T00:36:43.832520+0000","last_became_active":"2024-02-17T00:36:38.053966+0000","last_became_peered":"2024-02-17T00:36:38.053966+0000","last_unstale":"2024-02-17T00:36:43.832520+0000","last_undegraded":"2024-02-17T00:36:43.832520+0000","last_fullsized":"2024-02-17T00:36:43.832520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831587+0000","last_change":"2024-02-17T00:36:38.056442+0000","last_active":"2024-02-17T00:36:43.831587+0000","last_peered":"2024-02-17T00:36:43.831587+0000","last_clean":"2024-02-17T00:36:43.831587+0000","last_became_active":"2024-02-17T00:36:38.056049+0000","last_became_peered":"2024-02-17T00:36:38.056049+0000","last_unstale":"2024-02-17T00:36:43.831587+0000","last_undegraded":"2024-02-17T00:36:43.831587+0000","last_fullsized":"2024-02-17T00:36:43.831587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068812+0000","last_change":"2024-02-17T00:36:38.036181+0000","last_active":"2024-02-17T00:36:43.068812+0000","last_peered":"2024-02-17T00:36:43.068812+0000","last_clean":"2024-02-17T00:36:43.068812+0000","last_became_active":"2024-02-17T00:36:38.035881+0000","last_became_peered":"2024-02-17T00:36:38.035881+0000","last_unstale":"2024-02-17T00:36:43.068812+0000","last_undegraded":"2024-02-17T00:36:43.068812+0000","last_fullsized":"2024-02-17T00:36:43.068812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097279+0000","last_change":"2024-02-17T00:36:38.049793+0000","last_active":"2024-02-17T00:36:43.097279+0000","last_peered":"2024-02-17T00:36:43.097279+0000","last_clean":"2024-02-17T00:36:43.097279+0000","last_became_active":"2024-02-17T00:36:38.049216+0000","last_became_peered":"2024-02-17T00:36:38.049216+0000","last_unstale":"2024-02-17T00:36:43.097279+0000","last_undegraded":"2024-02-17T00:36:43.097279+0000","last_fullsized":"2024-02-17T00:36:43.097279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830904+0000","last_change":"2024-02-17T00:36:38.047085+0000","last_active":"2024-02-17T00:36:43.830904+0000","last_peered":"2024-02-17T00:36:43.830904+0000","last_clean":"2024-02-17T00:36:43.830904+0000","last_became_active":"2024-02-17T00:36:38.046375+0000","last_became_peered":"2024-02-17T00:36:38.046375+0000","last_unstale":"2024-02-17T00:36:43.830904+0000","last_undegraded":"2024-02-17T00:36:43.830904+0000","last_fullsized":"2024-02-17T00:36:43.830904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096697+0000","last_change":"2024-02-17T00:36:38.054777+0000","last_active":"2024-02-17T00:36:43.096697+0000","last_peered":"2024-02-17T00:36:43.096697+0000","last_clean":"2024-02-17T00:36:43.096697+0000","last_became_active":"2024-02-17T00:36:38.054520+0000","last_became_peered":"2024-02-17T00:36:38.054520+0000","last_unstale":"2024-02-17T00:36:43.096697+0000","last_undegraded":"2024-02-17T00:36:43.096697+0000","last_fullsized":"2024-02-17T00:36:43.096697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069328+0000","last_change":"2024-02-17T00:36:38.054174+0000","last_active":"2024-02-17T00:36:43.069328+0000","last_peered":"2024-02-17T00:36:43.069328+0000","last_clean":"2024-02-17T00:36:43.069328+0000","last_became_active":"2024-02-17T00:36:38.053849+0000","last_became_peered":"2024-02-17T00:36:38.053849+0000","last_unstale":"2024-02-17T00:36:43.069328+0000","last_undegraded":"2024-02-17T00:36:43.069328+0000","last_fullsized":"2024-02-17T00:36:43.069328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831711+0000","last_change":"2024-02-17T00:36:38.040949+0000","last_active":"2024-02-17T00:36:43.831711+0000","last_peered":"2024-02-17T00:36:43.831711+0000","last_clean":"2024-02-17T00:36:43.831711+0000","last_became_active":"2024-02-17T00:36:38.040638+0000","last_became_peered":"2024-02-17T00:36:38.040638+0000","last_unstale":"2024-02-17T00:36:43.831711+0000","last_undegraded":"2024-02-17T00:36:43.831711+0000","last_fullsized":"2024-02-17T00:36:43.831711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831857+0000","last_change":"2024-02-17T00:36:38.059813+0000","last_active":"2024-02-17T00:36:43.831857+0000","last_peered":"2024-02-17T00:36:43.831857+0000","last_clean":"2024-02-17T00:36:43.831857+0000","last_became_active":"2024-02-17T00:36:38.059568+0000","last_became_peered":"2024-02-17T00:36:38.059568+0000","last_unstale":"2024-02-17T00:36:43.831857+0000","last_undegraded":"2024-02-17T00:36:43.831857+0000","last_fullsized":"2024-02-17T00:36:43.831857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832389+0000","last_change":"2024-02-17T00:36:38.054049+0000","last_active":"2024-02-17T00:36:43.832389+0000","last_peered":"2024-02-17T00:36:43.832389+0000","last_clean":"2024-02-17T00:36:43.832389+0000","last_became_active":"2024-02-17T00:36:38.053785+0000","last_became_peered":"2024-02-17T00:36:38.053785+0000","last_unstale":"2024-02-17T00:36:43.832389+0000","last_undegraded":"2024-02-17T00:36:43.832389+0000","last_fullsized":"2024-02-17T00:36:43.832389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:46.428346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069734+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.069734+0000","last_peered":"2024-02-17T00:36:43.069734+0000","last_clean":"2024-02-17T00:36:43.069734+0000","last_became_active":"2024-02-17T00:36:38.057512+0000","last_became_peered":"2024-02-17T00:36:38.057512+0000","last_unstale":"2024-02-17T00:36:43.069734+0000","last_undegraded":"2024-02-17T00:36:43.069734+0000","last_fullsized":"2024-02-17T00:36:43.069734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:06:22.484806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832454+0000","last_change":"2024-02-17T00:36:38.055783+0000","last_active":"2024-02-17T00:36:43.832454+0000","last_peered":"2024-02-17T00:36:43.832454+0000","last_clean":"2024-02-17T00:36:43.832454+0000","last_became_active":"2024-02-17T00:36:38.055520+0000","last_became_peered":"2024-02-17T00:36:38.055520+0000","last_unstale":"2024-02-17T00:36:43.832454+0000","last_undegraded":"2024-02-17T00:36:43.832454+0000","last_fullsized":"2024-02-17T00:36:43.832454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:36.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830805+0000","last_change":"2024-02-17T00:36:38.041377+0000","last_active":"2024-02-17T00:36:43.830805+0000","last_peered":"2024-02-17T00:36:43.830805+0000","last_clean":"2024-02-17T00:36:43.830805+0000","last_became_active":"2024-02-17T00:36:38.041081+0000","last_became_peered":"2024-02-17T00:36:38.041081+0000","last_unstale":"2024-02-17T00:36:43.830805+0000","last_undegraded":"2024-02-17T00:36:43.830805+0000","last_fullsized":"2024-02-17T00:36:43.830805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096497+0000","last_change":"2024-02-17T00:36:38.054101+0000","last_active":"2024-02-17T00:36:43.096497+0000","last_peered":"2024-02-17T00:36:43.096497+0000","last_clean":"2024-02-17T00:36:43.096497+0000","last_became_active":"2024-02-17T00:36:38.053820+0000","last_became_peered":"2024-02-17T00:36:38.053820+0000","last_unstale":"2024-02-17T00:36:43.096497+0000","last_undegraded":"2024-02-17T00:36:43.096497+0000","last_fullsized":"2024-02-17T00:36:43.096497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831862+0000","last_change":"2024-02-17T00:36:38.051075+0000","last_active":"2024-02-17T00:36:43.831862+0000","last_peered":"2024-02-17T00:36:43.831862+0000","last_clean":"2024-02-17T00:36:43.831862+0000","last_became_active":"2024-02-17T00:36:38.050786+0000","last_became_peered":"2024-02-17T00:36:38.050786+0000","last_unstale":"2024-02-17T00:36:43.831862+0000","last_undegraded":"2024-02-17T00:36:43.831862+0000","last_fullsized":"2024-02-17T00:36:43.831862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832457+0000","last_change":"2024-02-17T00:36:38.053472+0000","last_active":"2024-02-17T00:36:43.832457+0000","last_peered":"2024-02-17T00:36:43.832457+0000","last_clean":"2024-02-17T00:36:43.832457+0000","last_became_active":"2024-02-17T00:36:38.053183+0000","last_became_peered":"2024-02-17T00:36:38.053183+0000","last_unstale":"2024-02-17T00:36:43.832457+0000","last_undegraded":"2024-02-17T00:36:43.832457+0000","last_fullsized":"2024-02-17T00:36:43.832457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831779+0000","last_change":"2024-02-17T00:36:38.061499+0000","last_active":"2024-02-17T00:36:43.831779+0000","last_peered":"2024-02-17T00:36:43.831779+0000","last_clean":"2024-02-17T00:36:43.831779+0000","last_became_active":"2024-02-17T00:36:38.061179+0000","last_became_peered":"2024-02-17T00:36:38.061179+0000","last_unstale":"2024-02-17T00:36:43.831779+0000","last_undegraded":"2024-02-17T00:36:43.831779+0000","last_fullsized":"2024-02-17T00:36:43.831779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830928+0000","last_change":"2024-02-17T00:36:38.060993+0000","last_active":"2024-02-17T00:36:43.830928+0000","last_peered":"2024-02-17T00:36:43.830928+0000","last_clean":"2024-02-17T00:36:43.830928+0000","last_became_active":"2024-02-17T00:36:38.060363+0000","last_became_peered":"2024-02-17T00:36:38.060363+0000","last_unstale":"2024-02-17T00:36:43.830928+0000","last_undegraded":"2024-02-17T00:36:43.830928+0000","last_fullsized":"2024-02-17T00:36:43.830928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830894+0000","last_change":"2024-02-17T00:36:38.064745+0000","last_active":"2024-02-17T00:36:43.830894+0000","last_peered":"2024-02-17T00:36:43.830894+0000","last_clean":"2024-02-17T00:36:43.830894+0000","last_became_active":"2024-02-17T00:36:38.064474+0000","last_became_peered":"2024-02-17T00:36:38.064474+0000","last_unstale":"2024-02-17T00:36:43.830894+0000","last_undegraded":"2024-02-17T00:36:43.830894+0000","last_fullsized":"2024-02-17T00:36:43.830894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070025+0000","last_change":"2024-02-17T00:36:38.045388+0000","last_active":"2024-02-17T00:36:43.070025+0000","last_peered":"2024-02-17T00:36:43.070025+0000","last_clean":"2024-02-17T00:36:43.070025+0000","last_became_active":"2024-02-17T00:36:38.045025+0000","last_became_peered":"2024-02-17T00:36:38.045025+0000","last_unstale":"2024-02-17T00:36:43.070025+0000","last_undegraded":"2024-02-17T00:36:43.070025+0000","last_fullsized":"2024-02-17T00:36:43.070025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:27.545648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096470+0000","last_change":"2024-02-17T00:36:38.060065+0000","last_active":"2024-02-17T00:36:43.096470+0000","last_peered":"2024-02-17T00:36:43.096470+0000","last_clean":"2024-02-17T00:36:43.096470+0000","last_became_active":"2024-02-17T00:36:38.058856+0000","last_became_peered":"2024-02-17T00:36:38.058856+0000","last_unstale":"2024-02-17T00:36:43.096470+0000","last_undegraded":"2024-02-17T00:36:43.096470+0000","last_fullsized":"2024-02-17T00:36:43.096470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830615+0000","last_change":"2024-02-17T00:36:38.049156+0000","last_active":"2024-02-17T00:36:43.830615+0000","last_peered":"2024-02-17T00:36:43.830615+0000","last_clean":"2024-02-17T00:36:43.830615+0000","last_became_active":"2024-02-17T00:36:38.048871+0000","last_became_peered":"2024-02-17T00:36:38.048871+0000","last_unstale":"2024-02-17T00:36:43.830615+0000","last_undegraded":"2024-02-17T00:36:43.830615+0000","last_fullsized":"2024-02-17T00:36:43.830615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068418+0000","last_change":"2024-02-17T00:36:38.043709+0000","last_active":"2024-02-17T00:36:43.068418+0000","last_peered":"2024-02-17T00:36:43.068418+0000","last_clean":"2024-02-17T00:36:43.068418+0000","last_became_active":"2024-02-17T00:36:38.043021+0000","last_became_peered":"2024-02-17T00:36:38.043021+0000","last_unstale":"2024-02-17T00:36:43.068418+0000","last_undegraded":"2024-02-17T00:36:43.068418+0000","last_fullsized":"2024-02-17T00:36:43.068418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831338+0000","last_change":"2024-02-17T00:36:38.051762+0000","last_active":"2024-02-17T00:36:43.831338+0000","last_peered":"2024-02-17T00:36:43.831338+0000","last_clean":"2024-02-17T00:36:43.831338+0000","last_became_active":"2024-02-17T00:36:38.050858+0000","last_became_peered":"2024-02-17T00:36:38.050858+0000","last_unstale":"2024-02-17T00:36:43.831338+0000","last_undegraded":"2024-02-17T00:36:43.831338+0000","last_fullsized":"2024-02-17T00:36:43.831338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068278+0000","last_change":"2024-02-17T00:36:38.052747+0000","last_active":"2024-02-17T00:36:43.068278+0000","last_peered":"2024-02-17T00:36:43.068278+0000","last_clean":"2024-02-17T00:36:43.068278+0000","last_became_active":"2024-02-17T00:36:38.052427+0000","last_became_peered":"2024-02-17T00:36:38.052427+0000","last_unstale":"2024-02-17T00:36:43.068278+0000","last_undegraded":"2024-02-17T00:36:43.068278+0000","last_fullsized":"2024-02-17T00:36:43.068278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097083+0000","last_change":"2024-02-17T00:36:38.050783+0000","last_active":"2024-02-17T00:36:43.097083+0000","last_peered":"2024-02-17T00:36:43.097083+0000","last_clean":"2024-02-17T00:36:43.097083+0000","last_became_active":"2024-02-17T00:36:38.050517+0000","last_became_peered":"2024-02-17T00:36:38.050517+0000","last_unstale":"2024-02-17T00:36:43.097083+0000","last_undegraded":"2024-02-17T00:36:43.097083+0000","last_fullsized":"2024-02-17T00:36:43.097083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097293+0000","last_change":"2024-02-17T00:36:38.052397+0000","last_active":"2024-02-17T00:36:43.097293+0000","last_peered":"2024-02-17T00:36:43.097293+0000","last_clean":"2024-02-17T00:36:43.097293+0000","last_became_active":"2024-02-17T00:36:38.052096+0000","last_became_peered":"2024-02-17T00:36:38.052096+0000","last_unstale":"2024-02-17T00:36:43.097293+0000","last_undegraded":"2024-02-17T00:36:43.097293+0000","last_fullsized":"2024-02-17T00:36:43.097293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831341+0000","last_change":"2024-02-17T00:36:38.054432+0000","last_active":"2024-02-17T00:36:43.831341+0000","last_peered":"2024-02-17T00:36:43.831341+0000","last_clean":"2024-02-17T00:36:43.831341+0000","last_became_active":"2024-02-17T00:36:38.054152+0000","last_became_peered":"2024-02-17T00:36:38.054152+0000","last_unstale":"2024-02-17T00:36:43.831341+0000","last_undegraded":"2024-02-17T00:36:43.831341+0000","last_fullsized":"2024-02-17T00:36:43.831341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:01.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:01.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.262+0000 7f28c4288640 1 Processor -- start 2024-02-17T00:37:01.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.262+0000 7f28c4288640 1 -- start start 2024-02-17T00:37:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c4288640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c4288640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28bc0b6a40 0x7f28bc0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c4288640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc15e0e0 con 0x7f28bc06bfb0 2024-02-17T00:37:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c4288640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc06cfe0 con 0x7f28bc0b6a40 2024-02-17T00:37:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c4288640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc06cd00 con 0x7f28bc15dd00 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c1823640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28bc0b6a40 0x7f28bc0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c2825640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f28bc06bfb0 0x7f28bc06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38652/0 (socket says 172.21.15.32:38652) 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c2825640 1 -- 172.21.15.32:0/604374499 learned_addr learned my addr 172.21.15.32:0/604374499 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c1823640 1 -- 172.21.15.32:0/604374499 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 msgr2=0x7f28bc0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c2024640 1 --2- 172.21.15.32:0/604374499 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c1823640 1 --2- 172.21.15.32:0/604374499 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c1823640 1 -- 172.21.15.32:0/604374499 >> v1:172.21.15.32:6789/0 conn(0x7f28bc06bfb0 legacy=0x7f28bc06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c1022640 1 -- 172.21.15.32:0/604374499 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782540216 0 0) 0x7f28b4001490 con 0x7f28bc06bfb0 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.263+0000 7f28c1823640 1 -- 172.21.15.32:0/604374499 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0d1ca0 con 0x7f28bc0b6a40 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.264+0000 7f28c1823640 1 --2- 172.21.15.32:0/604374499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0b5c90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0097a0 tx=0x7f28ac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f35ec8ebda50702 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.264+0000 7f28c1022640 1 -- 172.21.15.32:0/604374499 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac030610 con 0x7f28bc0b6a40 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.264+0000 7f28c1022640 1 -- 172.21.15.32:0/604374499 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac030770 con 0x7f28bc0b6a40 2024-02-17T00:37:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.264+0000 7f28c1022640 1 -- 172.21.15.32:0/604374499 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac030b00 con 0x7f28bc0b6a40 2024-02-17T00:37:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 -- 172.21.15.32:0/604374499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 msgr2=0x7f28bc0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 --2- 172.21.15.32:0/604374499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0b5c90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0097a0 tx=0x7f28ac02b960 comp rx=0 tx=0).stop 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 -- 172.21.15.32:0/604374499 shutdown_connections 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 --2- 172.21.15.32:0/604374499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0b5c90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 --2- 172.21.15.32:0/604374499 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 -- 172.21.15.32:0/604374499 >> 172.21.15.32:0/604374499 conn(0x7f28bc0d07b0 msgr2=0x7f28bc0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 -- 172.21.15.32:0/604374499 shutdown_connections 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.265+0000 7f28c4288640 1 -- 172.21.15.32:0/604374499 wait complete. 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.266+0000 7f28c4288640 1 Processor -- start 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.266+0000 7f28c4288640 1 -- start start 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c4288640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28bc06bfb0 0x7f28bc0b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c4288640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c4288640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c4288640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0ca9e0 con 0x7f28bc0b6a40 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c4288640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc160690 con 0x7f28bc06bfb0 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c4288640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc160970 con 0x7f28bc15dd00 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58528/0 (socket says 172.21.15.32:58528) 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 -- 172.21.15.32:0/617941570 learned_addr learned my addr 172.21.15.32:0/617941570 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c2825640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c2024640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28bc06bfb0 0x7f28bc0b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 -- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 msgr2=0x7f28bc0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 -- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28bc06bfb0 msgr2=0x7f28bc0b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28bc06bfb0 0x7f28bc0b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 -- 172.21.15.32:0/617941570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac009400 con 0x7f28bc0b6a40 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28c1823640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0c9080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f28ac02bf70 tx=0x7f28ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.267+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac03e040 con 0x7f28bc0b6a40 2024-02-17T00:37:01.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.268+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac039cb0 con 0x7f28bc0b6a40 2024-02-17T00:37:01.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.268+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc160c50 con 0x7f28bc0b6a40 2024-02-17T00:37:01.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.268+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac044630 con 0x7f28bc0b6a40 2024-02-17T00:37:01.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.268+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0b8b30 con 0x7f28bc0b6a40 2024-02-17T00:37:01.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.269+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc0b8d20 con 0x7f28bc0b6a40 2024-02-17T00:37:01.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.269+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f28ac04d3b0 con 0x7f28bc0b6a40 2024-02-17T00:37:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.269+0000 7f28b2ffd640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f28a006b810 0x7f28a006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.269+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f28ac0acb40 con 0x7f28bc0b6a40 2024-02-17T00:37:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.270+0000 7f28c2024640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f28a006b810 0x7f28a006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.270+0000 7f28c2024640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f28a006b810 0x7f28a006dcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28bc1f6f00 tx=0x7f28b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.274+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28ac077220 con 0x7f28bc0b6a40 2024-02-17T00:37:01.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.451+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28bc154660 con 0x7f28a006b810 2024-02-17T00:37:01.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.461+0000 7f28b2ffd640 1 -- 172.21.15.32:0/617941570 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345271 (secure 0 0 0) 0x7f28bc154660 con 0x7f28a006b810 2024-02-17T00:37:01.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:01.469 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f28a006b810 msgr2=0x7f28a006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f28a006b810 0x7f28a006dcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28bc1f6f00 tx=0x7f28b8008040 comp rx=0 tx=0).stop 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 msgr2=0x7f28bc0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0c9080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f28ac02bf70 tx=0x7f28ac004730 comp rx=0 tx=0).stop 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 shutdown_connections 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f28a006b810 0x7f28a006dcd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f28bc15dd00 0x7f28bc0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28bc0b6a40 0x7f28bc0c9080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 --2- 172.21.15.32:0/617941570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28bc06bfb0 0x7f28bc0b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 >> 172.21.15.32:0/617941570 conn(0x7f28bc0d07b0 msgr2=0x7f28bc0b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 shutdown_connections 2024-02-17T00:37:01.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.464+0000 7f28c4288640 1 -- 172.21.15.32:0/617941570 wait complete. 2024-02-17T00:37:01.477 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-02-17T00:36:59.950940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248732,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725988,"statfs":{"total":773094113280,"available":772839411712,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003158"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831592+0000","last_change":"2024-02-17T00:36:37.030662+0000","last_active":"2024-02-17T00:36:43.831592+0000","last_peered":"2024-02-17T00:36:43.831592+0000","last_clean":"2024-02-17T00:36:43.831592+0000","last_became_active":"2024-02-17T00:36:37.030370+0000","last_became_peered":"2024-02-17T00:36:37.030370+0000","last_unstale":"2024-02-17T00:36:43.831592+0000","last_undegraded":"2024-02-17T00:36:43.831592+0000","last_fullsized":"2024-02-17T00:36:43.831592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097375+0000","last_change":"2024-02-17T00:36:38.055521+0000","last_active":"2024-02-17T00:36:43.097375+0000","last_peered":"2024-02-17T00:36:43.097375+0000","last_clean":"2024-02-17T00:36:43.097375+0000","last_became_active":"2024-02-17T00:36:38.054923+0000","last_became_peered":"2024-02-17T00:36:38.054923+0000","last_unstale":"2024-02-17T00:36:43.097375+0000","last_undegraded":"2024-02-17T00:36:43.097375+0000","last_fullsized":"2024-02-17T00:36:43.097375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068785+0000","last_change":"2024-02-17T00:36:42.106155+0000","last_active":"2024-02-17T00:36:43.068785+0000","last_peered":"2024-02-17T00:36:43.068785+0000","last_clean":"2024-02-17T00:36:43.068785+0000","last_became_active":"2024-02-17T00:36:42.105538+0000","last_became_peered":"2024-02-17T00:36:42.105538+0000","last_unstale":"2024-02-17T00:36:43.068785+0000","last_undegraded":"2024-02-17T00:36:43.068785+0000","last_fullsized":"2024-02-17T00:36:43.068785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:31:04.425166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097461+0000","last_change":"2024-02-17T00:36:37.028529+0000","last_active":"2024-02-17T00:36:43.097461+0000","last_peered":"2024-02-17T00:36:43.097461+0000","last_clean":"2024-02-17T00:36:43.097461+0000","last_became_active":"2024-02-17T00:36:37.027869+0000","last_became_peered":"2024-02-17T00:36:37.027869+0000","last_unstale":"2024-02-17T00:36:43.097461+0000","last_undegraded":"2024-02-17T00:36:43.097461+0000","last_fullsized":"2024-02-17T00:36:43.097461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097406+0000","last_change":"2024-02-17T00:36:38.049523+0000","last_active":"2024-02-17T00:36:43.097406+0000","last_peered":"2024-02-17T00:36:43.097406+0000","last_clean":"2024-02-17T00:36:43.097406+0000","last_became_active":"2024-02-17T00:36:38.048836+0000","last_became_peered":"2024-02-17T00:36:38.048836+0000","last_unstale":"2024-02-17T00:36:43.097406+0000","last_undegraded":"2024-02-17T00:36:43.097406+0000","last_fullsized":"2024-02-17T00:36:43.097406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068282+0000","last_change":"2024-02-17T00:36:42.106437+0000","last_active":"2024-02-17T00:36:43.068282+0000","last_peered":"2024-02-17T00:36:43.068282+0000","last_clean":"2024-02-17T00:36:43.068282+0000","last_became_active":"2024-02-17T00:36:42.105260+0000","last_became_peered":"2024-02-17T00:36:42.105260+0000","last_unstale":"2024-02-17T00:36:43.068282+0000","last_undegraded":"2024-02-17T00:36:43.068282+0000","last_fullsized":"2024-02-17T00:36:43.068282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:43.059445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831042+0000","last_change":"2024-02-17T00:36:37.031714+0000","last_active":"2024-02-17T00:36:43.831042+0000","last_peered":"2024-02-17T00:36:43.831042+0000","last_clean":"2024-02-17T00:36:43.831042+0000","last_became_active":"2024-02-17T00:36:37.031420+0000","last_became_peered":"2024-02-17T00:36:37.031420+0000","last_unstale":"2024-02-17T00:36:43.831042+0000","last_undegraded":"2024-02-17T00:36:43.831042+0000","last_fullsized":"2024-02-17T00:36:43.831042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069643+0000","last_change":"2024-02-17T00:36:38.056370+0000","last_active":"2024-02-17T00:36:43.069643+0000","last_peered":"2024-02-17T00:36:43.069643+0000","last_clean":"2024-02-17T00:36:43.069643+0000","last_became_active":"2024-02-17T00:36:38.056088+0000","last_became_peered":"2024-02-17T00:36:38.056088+0000","last_unstale":"2024-02-17T00:36:43.069643+0000","last_undegraded":"2024-02-17T00:36:43.069643+0000","last_fullsized":"2024-02-17T00:36:43.069643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068302+0000","last_change":"2024-02-17T00:36:42.102716+0000","last_active":"2024-02-17T00:36:43.068302+0000","last_peered":"2024-02-17T00:36:43.068302+0000","last_clean":"2024-02-17T00:36:43.068302+0000","last_became_active":"2024-02-17T00:36:42.102320+0000","last_became_peered":"2024-02-17T00:36:42.102320+0000","last_unstale":"2024-02-17T00:36:43.068302+0000","last_undegraded":"2024-02-17T00:36:43.068302+0000","last_fullsized":"2024-02-17T00:36:43.068302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832076+0000","last_change":"2024-02-17T00:36:37.030968+0000","last_active":"2024-02-17T00:36:43.832076+0000","last_peered":"2024-02-17T00:36:43.832076+0000","last_clean":"2024-02-17T00:36:43.832076+0000","last_became_active":"2024-02-17T00:36:37.030633+0000","last_became_peered":"2024-02-17T00:36:37.030633+0000","last_unstale":"2024-02-17T00:36:43.832076+0000","last_undegraded":"2024-02-17T00:36:43.832076+0000","last_fullsized":"2024-02-17T00:36:43.832076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832222+0000","last_change":"2024-02-17T00:36:38.059509+0000","last_active":"2024-02-17T00:36:43.832222+0000","last_peered":"2024-02-17T00:36:43.832222+0000","last_clean":"2024-02-17T00:36:43.832222+0000","last_became_active":"2024-02-17T00:36:38.059254+0000","last_became_peered":"2024-02-17T00:36:38.059254+0000","last_unstale":"2024-02-17T00:36:43.832222+0000","last_undegraded":"2024-02-17T00:36:43.832222+0000","last_fullsized":"2024-02-17T00:36:43.832222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:03.666531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068026+0000","last_change":"2024-02-17T00:36:42.104635+0000","last_active":"2024-02-17T00:36:43.068026+0000","last_peered":"2024-02-17T00:36:43.068026+0000","last_clean":"2024-02-17T00:36:43.068026+0000","last_became_active":"2024-02-17T00:36:42.104078+0000","last_became_peered":"2024-02-17T00:36:42.104078+0000","last_unstale":"2024-02-17T00:36:43.068026+0000","last_undegraded":"2024-02-17T00:36:43.068026+0000","last_fullsized":"2024-02-17T00:36:43.068026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831402+0000","last_change":"2024-02-17T00:36:38.044922+0000","last_active":"2024-02-17T00:36:43.831402+0000","last_peered":"2024-02-17T00:36:43.831402+0000","last_clean":"2024-02-17T00:36:43.831402+0000","last_became_active":"2024-02-17T00:36:38.044635+0000","last_became_peered":"2024-02-17T00:36:38.044635+0000","last_unstale":"2024-02-17T00:36:43.831402+0000","last_undegraded":"2024-02-17T00:36:43.831402+0000","last_fullsized":"2024-02-17T00:36:43.831402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:07:57.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831908+0000","last_change":"2024-02-17T00:36:37.027914+0000","last_active":"2024-02-17T00:36:43.831908+0000","last_peered":"2024-02-17T00:36:43.831908+0000","last_clean":"2024-02-17T00:36:43.831908+0000","last_became_active":"2024-02-17T00:36:37.027428+0000","last_became_peered":"2024-02-17T00:36:37.027428+0000","last_unstale":"2024-02-17T00:36:43.831908+0000","last_undegraded":"2024-02-17T00:36:43.831908+0000","last_fullsized":"2024-02-17T00:36:43.831908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:41.254351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832120+0000","last_change":"2024-02-17T00:36:42.112759+0000","last_active":"2024-02-17T00:36:43.832120+0000","last_peered":"2024-02-17T00:36:43.832120+0000","last_clean":"2024-02-17T00:36:43.832120+0000","last_became_active":"2024-02-17T00:36:42.112040+0000","last_became_peered":"2024-02-17T00:36:42.112040+0000","last_unstale":"2024-02-17T00:36:43.832120+0000","last_undegraded":"2024-02-17T00:36:43.832120+0000","last_fullsized":"2024-02-17T00:36:43.832120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:15.987819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069089+0000","last_change":"2024-02-17T00:36:38.057079+0000","last_active":"2024-02-17T00:36:43.069089+0000","last_peered":"2024-02-17T00:36:43.069089+0000","last_clean":"2024-02-17T00:36:43.069089+0000","last_became_active":"2024-02-17T00:36:38.056788+0000","last_became_peered":"2024-02-17T00:36:38.056788+0000","last_unstale":"2024-02-17T00:36:43.069089+0000","last_undegraded":"2024-02-17T00:36:43.069089+0000","last_fullsized":"2024-02-17T00:36:43.069089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:56:11.007052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832223+0000","last_change":"2024-02-17T00:36:37.032242+0000","last_active":"2024-02-17T00:36:43.832223+0000","last_peered":"2024-02-17T00:36:43.832223+0000","last_clean":"2024-02-17T00:36:43.832223+0000","last_became_active":"2024-02-17T00:36:37.031951+0000","last_became_peered":"2024-02-17T00:36:37.031951+0000","last_unstale":"2024-02-17T00:36:43.832223+0000","last_undegraded":"2024-02-17T00:36:43.832223+0000","last_fullsized":"2024-02-17T00:36:43.832223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831617+0000","last_change":"2024-02-17T00:36:42.105780+0000","last_active":"2024-02-17T00:36:43.831617+0000","last_peered":"2024-02-17T00:36:43.831617+0000","last_clean":"2024-02-17T00:36:43.831617+0000","last_became_active":"2024-02-17T00:36:42.105405+0000","last_became_peered":"2024-02-17T00:36:42.105405+0000","last_unstale":"2024-02-17T00:36:43.831617+0000","last_undegraded":"2024-02-17T00:36:43.831617+0000","last_fullsized":"2024-02-17T00:36:43.831617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:40.401581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831013+0000","last_change":"2024-02-17T00:36:38.053301+0000","last_active":"2024-02-17T00:36:43.831013+0000","last_peered":"2024-02-17T00:36:43.831013+0000","last_clean":"2024-02-17T00:36:43.831013+0000","last_became_active":"2024-02-17T00:36:38.052981+0000","last_became_peered":"2024-02-17T00:36:38.052981+0000","last_unstale":"2024-02-17T00:36:43.831013+0000","last_undegraded":"2024-02-17T00:36:43.831013+0000","last_fullsized":"2024-02-17T00:36:43.831013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831734+0000","last_change":"2024-02-17T00:36:37.032841+0000","last_active":"2024-02-17T00:36:43.831734+0000","last_peered":"2024-02-17T00:36:43.831734+0000","last_clean":"2024-02-17T00:36:43.831734+0000","last_became_active":"2024-02-17T00:36:37.032569+0000","last_became_peered":"2024-02-17T00:36:37.032569+0000","last_unstale":"2024-02-17T00:36:43.831734+0000","last_undegraded":"2024-02-17T00:36:43.831734+0000","last_fullsized":"2024-02-17T00:36:43.831734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069627+0000","last_change":"2024-02-17T00:36:42.110199+0000","last_active":"2024-02-17T00:36:43.069627+0000","last_peered":"2024-02-17T00:36:43.069627+0000","last_clean":"2024-02-17T00:36:43.069627+0000","last_became_active":"2024-02-17T00:36:42.109821+0000","last_became_peered":"2024-02-17T00:36:42.109821+0000","last_unstale":"2024-02-17T00:36:43.069627+0000","last_undegraded":"2024-02-17T00:36:43.069627+0000","last_fullsized":"2024-02-17T00:36:43.069627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:09:09.535328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830918+0000","last_change":"2024-02-17T00:36:38.054753+0000","last_active":"2024-02-17T00:36:43.830918+0000","last_peered":"2024-02-17T00:36:43.830918+0000","last_clean":"2024-02-17T00:36:43.830918+0000","last_became_active":"2024-02-17T00:36:38.054461+0000","last_became_peered":"2024-02-17T00:36:38.054461+0000","last_unstale":"2024-02-17T00:36:43.830918+0000","last_undegraded":"2024-02-17T00:36:43.830918+0000","last_fullsized":"2024-02-17T00:36:43.830918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:40.337939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830476+0000","last_change":"2024-02-17T00:36:37.036152+0000","last_active":"2024-02-17T00:36:43.830476+0000","last_peered":"2024-02-17T00:36:43.830476+0000","last_clean":"2024-02-17T00:36:43.830476+0000","last_became_active":"2024-02-17T00:36:37.035247+0000","last_became_peered":"2024-02-17T00:36:37.035247+0000","last_unstale":"2024-02-17T00:36:43.830476+0000","last_undegraded":"2024-02-17T00:36:43.830476+0000","last_fullsized":"2024-02-17T00:36:43.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068880+0000","last_change":"2024-02-17T00:36:42.107390+0000","last_active":"2024-02-17T00:36:43.068880+0000","last_peered":"2024-02-17T00:36:43.068880+0000","last_clean":"2024-02-17T00:36:43.068880+0000","last_became_active":"2024-02-17T00:36:42.106991+0000","last_became_peered":"2024-02-17T00:36:42.106991+0000","last_unstale":"2024-02-17T00:36:43.068880+0000","last_undegraded":"2024-02-17T00:36:43.068880+0000","last_fullsized":"2024-02-17T00:36:43.068880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831870+0000","last_change":"2024-02-17T00:36:38.056121+0000","last_active":"2024-02-17T00:36:43.831870+0000","last_peered":"2024-02-17T00:36:43.831870+0000","last_clean":"2024-02-17T00:36:43.831870+0000","last_became_active":"2024-02-17T00:36:38.055860+0000","last_became_peered":"2024-02-17T00:36:38.055860+0000","last_unstale":"2024-02-17T00:36:43.831870+0000","last_undegraded":"2024-02-17T00:36:43.831870+0000","last_fullsized":"2024-02-17T00:36:43.831870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832500+0000","last_change":"2024-02-17T00:36:37.038395+0000","last_active":"2024-02-17T00:36:43.832500+0000","last_peered":"2024-02-17T00:36:43.832500+0000","last_clean":"2024-02-17T00:36:43.832500+0000","last_became_active":"2024-02-17T00:36:37.038139+0000","last_became_peered":"2024-02-17T00:36:37.038139+0000","last_unstale":"2024-02-17T00:36:43.832500+0000","last_undegraded":"2024-02-17T00:36:43.832500+0000","last_fullsized":"2024-02-17T00:36:43.832500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068014+0000","last_change":"2024-02-17T00:36:42.106502+0000","last_active":"2024-02-17T00:36:43.068014+0000","last_peered":"2024-02-17T00:36:43.068014+0000","last_clean":"2024-02-17T00:36:43.068014+0000","last_became_active":"2024-02-17T00:36:42.104704+0000","last_became_peered":"2024-02-17T00:36:42.104704+0000","last_unstale":"2024-02-17T00:36:43.068014+0000","last_undegraded":"2024-02-17T00:36:43.068014+0000","last_fullsized":"2024-02-17T00:36:43.068014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831529+0000","last_change":"2024-02-17T00:36:38.047108+0000","last_active":"2024-02-17T00:36:43.831529+0000","last_peered":"2024-02-17T00:36:43.831529+0000","last_clean":"2024-02-17T00:36:43.831529+0000","last_became_active":"2024-02-17T00:36:38.046838+0000","last_became_peered":"2024-02-17T00:36:38.046838+0000","last_unstale":"2024-02-17T00:36:43.831529+0000","last_undegraded":"2024-02-17T00:36:43.831529+0000","last_fullsized":"2024-02-17T00:36:43.831529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832108+0000","last_change":"2024-02-17T00:36:37.029498+0000","last_active":"2024-02-17T00:36:43.832108+0000","last_peered":"2024-02-17T00:36:43.832108+0000","last_clean":"2024-02-17T00:36:43.832108+0000","last_became_active":"2024-02-17T00:36:37.029197+0000","last_became_peered":"2024-02-17T00:36:37.029197+0000","last_unstale":"2024-02-17T00:36:43.832108+0000","last_undegraded":"2024-02-17T00:36:43.832108+0000","last_fullsized":"2024-02-17T00:36:43.832108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831904+0000","last_change":"2024-02-17T00:36:42.107429+0000","last_active":"2024-02-17T00:36:43.831904+0000","last_peered":"2024-02-17T00:36:43.831904+0000","last_clean":"2024-02-17T00:36:43.831904+0000","last_became_active":"2024-02-17T00:36:42.105692+0000","last_became_peered":"2024-02-17T00:36:42.105692+0000","last_unstale":"2024-02-17T00:36:43.831904+0000","last_undegraded":"2024-02-17T00:36:43.831904+0000","last_fullsized":"2024-02-17T00:36:43.831904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:14.318951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832572+0000","last_change":"2024-02-17T00:36:38.049191+0000","last_active":"2024-02-17T00:36:43.832572+0000","last_peered":"2024-02-17T00:36:43.832572+0000","last_clean":"2024-02-17T00:36:43.832572+0000","last_became_active":"2024-02-17T00:36:38.048889+0000","last_became_peered":"2024-02-17T00:36:38.048889+0000","last_unstale":"2024-02-17T00:36:43.832572+0000","last_undegraded":"2024-02-17T00:36:43.832572+0000","last_fullsized":"2024-02-17T00:36:43.832572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832472+0000","last_change":"2024-02-17T00:36:37.034662+0000","last_active":"2024-02-17T00:36:43.832472+0000","last_peered":"2024-02-17T00:36:43.832472+0000","last_clean":"2024-02-17T00:36:43.832472+0000","last_became_active":"2024-02-17T00:36:37.034377+0000","last_became_peered":"2024-02-17T00:36:37.034377+0000","last_unstale":"2024-02-17T00:36:43.832472+0000","last_undegraded":"2024-02-17T00:36:43.832472+0000","last_fullsized":"2024-02-17T00:36:43.832472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:46.302658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832390+0000","last_change":"2024-02-17T00:36:42.102832+0000","last_active":"2024-02-17T00:36:43.832390+0000","last_peered":"2024-02-17T00:36:43.832390+0000","last_clean":"2024-02-17T00:36:43.832390+0000","last_became_active":"2024-02-17T00:36:42.102261+0000","last_became_peered":"2024-02-17T00:36:42.102261+0000","last_unstale":"2024-02-17T00:36:43.832390+0000","last_undegraded":"2024-02-17T00:36:43.832390+0000","last_fullsized":"2024-02-17T00:36:43.832390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068321+0000","last_change":"2024-02-17T00:36:38.040343+0000","last_active":"2024-02-17T00:36:43.068321+0000","last_peered":"2024-02-17T00:36:43.068321+0000","last_clean":"2024-02-17T00:36:43.068321+0000","last_became_active":"2024-02-17T00:36:38.039985+0000","last_became_peered":"2024-02-17T00:36:38.039985+0000","last_unstale":"2024-02-17T00:36:43.068321+0000","last_undegraded":"2024-02-17T00:36:43.068321+0000","last_fullsized":"2024-02-17T00:36:43.068321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096964+0000","last_change":"2024-02-17T00:36:37.031000+0000","last_active":"2024-02-17T00:36:43.096964+0000","last_peered":"2024-02-17T00:36:43.096964+0000","last_clean":"2024-02-17T00:36:43.096964+0000","last_became_active":"2024-02-17T00:36:37.028403+0000","last_became_peered":"2024-02-17T00:36:37.028403+0000","last_unstale":"2024-02-17T00:36:43.096964+0000","last_undegraded":"2024-02-17T00:36:43.096964+0000","last_fullsized":"2024-02-17T00:36:43.096964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831801+0000","last_change":"2024-02-17T00:36:42.106983+0000","last_active":"2024-02-17T00:36:43.831801+0000","last_peered":"2024-02-17T00:36:43.831801+0000","last_clean":"2024-02-17T00:36:43.831801+0000","last_became_active":"2024-02-17T00:36:42.106220+0000","last_became_peered":"2024-02-17T00:36:42.106220+0000","last_unstale":"2024-02-17T00:36:43.831801+0000","last_undegraded":"2024-02-17T00:36:43.831801+0000","last_fullsized":"2024-02-17T00:36:43.831801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831273+0000","last_change":"2024-02-17T00:36:38.064921+0000","last_active":"2024-02-17T00:36:43.831273+0000","last_peered":"2024-02-17T00:36:43.831273+0000","last_clean":"2024-02-17T00:36:43.831273+0000","last_became_active":"2024-02-17T00:36:38.064609+0000","last_became_peered":"2024-02-17T00:36:38.064609+0000","last_unstale":"2024-02-17T00:36:43.831273+0000","last_undegraded":"2024-02-17T00:36:43.831273+0000","last_fullsized":"2024-02-17T00:36:43.831273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831743+0000","last_change":"2024-02-17T00:36:37.027393+0000","last_active":"2024-02-17T00:36:43.831743+0000","last_peered":"2024-02-17T00:36:43.831743+0000","last_clean":"2024-02-17T00:36:43.831743+0000","last_became_active":"2024-02-17T00:36:37.027115+0000","last_became_peered":"2024-02-17T00:36:37.027115+0000","last_unstale":"2024-02-17T00:36:43.831743+0000","last_undegraded":"2024-02-17T00:36:43.831743+0000","last_fullsized":"2024-02-17T00:36:43.831743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:53.731912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832512+0000","last_change":"2024-02-17T00:36:42.104622+0000","last_active":"2024-02-17T00:36:43.832512+0000","last_peered":"2024-02-17T00:36:43.832512+0000","last_clean":"2024-02-17T00:36:43.832512+0000","last_became_active":"2024-02-17T00:36:42.104221+0000","last_became_peered":"2024-02-17T00:36:42.104221+0000","last_unstale":"2024-02-17T00:36:43.832512+0000","last_undegraded":"2024-02-17T00:36:43.832512+0000","last_fullsized":"2024-02-17T00:36:43.832512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096468+0000","last_change":"2024-02-17T00:36:38.059189+0000","last_active":"2024-02-17T00:36:43.096468+0000","last_peered":"2024-02-17T00:36:43.096468+0000","last_clean":"2024-02-17T00:36:43.096468+0000","last_became_active":"2024-02-17T00:36:38.058901+0000","last_became_peered":"2024-02-17T00:36:38.058901+0000","last_unstale":"2024-02-17T00:36:43.096468+0000","last_undegraded":"2024-02-17T00:36:43.096468+0000","last_fullsized":"2024-02-17T00:36:43.096468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068931+0000","last_change":"2024-02-17T00:36:37.030700+0000","last_active":"2024-02-17T00:36:43.068931+0000","last_peered":"2024-02-17T00:36:43.068931+0000","last_clean":"2024-02-17T00:36:43.068931+0000","last_became_active":"2024-02-17T00:36:37.030397+0000","last_became_peered":"2024-02-17T00:36:37.030397+0000","last_unstale":"2024-02-17T00:36:43.068931+0000","last_undegraded":"2024-02-17T00:36:43.068931+0000","last_fullsized":"2024-02-17T00:36:43.068931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:05.382965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832374+0000","last_change":"2024-02-17T00:36:42.107289+0000","last_active":"2024-02-17T00:36:43.832374+0000","last_peered":"2024-02-17T00:36:43.832374+0000","last_clean":"2024-02-17T00:36:43.832374+0000","last_became_active":"2024-02-17T00:36:42.106838+0000","last_became_peered":"2024-02-17T00:36:42.106838+0000","last_unstale":"2024-02-17T00:36:43.832374+0000","last_undegraded":"2024-02-17T00:36:43.832374+0000","last_fullsized":"2024-02-17T00:36:43.832374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831254+0000","last_change":"2024-02-17T00:36:38.040509+0000","last_active":"2024-02-17T00:36:43.831254+0000","last_peered":"2024-02-17T00:36:43.831254+0000","last_clean":"2024-02-17T00:36:43.831254+0000","last_became_active":"2024-02-17T00:36:38.040220+0000","last_became_peered":"2024-02-17T00:36:38.040220+0000","last_unstale":"2024-02-17T00:36:43.831254+0000","last_undegraded":"2024-02-17T00:36:43.831254+0000","last_fullsized":"2024-02-17T00:36:43.831254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831090+0000","last_change":"2024-02-17T00:36:37.029628+0000","last_active":"2024-02-17T00:36:43.831090+0000","last_peered":"2024-02-17T00:36:43.831090+0000","last_clean":"2024-02-17T00:36:43.831090+0000","last_became_active":"2024-02-17T00:36:37.029322+0000","last_became_peered":"2024-02-17T00:36:37.029322+0000","last_unstale":"2024-02-17T00:36:43.831090+0000","last_undegraded":"2024-02-17T00:36:43.831090+0000","last_fullsized":"2024-02-17T00:36:43.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:29.219599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097224+0000","last_change":"2024-02-17T00:36:42.110170+0000","last_active":"2024-02-17T00:36:43.097224+0000","last_peered":"2024-02-17T00:36:43.097224+0000","last_clean":"2024-02-17T00:36:43.097224+0000","last_became_active":"2024-02-17T00:36:42.109713+0000","last_became_peered":"2024-02-17T00:36:42.109713+0000","last_unstale":"2024-02-17T00:36:43.097224+0000","last_undegraded":"2024-02-17T00:36:43.097224+0000","last_fullsized":"2024-02-17T00:36:43.097224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:07.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831262+0000","last_change":"2024-02-17T00:36:38.041003+0000","last_active":"2024-02-17T00:36:43.831262+0000","last_peered":"2024-02-17T00:36:43.831262+0000","last_clean":"2024-02-17T00:36:43.831262+0000","last_became_active":"2024-02-17T00:36:38.040700+0000","last_became_peered":"2024-02-17T00:36:38.040700+0000","last_unstale":"2024-02-17T00:36:43.831262+0000","last_undegraded":"2024-02-17T00:36:43.831262+0000","last_fullsized":"2024-02-17T00:36:43.831262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:15:02.009972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831922+0000","last_change":"2024-02-17T00:36:37.027694+0000","last_active":"2024-02-17T00:36:43.831922+0000","last_peered":"2024-02-17T00:36:43.831922+0000","last_clean":"2024-02-17T00:36:43.831922+0000","last_became_active":"2024-02-17T00:36:37.027061+0000","last_became_peered":"2024-02-17T00:36:37.027061+0000","last_unstale":"2024-02-17T00:36:43.831922+0000","last_undegraded":"2024-02-17T00:36:43.831922+0000","last_fullsized":"2024-02-17T00:36:43.831922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069046+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:36:43.069046+0000","last_peered":"2024-02-17T00:36:43.069046+0000","last_clean":"2024-02-17T00:36:43.069046+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:36:43.069046+0000","last_undegraded":"2024-02-17T00:36:43.069046+0000","last_fullsized":"2024-02-17T00:36:43.069046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832461+0000","last_change":"2024-02-17T00:36:42.105550+0000","last_active":"2024-02-17T00:36:43.832461+0000","last_peered":"2024-02-17T00:36:43.832461+0000","last_clean":"2024-02-17T00:36:43.832461+0000","last_became_active":"2024-02-17T00:36:42.105076+0000","last_became_peered":"2024-02-17T00:36:42.105076+0000","last_unstale":"2024-02-17T00:36:43.832461+0000","last_undegraded":"2024-02-17T00:36:43.832461+0000","last_fullsized":"2024-02-17T00:36:43.832461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:06:27.497749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832306+0000","last_change":"2024-02-17T00:36:38.045045+0000","last_active":"2024-02-17T00:36:43.832306+0000","last_peered":"2024-02-17T00:36:43.832306+0000","last_clean":"2024-02-17T00:36:43.832306+0000","last_became_active":"2024-02-17T00:36:38.044771+0000","last_became_peered":"2024-02-17T00:36:38.044771+0000","last_unstale":"2024-02-17T00:36:43.832306+0000","last_undegraded":"2024-02-17T00:36:43.832306+0000","last_fullsized":"2024-02-17T00:36:43.832306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:37.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832582+0000","last_change":"2024-02-17T00:36:37.032742+0000","last_active":"2024-02-17T00:36:43.832582+0000","last_peered":"2024-02-17T00:36:43.832582+0000","last_clean":"2024-02-17T00:36:43.832582+0000","last_became_active":"2024-02-17T00:36:37.032468+0000","last_became_peered":"2024-02-17T00:36:37.032468+0000","last_unstale":"2024-02-17T00:36:43.832582+0000","last_undegraded":"2024-02-17T00:36:43.832582+0000","last_fullsized":"2024-02-17T00:36:43.832582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068115+0000","last_change":"2024-02-17T00:36:42.103839+0000","last_active":"2024-02-17T00:36:43.068115+0000","last_peered":"2024-02-17T00:36:43.068115+0000","last_clean":"2024-02-17T00:36:43.068115+0000","last_became_active":"2024-02-17T00:36:42.103440+0000","last_became_peered":"2024-02-17T00:36:42.103440+0000","last_unstale":"2024-02-17T00:36:43.068115+0000","last_undegraded":"2024-02-17T00:36:43.068115+0000","last_fullsized":"2024-02-17T00:36:43.068115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831939+0000","last_change":"2024-02-17T00:36:38.062320+0000","last_active":"2024-02-17T00:36:43.831939+0000","last_peered":"2024-02-17T00:36:43.831939+0000","last_clean":"2024-02-17T00:36:43.831939+0000","last_became_active":"2024-02-17T00:36:38.062072+0000","last_became_peered":"2024-02-17T00:36:38.062072+0000","last_unstale":"2024-02-17T00:36:43.831939+0000","last_undegraded":"2024-02-17T00:36:43.831939+0000","last_fullsized":"2024-02-17T00:36:43.831939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097214+0000","last_change":"2024-02-17T00:36:37.027607+0000","last_active":"2024-02-17T00:36:43.097214+0000","last_peered":"2024-02-17T00:36:43.097214+0000","last_clean":"2024-02-17T00:36:43.097214+0000","last_became_active":"2024-02-17T00:36:37.025882+0000","last_became_peered":"2024-02-17T00:36:37.025882+0000","last_unstale":"2024-02-17T00:36:43.097214+0000","last_undegraded":"2024-02-17T00:36:43.097214+0000","last_fullsized":"2024-02-17T00:36:43.097214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096933+0000","last_change":"2024-02-17T00:36:42.108808+0000","last_active":"2024-02-17T00:36:43.096933+0000","last_peered":"2024-02-17T00:36:43.096933+0000","last_clean":"2024-02-17T00:36:43.096933+0000","last_became_active":"2024-02-17T00:36:42.108343+0000","last_became_peered":"2024-02-17T00:36:42.108343+0000","last_unstale":"2024-02-17T00:36:43.096933+0000","last_undegraded":"2024-02-17T00:36:43.096933+0000","last_fullsized":"2024-02-17T00:36:43.096933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:08:01.687705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831483+0000","last_change":"2024-02-17T00:36:38.059195+0000","last_active":"2024-02-17T00:36:43.831483+0000","last_peered":"2024-02-17T00:36:43.831483+0000","last_clean":"2024-02-17T00:36:43.831483+0000","last_became_active":"2024-02-17T00:36:38.058923+0000","last_became_peered":"2024-02-17T00:36:38.058923+0000","last_unstale":"2024-02-17T00:36:43.831483+0000","last_undegraded":"2024-02-17T00:36:43.831483+0000","last_fullsized":"2024-02-17T00:36:43.831483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831998+0000","last_change":"2024-02-17T00:36:37.030669+0000","last_active":"2024-02-17T00:36:43.831998+0000","last_peered":"2024-02-17T00:36:43.831998+0000","last_clean":"2024-02-17T00:36:43.831998+0000","last_became_active":"2024-02-17T00:36:37.029671+0000","last_became_peered":"2024-02-17T00:36:37.029671+0000","last_unstale":"2024-02-17T00:36:43.831998+0000","last_undegraded":"2024-02-17T00:36:43.831998+0000","last_fullsized":"2024-02-17T00:36:43.831998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830669+0000","last_change":"2024-02-17T00:36:42.106377+0000","last_active":"2024-02-17T00:36:43.830669+0000","last_peered":"2024-02-17T00:36:43.830669+0000","last_clean":"2024-02-17T00:36:43.830669+0000","last_became_active":"2024-02-17T00:36:42.105980+0000","last_became_peered":"2024-02-17T00:36:42.105980+0000","last_unstale":"2024-02-17T00:36:43.830669+0000","last_undegraded":"2024-02-17T00:36:43.830669+0000","last_fullsized":"2024-02-17T00:36:43.830669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:14:16.476031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069144+0000","last_change":"2024-02-17T00:36:38.056738+0000","last_active":"2024-02-17T00:36:43.069144+0000","last_peered":"2024-02-17T00:36:43.069144+0000","last_clean":"2024-02-17T00:36:43.069144+0000","last_became_active":"2024-02-17T00:36:38.056342+0000","last_became_peered":"2024-02-17T00:36:38.056342+0000","last_unstale":"2024-02-17T00:36:43.069144+0000","last_undegraded":"2024-02-17T00:36:43.069144+0000","last_fullsized":"2024-02-17T00:36:43.069144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831546+0000","last_change":"2024-02-17T00:36:37.037085+0000","last_active":"2024-02-17T00:36:43.831546+0000","last_peered":"2024-02-17T00:36:43.831546+0000","last_clean":"2024-02-17T00:36:43.831546+0000","last_became_active":"2024-02-17T00:36:37.036719+0000","last_became_peered":"2024-02-17T00:36:37.036719+0000","last_unstale":"2024-02-17T00:36:43.831546+0000","last_undegraded":"2024-02-17T00:36:43.831546+0000","last_fullsized":"2024-02-17T00:36:43.831546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069663+0000","last_change":"2024-02-17T00:36:42.109922+0000","last_active":"2024-02-17T00:36:43.069663+0000","last_peered":"2024-02-17T00:36:43.069663+0000","last_clean":"2024-02-17T00:36:43.069663+0000","last_became_active":"2024-02-17T00:36:42.109554+0000","last_became_peered":"2024-02-17T00:36:42.109554+0000","last_unstale":"2024-02-17T00:36:43.069663+0000","last_undegraded":"2024-02-17T00:36:43.069663+0000","last_fullsized":"2024-02-17T00:36:43.069663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:14.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:38.039174+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:38.038826+0000","last_became_peered":"2024-02-17T00:36:38.038826+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831131+0000","last_change":"2024-02-17T00:36:37.026636+0000","last_active":"2024-02-17T00:36:43.831131+0000","last_peered":"2024-02-17T00:36:43.831131+0000","last_clean":"2024-02-17T00:36:43.831131+0000","last_became_active":"2024-02-17T00:36:37.026356+0000","last_became_peered":"2024-02-17T00:36:37.026356+0000","last_unstale":"2024-02-17T00:36:43.831131+0000","last_undegraded":"2024-02-17T00:36:43.831131+0000","last_fullsized":"2024-02-17T00:36:43.831131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097409+0000","last_change":"2024-02-17T00:36:42.109160+0000","last_active":"2024-02-17T00:36:43.097409+0000","last_peered":"2024-02-17T00:36:43.097409+0000","last_clean":"2024-02-17T00:36:43.097409+0000","last_became_active":"2024-02-17T00:36:42.108726+0000","last_became_peered":"2024-02-17T00:36:42.108726+0000","last_unstale":"2024-02-17T00:36:43.097409+0000","last_undegraded":"2024-02-17T00:36:43.097409+0000","last_fullsized":"2024-02-17T00:36:43.097409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:41.664699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068896+0000","last_change":"2024-02-17T00:36:38.050032+0000","last_active":"2024-02-17T00:36:43.068896+0000","last_peered":"2024-02-17T00:36:43.068896+0000","last_clean":"2024-02-17T00:36:43.068896+0000","last_became_active":"2024-02-17T00:36:38.049764+0000","last_became_peered":"2024-02-17T00:36:38.049764+0000","last_unstale":"2024-02-17T00:36:43.068896+0000","last_undegraded":"2024-02-17T00:36:43.068896+0000","last_fullsized":"2024-02-17T00:36:43.068896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:04.316331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830633+0000","last_change":"2024-02-17T00:36:37.039587+0000","last_active":"2024-02-17T00:36:43.830633+0000","last_peered":"2024-02-17T00:36:43.830633+0000","last_clean":"2024-02-17T00:36:43.830633+0000","last_became_active":"2024-02-17T00:36:37.039306+0000","last_became_peered":"2024-02-17T00:36:37.039306+0000","last_unstale":"2024-02-17T00:36:43.830633+0000","last_undegraded":"2024-02-17T00:36:43.830633+0000","last_fullsized":"2024-02-17T00:36:43.830633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097441+0000","last_change":"2024-02-17T00:36:42.110028+0000","last_active":"2024-02-17T00:36:43.097441+0000","last_peered":"2024-02-17T00:36:43.097441+0000","last_clean":"2024-02-17T00:36:43.097441+0000","last_became_active":"2024-02-17T00:36:42.109169+0000","last_became_peered":"2024-02-17T00:36:42.109169+0000","last_unstale":"2024-02-17T00:36:43.097441+0000","last_undegraded":"2024-02-17T00:36:43.097441+0000","last_fullsized":"2024-02-17T00:36:43.097441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:50.471622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831820+0000","last_change":"2024-02-17T00:36:38.058168+0000","last_active":"2024-02-17T00:36:43.831820+0000","last_peered":"2024-02-17T00:36:43.831820+0000","last_clean":"2024-02-17T00:36:43.831820+0000","last_became_active":"2024-02-17T00:36:38.057867+0000","last_became_peered":"2024-02-17T00:36:38.057867+0000","last_unstale":"2024-02-17T00:36:43.831820+0000","last_undegraded":"2024-02-17T00:36:43.831820+0000","last_fullsized":"2024-02-17T00:36:43.831820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:03:31.843189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831661+0000","last_change":"2024-02-17T00:36:37.033408+0000","last_active":"2024-02-17T00:36:43.831661+0000","last_peered":"2024-02-17T00:36:43.831661+0000","last_clean":"2024-02-17T00:36:43.831661+0000","last_became_active":"2024-02-17T00:36:37.031691+0000","last_became_peered":"2024-02-17T00:36:37.031691+0000","last_unstale":"2024-02-17T00:36:43.831661+0000","last_undegraded":"2024-02-17T00:36:43.831661+0000","last_fullsized":"2024-02-17T00:36:43.831661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:09.449647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832315+0000","last_change":"2024-02-17T00:36:42.105315+0000","last_active":"2024-02-17T00:36:43.832315+0000","last_peered":"2024-02-17T00:36:43.832315+0000","last_clean":"2024-02-17T00:36:43.832315+0000","last_became_active":"2024-02-17T00:36:42.104846+0000","last_became_peered":"2024-02-17T00:36:42.104846+0000","last_unstale":"2024-02-17T00:36:43.832315+0000","last_undegraded":"2024-02-17T00:36:43.832315+0000","last_fullsized":"2024-02-17T00:36:43.832315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831976+0000","last_change":"2024-02-17T00:36:38.038475+0000","last_active":"2024-02-17T00:36:43.831976+0000","last_peered":"2024-02-17T00:36:43.831976+0000","last_clean":"2024-02-17T00:36:43.831976+0000","last_became_active":"2024-02-17T00:36:38.038146+0000","last_became_peered":"2024-02-17T00:36:38.038146+0000","last_unstale":"2024-02-17T00:36:43.831976+0000","last_undegraded":"2024-02-17T00:36:43.831976+0000","last_fullsized":"2024-02-17T00:36:43.831976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069341+0000","last_change":"2024-02-17T00:36:37.035415+0000","last_active":"2024-02-17T00:36:43.069341+0000","last_peered":"2024-02-17T00:36:43.069341+0000","last_clean":"2024-02-17T00:36:43.069341+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.069341+0000","last_undegraded":"2024-02-17T00:36:43.069341+0000","last_fullsized":"2024-02-17T00:36:43.069341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:57:22.735661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832312+0000","last_change":"2024-02-17T00:36:42.102660+0000","last_active":"2024-02-17T00:36:43.832312+0000","last_peered":"2024-02-17T00:36:43.832312+0000","last_clean":"2024-02-17T00:36:43.832312+0000","last_became_active":"2024-02-17T00:36:42.102164+0000","last_became_peered":"2024-02-17T00:36:42.102164+0000","last_unstale":"2024-02-17T00:36:43.832312+0000","last_undegraded":"2024-02-17T00:36:43.832312+0000","last_fullsized":"2024-02-17T00:36:43.832312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:22:56.783330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830955+0000","last_change":"2024-02-17T00:36:38.051782+0000","last_active":"2024-02-17T00:36:43.830955+0000","last_peered":"2024-02-17T00:36:43.830955+0000","last_clean":"2024-02-17T00:36:43.830955+0000","last_became_active":"2024-02-17T00:36:38.051484+0000","last_became_peered":"2024-02-17T00:36:38.051484+0000","last_unstale":"2024-02-17T00:36:43.830955+0000","last_undegraded":"2024-02-17T00:36:43.830955+0000","last_fullsized":"2024-02-17T00:36:43.830955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:47.435702+0000","last_change":"2024-02-17T00:36:37.024838+0000","last_active":"2024-02-17T00:36:47.435702+0000","last_peered":"2024-02-17T00:36:47.435702+0000","last_clean":"2024-02-17T00:36:47.435702+0000","last_became_active":"2024-02-17T00:36:37.024507+0000","last_became_peered":"2024-02-17T00:36:37.024507+0000","last_unstale":"2024-02-17T00:36:47.435702+0000","last_undegraded":"2024-02-17T00:36:47.435702+0000","last_fullsized":"2024-02-17T00:36:47.435702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:42.108161+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:42.107414+0000","last_became_peered":"2024-02-17T00:36:42.107414+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:44.381216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831001+0000","last_change":"2024-02-17T00:36:38.040658+0000","last_active":"2024-02-17T00:36:43.831001+0000","last_peered":"2024-02-17T00:36:43.831001+0000","last_clean":"2024-02-17T00:36:43.831001+0000","last_became_active":"2024-02-17T00:36:38.040361+0000","last_became_peered":"2024-02-17T00:36:38.040361+0000","last_unstale":"2024-02-17T00:36:43.831001+0000","last_undegraded":"2024-02-17T00:36:43.831001+0000","last_fullsized":"2024-02-17T00:36:43.831001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069426+0000","last_change":"2024-02-17T00:36:37.030364+0000","last_active":"2024-02-17T00:36:43.069426+0000","last_peered":"2024-02-17T00:36:43.069426+0000","last_clean":"2024-02-17T00:36:43.069426+0000","last_became_active":"2024-02-17T00:36:37.030047+0000","last_became_peered":"2024-02-17T00:36:37.030047+0000","last_unstale":"2024-02-17T00:36:43.069426+0000","last_undegraded":"2024-02-17T00:36:43.069426+0000","last_fullsized":"2024-02-17T00:36:43.069426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:26:31.440572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068488+0000","last_change":"2024-02-17T00:36:42.109162+0000","last_active":"2024-02-17T00:36:43.068488+0000","last_peered":"2024-02-17T00:36:43.068488+0000","last_clean":"2024-02-17T00:36:43.068488+0000","last_became_active":"2024-02-17T00:36:42.107077+0000","last_became_peered":"2024-02-17T00:36:42.107077+0000","last_unstale":"2024-02-17T00:36:43.068488+0000","last_undegraded":"2024-02-17T00:36:43.068488+0000","last_fullsized":"2024-02-17T00:36:43.068488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097502+0000","last_change":"2024-02-17T00:36:38.044311+0000","last_active":"2024-02-17T00:36:43.097502+0000","last_peered":"2024-02-17T00:36:43.097502+0000","last_clean":"2024-02-17T00:36:43.097502+0000","last_became_active":"2024-02-17T00:36:38.044043+0000","last_became_peered":"2024-02-17T00:36:38.044043+0000","last_unstale":"2024-02-17T00:36:43.097502+0000","last_undegraded":"2024-02-17T00:36:43.097502+0000","last_fullsized":"2024-02-17T00:36:43.097502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831305+0000","last_change":"2024-02-17T00:36:37.035871+0000","last_active":"2024-02-17T00:36:43.831305+0000","last_peered":"2024-02-17T00:36:43.831305+0000","last_clean":"2024-02-17T00:36:43.831305+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.831305+0000","last_undegraded":"2024-02-17T00:36:43.831305+0000","last_fullsized":"2024-02-17T00:36:43.831305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068707+0000","last_change":"2024-02-17T00:36:42.111490+0000","last_active":"2024-02-17T00:36:43.068707+0000","last_peered":"2024-02-17T00:36:43.068707+0000","last_clean":"2024-02-17T00:36:43.068707+0000","last_became_active":"2024-02-17T00:36:42.110829+0000","last_became_peered":"2024-02-17T00:36:42.110829+0000","last_unstale":"2024-02-17T00:36:43.068707+0000","last_undegraded":"2024-02-17T00:36:43.068707+0000","last_fullsized":"2024-02-17T00:36:43.068707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:23:34.160962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068936+0000","last_change":"2024-02-17T00:36:38.035374+0000","last_active":"2024-02-17T00:36:43.068936+0000","last_peered":"2024-02-17T00:36:43.068936+0000","last_clean":"2024-02-17T00:36:43.068936+0000","last_became_active":"2024-02-17T00:36:38.035048+0000","last_became_peered":"2024-02-17T00:36:38.035048+0000","last_unstale":"2024-02-17T00:36:43.068936+0000","last_undegraded":"2024-02-17T00:36:43.068936+0000","last_fullsized":"2024-02-17T00:36:43.068936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070032+0000","last_change":"2024-02-17T00:36:37.028771+0000","last_active":"2024-02-17T00:36:43.070032+0000","last_peered":"2024-02-17T00:36:43.070032+0000","last_clean":"2024-02-17T00:36:43.070032+0000","last_became_active":"2024-02-17T00:36:37.028466+0000","last_became_peered":"2024-02-17T00:36:37.028466+0000","last_unstale":"2024-02-17T00:36:43.070032+0000","last_undegraded":"2024-02-17T00:36:43.070032+0000","last_fullsized":"2024-02-17T00:36:43.070032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831980+0000","last_change":"2024-02-17T00:36:42.102858+0000","last_active":"2024-02-17T00:36:43.831980+0000","last_peered":"2024-02-17T00:36:43.831980+0000","last_clean":"2024-02-17T00:36:43.831980+0000","last_became_active":"2024-02-17T00:36:42.102467+0000","last_became_peered":"2024-02-17T00:36:42.102467+0000","last_unstale":"2024-02-17T00:36:43.831980+0000","last_undegraded":"2024-02-17T00:36:43.831980+0000","last_fullsized":"2024-02-17T00:36:43.831980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:16.339508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831808+0000","last_change":"2024-02-17T00:36:42.107030+0000","last_active":"2024-02-17T00:36:43.831808+0000","last_peered":"2024-02-17T00:36:43.831808+0000","last_clean":"2024-02-17T00:36:43.831808+0000","last_became_active":"2024-02-17T00:36:42.106372+0000","last_became_peered":"2024-02-17T00:36:42.106372+0000","last_unstale":"2024-02-17T00:36:43.831808+0000","last_undegraded":"2024-02-17T00:36:43.831808+0000","last_fullsized":"2024-02-17T00:36:43.831808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831130+0000","last_change":"2024-02-17T00:36:38.044613+0000","last_active":"2024-02-17T00:36:43.831130+0000","last_peered":"2024-02-17T00:36:43.831130+0000","last_clean":"2024-02-17T00:36:43.831130+0000","last_became_active":"2024-02-17T00:36:38.043593+0000","last_became_peered":"2024-02-17T00:36:38.043593+0000","last_unstale":"2024-02-17T00:36:43.831130+0000","last_undegraded":"2024-02-17T00:36:43.831130+0000","last_fullsized":"2024-02-17T00:36:43.831130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830995+0000","last_change":"2024-02-17T00:36:37.022022+0000","last_active":"2024-02-17T00:36:43.830995+0000","last_peered":"2024-02-17T00:36:43.830995+0000","last_clean":"2024-02-17T00:36:43.830995+0000","last_became_active":"2024-02-17T00:36:37.021271+0000","last_became_peered":"2024-02-17T00:36:37.021271+0000","last_unstale":"2024-02-17T00:36:43.830995+0000","last_undegraded":"2024-02-17T00:36:43.830995+0000","last_fullsized":"2024-02-17T00:36:43.830995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:45.683932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832391+0000","last_change":"2024-02-17T00:36:42.105409+0000","last_active":"2024-02-17T00:36:43.832391+0000","last_peered":"2024-02-17T00:36:43.832391+0000","last_clean":"2024-02-17T00:36:43.832391+0000","last_became_active":"2024-02-17T00:36:42.104989+0000","last_became_peered":"2024-02-17T00:36:42.104989+0000","last_unstale":"2024-02-17T00:36:43.832391+0000","last_undegraded":"2024-02-17T00:36:43.832391+0000","last_fullsized":"2024-02-17T00:36:43.832391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:41.477918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096723+0000","last_change":"2024-02-17T00:36:38.052345+0000","last_active":"2024-02-17T00:36:43.096723+0000","last_peered":"2024-02-17T00:36:43.096723+0000","last_clean":"2024-02-17T00:36:43.096723+0000","last_became_active":"2024-02-17T00:36:38.052051+0000","last_became_peered":"2024-02-17T00:36:38.052051+0000","last_unstale":"2024-02-17T00:36:43.096723+0000","last_undegraded":"2024-02-17T00:36:43.096723+0000","last_fullsized":"2024-02-17T00:36:43.096723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831372+0000","last_change":"2024-02-17T00:36:37.032305+0000","last_active":"2024-02-17T00:36:43.831372+0000","last_peered":"2024-02-17T00:36:43.831372+0000","last_clean":"2024-02-17T00:36:43.831372+0000","last_became_active":"2024-02-17T00:36:37.031977+0000","last_became_peered":"2024-02-17T00:36:37.031977+0000","last_unstale":"2024-02-17T00:36:43.831372+0000","last_undegraded":"2024-02-17T00:36:43.831372+0000","last_fullsized":"2024-02-17T00:36:43.831372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:45.670660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831564+0000","last_change":"2024-02-17T00:36:37.037062+0000","last_active":"2024-02-17T00:36:43.831564+0000","last_peered":"2024-02-17T00:36:43.831564+0000","last_clean":"2024-02-17T00:36:43.831564+0000","last_became_active":"2024-02-17T00:36:37.036814+0000","last_became_peered":"2024-02-17T00:36:37.036814+0000","last_unstale":"2024-02-17T00:36:43.831564+0000","last_undegraded":"2024-02-17T00:36:43.831564+0000","last_fullsized":"2024-02-17T00:36:43.831564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831622+0000","last_change":"2024-02-17T00:36:38.055091+0000","last_active":"2024-02-17T00:36:43.831622+0000","last_peered":"2024-02-17T00:36:43.831622+0000","last_clean":"2024-02-17T00:36:43.831622+0000","last_became_active":"2024-02-17T00:36:38.054773+0000","last_became_peered":"2024-02-17T00:36:38.054773+0000","last_unstale":"2024-02-17T00:36:43.831622+0000","last_undegraded":"2024-02-17T00:36:43.831622+0000","last_fullsized":"2024-02-17T00:36:43.831622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831612+0000","last_change":"2024-02-17T00:36:42.103625+0000","last_active":"2024-02-17T00:36:43.831612+0000","last_peered":"2024-02-17T00:36:43.831612+0000","last_clean":"2024-02-17T00:36:43.831612+0000","last_became_active":"2024-02-17T00:36:42.103248+0000","last_became_peered":"2024-02-17T00:36:42.103248+0000","last_unstale":"2024-02-17T00:36:43.831612+0000","last_undegraded":"2024-02-17T00:36:43.831612+0000","last_fullsized":"2024-02-17T00:36:43.831612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096932+0000","last_change":"2024-02-17T00:36:37.030983+0000","last_active":"2024-02-17T00:36:43.096932+0000","last_peered":"2024-02-17T00:36:43.096932+0000","last_clean":"2024-02-17T00:36:43.096932+0000","last_became_active":"2024-02-17T00:36:37.028330+0000","last_became_peered":"2024-02-17T00:36:37.028330+0000","last_unstale":"2024-02-17T00:36:43.096932+0000","last_undegraded":"2024-02-17T00:36:43.096932+0000","last_fullsized":"2024-02-17T00:36:43.096932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069391+0000","last_change":"2024-02-17T00:36:38.049295+0000","last_active":"2024-02-17T00:36:43.069391+0000","last_peered":"2024-02-17T00:36:43.069391+0000","last_clean":"2024-02-17T00:36:43.069391+0000","last_became_active":"2024-02-17T00:36:38.048946+0000","last_became_peered":"2024-02-17T00:36:38.048946+0000","last_unstale":"2024-02-17T00:36:43.069391+0000","last_undegraded":"2024-02-17T00:36:43.069391+0000","last_fullsized":"2024-02-17T00:36:43.069391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069192+0000","last_change":"2024-02-17T00:36:42.105857+0000","last_active":"2024-02-17T00:36:43.069192+0000","last_peered":"2024-02-17T00:36:43.069192+0000","last_clean":"2024-02-17T00:36:43.069192+0000","last_became_active":"2024-02-17T00:36:42.105256+0000","last_became_peered":"2024-02-17T00:36:42.105256+0000","last_unstale":"2024-02-17T00:36:43.069192+0000","last_undegraded":"2024-02-17T00:36:43.069192+0000","last_fullsized":"2024-02-17T00:36:43.069192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:00:11.474820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068081+0000","last_change":"2024-02-17T00:36:38.040290+0000","last_active":"2024-02-17T00:36:43.068081+0000","last_peered":"2024-02-17T00:36:43.068081+0000","last_clean":"2024-02-17T00:36:43.068081+0000","last_became_active":"2024-02-17T00:36:38.039955+0000","last_became_peered":"2024-02-17T00:36:38.039955+0000","last_unstale":"2024-02-17T00:36:43.068081+0000","last_undegraded":"2024-02-17T00:36:43.068081+0000","last_fullsized":"2024-02-17T00:36:43.068081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068817+0000","last_change":"2024-02-17T00:36:38.056307+0000","last_active":"2024-02-17T00:36:43.068817+0000","last_peered":"2024-02-17T00:36:43.068817+0000","last_clean":"2024-02-17T00:36:43.068817+0000","last_became_active":"2024-02-17T00:36:38.055992+0000","last_became_peered":"2024-02-17T00:36:38.055992+0000","last_unstale":"2024-02-17T00:36:43.068817+0000","last_undegraded":"2024-02-17T00:36:43.068817+0000","last_fullsized":"2024-02-17T00:36:43.068817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:56:01.530703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831314+0000","last_change":"2024-02-17T00:36:38.043893+0000","last_active":"2024-02-17T00:36:43.831314+0000","last_peered":"2024-02-17T00:36:43.831314+0000","last_clean":"2024-02-17T00:36:43.831314+0000","last_became_active":"2024-02-17T00:36:38.043507+0000","last_became_peered":"2024-02-17T00:36:38.043507+0000","last_unstale":"2024-02-17T00:36:43.831314+0000","last_undegraded":"2024-02-17T00:36:43.831314+0000","last_fullsized":"2024-02-17T00:36:43.831314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:57:48.954988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096825+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.096825+0000","last_peered":"2024-02-17T00:36:43.096825+0000","last_clean":"2024-02-17T00:36:43.096825+0000","last_became_active":"2024-02-17T00:36:38.057544+0000","last_became_peered":"2024-02-17T00:36:38.057544+0000","last_unstale":"2024-02-17T00:36:43.096825+0000","last_undegraded":"2024-02-17T00:36:43.096825+0000","last_fullsized":"2024-02-17T00:36:43.096825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832520+0000","last_change":"2024-02-17T00:36:38.054267+0000","last_active":"2024-02-17T00:36:43.832520+0000","last_peered":"2024-02-17T00:36:43.832520+0000","last_clean":"2024-02-17T00:36:43.832520+0000","last_became_active":"2024-02-17T00:36:38.053966+0000","last_became_peered":"2024-02-17T00:36:38.053966+0000","last_unstale":"2024-02-17T00:36:43.832520+0000","last_undegraded":"2024-02-17T00:36:43.832520+0000","last_fullsized":"2024-02-17T00:36:43.832520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831587+0000","last_change":"2024-02-17T00:36:38.056442+0000","last_active":"2024-02-17T00:36:43.831587+0000","last_peered":"2024-02-17T00:36:43.831587+0000","last_clean":"2024-02-17T00:36:43.831587+0000","last_became_active":"2024-02-17T00:36:38.056049+0000","last_became_peered":"2024-02-17T00:36:38.056049+0000","last_unstale":"2024-02-17T00:36:43.831587+0000","last_undegraded":"2024-02-17T00:36:43.831587+0000","last_fullsized":"2024-02-17T00:36:43.831587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068812+0000","last_change":"2024-02-17T00:36:38.036181+0000","last_active":"2024-02-17T00:36:43.068812+0000","last_peered":"2024-02-17T00:36:43.068812+0000","last_clean":"2024-02-17T00:36:43.068812+0000","last_became_active":"2024-02-17T00:36:38.035881+0000","last_became_peered":"2024-02-17T00:36:38.035881+0000","last_unstale":"2024-02-17T00:36:43.068812+0000","last_undegraded":"2024-02-17T00:36:43.068812+0000","last_fullsized":"2024-02-17T00:36:43.068812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097279+0000","last_change":"2024-02-17T00:36:38.049793+0000","last_active":"2024-02-17T00:36:43.097279+0000","last_peered":"2024-02-17T00:36:43.097279+0000","last_clean":"2024-02-17T00:36:43.097279+0000","last_became_active":"2024-02-17T00:36:38.049216+0000","last_became_peered":"2024-02-17T00:36:38.049216+0000","last_unstale":"2024-02-17T00:36:43.097279+0000","last_undegraded":"2024-02-17T00:36:43.097279+0000","last_fullsized":"2024-02-17T00:36:43.097279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830904+0000","last_change":"2024-02-17T00:36:38.047085+0000","last_active":"2024-02-17T00:36:43.830904+0000","last_peered":"2024-02-17T00:36:43.830904+0000","last_clean":"2024-02-17T00:36:43.830904+0000","last_became_active":"2024-02-17T00:36:38.046375+0000","last_became_peered":"2024-02-17T00:36:38.046375+0000","last_unstale":"2024-02-17T00:36:43.830904+0000","last_undegraded":"2024-02-17T00:36:43.830904+0000","last_fullsized":"2024-02-17T00:36:43.830904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096697+0000","last_change":"2024-02-17T00:36:38.054777+0000","last_active":"2024-02-17T00:36:43.096697+0000","last_peered":"2024-02-17T00:36:43.096697+0000","last_clean":"2024-02-17T00:36:43.096697+0000","last_became_active":"2024-02-17T00:36:38.054520+0000","last_became_peered":"2024-02-17T00:36:38.054520+0000","last_unstale":"2024-02-17T00:36:43.096697+0000","last_undegraded":"2024-02-17T00:36:43.096697+0000","last_fullsized":"2024-02-17T00:36:43.096697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069328+0000","last_change":"2024-02-17T00:36:38.054174+0000","last_active":"2024-02-17T00:36:43.069328+0000","last_peered":"2024-02-17T00:36:43.069328+0000","last_clean":"2024-02-17T00:36:43.069328+0000","last_became_active":"2024-02-17T00:36:38.053849+0000","last_became_peered":"2024-02-17T00:36:38.053849+0000","last_unstale":"2024-02-17T00:36:43.069328+0000","last_undegraded":"2024-02-17T00:36:43.069328+0000","last_fullsized":"2024-02-17T00:36:43.069328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831711+0000","last_change":"2024-02-17T00:36:38.040949+0000","last_active":"2024-02-17T00:36:43.831711+0000","last_peered":"2024-02-17T00:36:43.831711+0000","last_clean":"2024-02-17T00:36:43.831711+0000","last_became_active":"2024-02-17T00:36:38.040638+0000","last_became_peered":"2024-02-17T00:36:38.040638+0000","last_unstale":"2024-02-17T00:36:43.831711+0000","last_undegraded":"2024-02-17T00:36:43.831711+0000","last_fullsized":"2024-02-17T00:36:43.831711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831857+0000","last_change":"2024-02-17T00:36:38.059813+0000","last_active":"2024-02-17T00:36:43.831857+0000","last_peered":"2024-02-17T00:36:43.831857+0000","last_clean":"2024-02-17T00:36:43.831857+0000","last_became_active":"2024-02-17T00:36:38.059568+0000","last_became_peered":"2024-02-17T00:36:38.059568+0000","last_unstale":"2024-02-17T00:36:43.831857+0000","last_undegraded":"2024-02-17T00:36:43.831857+0000","last_fullsized":"2024-02-17T00:36:43.831857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832389+0000","last_change":"2024-02-17T00:36:38.054049+0000","last_active":"2024-02-17T00:36:43.832389+0000","last_peered":"2024-02-17T00:36:43.832389+0000","last_clean":"2024-02-17T00:36:43.832389+0000","last_became_active":"2024-02-17T00:36:38.053785+0000","last_became_peered":"2024-02-17T00:36:38.053785+0000","last_unstale":"2024-02-17T00:36:43.832389+0000","last_undegraded":"2024-02-17T00:36:43.832389+0000","last_fullsized":"2024-02-17T00:36:43.832389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:46.428346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069734+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.069734+0000","last_peered":"2024-02-17T00:36:43.069734+0000","last_clean":"2024-02-17T00:36:43.069734+0000","last_became_active":"2024-02-17T00:36:38.057512+0000","last_became_peered":"2024-02-17T00:36:38.057512+0000","last_unstale":"2024-02-17T00:36:43.069734+0000","last_undegraded":"2024-02-17T00:36:43.069734+0000","last_fullsized":"2024-02-17T00:36:43.069734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:06:22.484806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832454+0000","last_change":"2024-02-17T00:36:38.055783+0000","last_active":"2024-02-17T00:36:43.832454+0000","last_peered":"2024-02-17T00:36:43.832454+0000","last_clean":"2024-02-17T00:36:43.832454+0000","last_became_active":"2024-02-17T00:36:38.055520+0000","last_became_peered":"2024-02-17T00:36:38.055520+0000","last_unstale":"2024-02-17T00:36:43.832454+0000","last_undegraded":"2024-02-17T00:36:43.832454+0000","last_fullsized":"2024-02-17T00:36:43.832454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:36.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830805+0000","last_change":"2024-02-17T00:36:38.041377+0000","last_active":"2024-02-17T00:36:43.830805+0000","last_peered":"2024-02-17T00:36:43.830805+0000","last_clean":"2024-02-17T00:36:43.830805+0000","last_became_active":"2024-02-17T00:36:38.041081+0000","last_became_peered":"2024-02-17T00:36:38.041081+0000","last_unstale":"2024-02-17T00:36:43.830805+0000","last_undegraded":"2024-02-17T00:36:43.830805+0000","last_fullsized":"2024-02-17T00:36:43.830805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096497+0000","last_change":"2024-02-17T00:36:38.054101+0000","last_active":"2024-02-17T00:36:43.096497+0000","last_peered":"2024-02-17T00:36:43.096497+0000","last_clean":"2024-02-17T00:36:43.096497+0000","last_became_active":"2024-02-17T00:36:38.053820+0000","last_became_peered":"2024-02-17T00:36:38.053820+0000","last_unstale":"2024-02-17T00:36:43.096497+0000","last_undegraded":"2024-02-17T00:36:43.096497+0000","last_fullsized":"2024-02-17T00:36:43.096497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831862+0000","last_change":"2024-02-17T00:36:38.051075+0000","last_active":"2024-02-17T00:36:43.831862+0000","last_peered":"2024-02-17T00:36:43.831862+0000","last_clean":"2024-02-17T00:36:43.831862+0000","last_became_active":"2024-02-17T00:36:38.050786+0000","last_became_peered":"2024-02-17T00:36:38.050786+0000","last_unstale":"2024-02-17T00:36:43.831862+0000","last_undegraded":"2024-02-17T00:36:43.831862+0000","last_fullsized":"2024-02-17T00:36:43.831862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832457+0000","last_change":"2024-02-17T00:36:38.053472+0000","last_active":"2024-02-17T00:36:43.832457+0000","last_peered":"2024-02-17T00:36:43.832457+0000","last_clean":"2024-02-17T00:36:43.832457+0000","last_became_active":"2024-02-17T00:36:38.053183+0000","last_became_peered":"2024-02-17T00:36:38.053183+0000","last_unstale":"2024-02-17T00:36:43.832457+0000","last_undegraded":"2024-02-17T00:36:43.832457+0000","last_fullsized":"2024-02-17T00:36:43.832457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831779+0000","last_change":"2024-02-17T00:36:38.061499+0000","last_active":"2024-02-17T00:36:43.831779+0000","last_peered":"2024-02-17T00:36:43.831779+0000","last_clean":"2024-02-17T00:36:43.831779+0000","last_became_active":"2024-02-17T00:36:38.061179+0000","last_became_peered":"2024-02-17T00:36:38.061179+0000","last_unstale":"2024-02-17T00:36:43.831779+0000","last_undegraded":"2024-02-17T00:36:43.831779+0000","last_fullsized":"2024-02-17T00:36:43.831779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830928+0000","last_change":"2024-02-17T00:36:38.060993+0000","last_active":"2024-02-17T00:36:43.830928+0000","last_peered":"2024-02-17T00:36:43.830928+0000","last_clean":"2024-02-17T00:36:43.830928+0000","last_became_active":"2024-02-17T00:36:38.060363+0000","last_became_peered":"2024-02-17T00:36:38.060363+0000","last_unstale":"2024-02-17T00:36:43.830928+0000","last_undegraded":"2024-02-17T00:36:43.830928+0000","last_fullsized":"2024-02-17T00:36:43.830928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830894+0000","last_change":"2024-02-17T00:36:38.064745+0000","last_active":"2024-02-17T00:36:43.830894+0000","last_peered":"2024-02-17T00:36:43.830894+0000","last_clean":"2024-02-17T00:36:43.830894+0000","last_became_active":"2024-02-17T00:36:38.064474+0000","last_became_peered":"2024-02-17T00:36:38.064474+0000","last_unstale":"2024-02-17T00:36:43.830894+0000","last_undegraded":"2024-02-17T00:36:43.830894+0000","last_fullsized":"2024-02-17T00:36:43.830894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070025+0000","last_change":"2024-02-17T00:36:38.045388+0000","last_active":"2024-02-17T00:36:43.070025+0000","last_peered":"2024-02-17T00:36:43.070025+0000","last_clean":"2024-02-17T00:36:43.070025+0000","last_became_active":"2024-02-17T00:36:38.045025+0000","last_became_peered":"2024-02-17T00:36:38.045025+0000","last_unstale":"2024-02-17T00:36:43.070025+0000","last_undegraded":"2024-02-17T00:36:43.070025+0000","last_fullsized":"2024-02-17T00:36:43.070025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:27.545648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096470+0000","last_change":"2024-02-17T00:36:38.060065+0000","last_active":"2024-02-17T00:36:43.096470+0000","last_peered":"2024-02-17T00:36:43.096470+0000","last_clean":"2024-02-17T00:36:43.096470+0000","last_became_active":"2024-02-17T00:36:38.058856+0000","last_became_peered":"2024-02-17T00:36:38.058856+0000","last_unstale":"2024-02-17T00:36:43.096470+0000","last_undegraded":"2024-02-17T00:36:43.096470+0000","last_fullsized":"2024-02-17T00:36:43.096470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830615+0000","last_change":"2024-02-17T00:36:38.049156+0000","last_active":"2024-02-17T00:36:43.830615+0000","last_peered":"2024-02-17T00:36:43.830615+0000","last_clean":"2024-02-17T00:36:43.830615+0000","last_became_active":"2024-02-17T00:36:38.048871+0000","last_became_peered":"2024-02-17T00:36:38.048871+0000","last_unstale":"2024-02-17T00:36:43.830615+0000","last_undegraded":"2024-02-17T00:36:43.830615+0000","last_fullsized":"2024-02-17T00:36:43.830615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068418+0000","last_change":"2024-02-17T00:36:38.043709+0000","last_active":"2024-02-17T00:36:43.068418+0000","last_peered":"2024-02-17T00:36:43.068418+0000","last_clean":"2024-02-17T00:36:43.068418+0000","last_became_active":"2024-02-17T00:36:38.043021+0000","last_became_peered":"2024-02-17T00:36:38.043021+0000","last_unstale":"2024-02-17T00:36:43.068418+0000","last_undegraded":"2024-02-17T00:36:43.068418+0000","last_fullsized":"2024-02-17T00:36:43.068418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831338+0000","last_change":"2024-02-17T00:36:38.051762+0000","last_active":"2024-02-17T00:36:43.831338+0000","last_peered":"2024-02-17T00:36:43.831338+0000","last_clean":"2024-02-17T00:36:43.831338+0000","last_became_active":"2024-02-17T00:36:38.050858+0000","last_became_peered":"2024-02-17T00:36:38.050858+0000","last_unstale":"2024-02-17T00:36:43.831338+0000","last_undegraded":"2024-02-17T00:36:43.831338+0000","last_fullsized":"2024-02-17T00:36:43.831338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068278+0000","last_change":"2024-02-17T00:36:38.052747+0000","last_active":"2024-02-17T00:36:43.068278+0000","last_peered":"2024-02-17T00:36:43.068278+0000","last_clean":"2024-02-17T00:36:43.068278+0000","last_became_active":"2024-02-17T00:36:38.052427+0000","last_became_peered":"2024-02-17T00:36:38.052427+0000","last_unstale":"2024-02-17T00:36:43.068278+0000","last_undegraded":"2024-02-17T00:36:43.068278+0000","last_fullsized":"2024-02-17T00:36:43.068278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097083+0000","last_change":"2024-02-17T00:36:38.050783+0000","last_active":"2024-02-17T00:36:43.097083+0000","last_peered":"2024-02-17T00:36:43.097083+0000","last_clean":"2024-02-17T00:36:43.097083+0000","last_became_active":"2024-02-17T00:36:38.050517+0000","last_became_peered":"2024-02-17T00:36:38.050517+0000","last_unstale":"2024-02-17T00:36:43.097083+0000","last_undegraded":"2024-02-17T00:36:43.097083+0000","last_fullsized":"2024-02-17T00:36:43.097083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097293+0000","last_change":"2024-02-17T00:36:38.052397+0000","last_active":"2024-02-17T00:36:43.097293+0000","last_peered":"2024-02-17T00:36:43.097293+0000","last_clean":"2024-02-17T00:36:43.097293+0000","last_became_active":"2024-02-17T00:36:38.052096+0000","last_became_peered":"2024-02-17T00:36:38.052096+0000","last_unstale":"2024-02-17T00:36:43.097293+0000","last_undegraded":"2024-02-17T00:36:43.097293+0000","last_fullsized":"2024-02-17T00:36:43.097293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831341+0000","last_change":"2024-02-17T00:36:38.054432+0000","last_active":"2024-02-17T00:36:43.831341+0000","last_peered":"2024-02-17T00:36:43.831341+0000","last_clean":"2024-02-17T00:36:43.831341+0000","last_became_active":"2024-02-17T00:36:38.054152+0000","last_became_peered":"2024-02-17T00:36:38.054152+0000","last_unstale":"2024-02-17T00:36:43.831341+0000","last_undegraded":"2024-02-17T00:36:43.831341+0000","last_fullsized":"2024-02-17T00:36:43.831341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:01.482 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T00:37:01.483 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-17T00:37:01.483 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-17T00:37:01.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-17T00:37:01.483 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-17T00:37:01.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.616+0000 7f1c83187640 1 Processor -- start 2024-02-17T00:37:01.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.616+0000 7f1c83187640 1 -- start start 2024-02-17T00:37:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.616+0000 7f1c83187640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15da60 0x7f1c7c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.616+0000 7f1c83187640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1c7c15e2a0 0x7f1c7c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.616+0000 7f1c83187640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c15e8a0 con 0x7f1c7c15de40 2024-02-17T00:37:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c83187640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c161640 con 0x7f1c7c15e2a0 2024-02-17T00:37:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c83187640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c15eb80 con 0x7f1c7c15da60 2024-02-17T00:37:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c81724640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1c7c15e2a0 0x7f1c7c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c7bfff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1c7c15de40 0x7f1c7c161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:56712/0 (socket says 172.21.15.32:56712) 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c7bfff640 1 -- 172.21.15.32:0/1885026169 learned_addr learned my addr 172.21.15.32:0/1885026169 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c80f23640 1 --2- 172.21.15.32:0/1885026169 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15da60 0x7f1c7c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c7b7fe640 1 -- 172.21.15.32:0/1885026169 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674725375 0 0) 0x7f1c7c15e8a0 con 0x7f1c7c15de40 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c7b7fe640 1 -- 172.21.15.32:0/1885026169 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c6c003520 con 0x7f1c7c15de40 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c80f23640 1 -- 172.21.15.32:0/1885026169 >> v2:172.21.15.39:3300/0 conn(0x7f1c7c15e2a0 msgr2=0x7f1c7c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c80f23640 1 --2- 172.21.15.32:0/1885026169 >> v2:172.21.15.39:3300/0 conn(0x7f1c7c15e2a0 0x7f1c7c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c80f23640 1 -- 172.21.15.32:0/1885026169 >> v1:172.21.15.39:6789/0 conn(0x7f1c7c15de40 legacy=0x7f1c7c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c80f23640 1 -- 172.21.15.32:0/1885026169 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c15ee60 con 0x7f1c7c15da60 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.617+0000 7f1c81724640 1 --2- 172.21.15.32:0/1885026169 >> v2:172.21.15.39:3300/0 conn(0x7f1c7c15e2a0 0x7f1c7c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.618+0000 7f1c80f23640 1 --2- 172.21.15.32:0/1885026169 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15da60 0x7f1c7c0d0aa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c7002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5de46b2b086cde server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.618+0000 7f1c7b7fe640 1 -- 172.21.15.32:0/1885026169 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7002e070 con 0x7f1c7c15da60 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.618+0000 7f1c7b7fe640 1 -- 172.21.15.32:0/1885026169 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700315a0 con 0x7f1c7c15da60 2024-02-17T00:37:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.618+0000 7f1c7b7fe640 1 -- 172.21.15.32:0/1885026169 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70031910 con 0x7f1c7c15da60 2024-02-17T00:37:01.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 -- 172.21.15.32:0/1885026169 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15da60 msgr2=0x7f1c7c0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 --2- 172.21.15.32:0/1885026169 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15da60 0x7f1c7c0d0aa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c7002b840 comp rx=0 tx=0).stop 2024-02-17T00:37:01.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 -- 172.21.15.32:0/1885026169 shutdown_connections 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 --2- 172.21.15.32:0/1885026169 >> v2:172.21.15.39:3300/0 conn(0x7f1c7c15e2a0 0x7f1c7c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 --2- 172.21.15.32:0/1885026169 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15da60 0x7f1c7c0d0aa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 -- 172.21.15.32:0/1885026169 >> 172.21.15.32:0/1885026169 conn(0x7f1c7c06bfe0 msgr2=0x7f1c7c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 -- 172.21.15.32:0/1885026169 shutdown_connections 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.619+0000 7f1c83187640 1 -- 172.21.15.32:0/1885026169 wait complete. 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.620+0000 7f1c83187640 1 Processor -- start 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.620+0000 7f1c83187640 1 -- start start 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c83187640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c7c15da60 0x7f1c7c0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c83187640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 0x7f1c7c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c83187640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15e2a0 0x7f1c7c0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c83187640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c14d6d0 con 0x7f1c7c15de40 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c83187640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0b57a0 con 0x7f1c7c15da60 2024-02-17T00:37:01.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c83187640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0b5a80 con 0x7f1c7c15e2a0 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 0x7f1c7c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 0x7f1c7c0b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58532/0 (socket says 172.21.15.32:58532) 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 -- 172.21.15.32:0/514713666 learned_addr learned my addr 172.21.15.32:0/514713666 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c81724640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15e2a0 0x7f1c7c0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c80f23640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c7c15da60 0x7f1c7c0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 -- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15e2a0 msgr2=0x7f1c7c0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15e2a0 0x7f1c7c0b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 -- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c7c15da60 msgr2=0x7f1c7c0aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c7c15da60 0x7f1c7c0aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 -- 172.21.15.32:0/514713666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009a70 con 0x7f1c7c15de40 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.621+0000 7f1c7bfff640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 0x7f1c7c0b4ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c430 tx=0x7f1c6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.622+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68005ce0 con 0x7f1c7c15de40 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.622+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68005e40 con 0x7f1c7c15de40 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.622+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c70009400 con 0x7f1c7c15de40 2024-02-17T00:37:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.622+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680072f0 con 0x7f1c7c15de40 2024-02-17T00:37:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.622+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c162600 con 0x7f1c7c15de40 2024-02-17T00:37:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.623+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c0680c0 con 0x7f1c7c15de40 2024-02-17T00:37:01.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.623+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1c68007450 con 0x7f1c7c15de40 2024-02-17T00:37:01.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.624+0000 7f1c797fa640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1c6006b810 0x7f1c6006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.624+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1c680899b0 con 0x7f1c7c15de40 2024-02-17T00:37:01.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.624+0000 7f1c80f23640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1c6006b810 0x7f1c6006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.624+0000 7f1c80f23640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1c6006b810 0x7f1c6006dcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c70036000 tx=0x7f1c7003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.628+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c680541d0 con 0x7f1c7c15de40 2024-02-17T00:37:01.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.855+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1c7c068fd0 con 0x7f1c7c15de40 2024-02-17T00:37:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.858+0000 7f1c797fa640 1 -- 172.21.15.32:0/514713666 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171795 (secure 0 0 0) 0x7f1c68057890 con 0x7f1c7c15de40 2024-02-17T00:37:01.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:01.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1c6006b810 msgr2=0x7f1c6006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1c6006b810 0x7f1c6006dcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c70036000 tx=0x7f1c7003d040 comp rx=0 tx=0).stop 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 msgr2=0x7f1c7c0b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 0x7f1c7c0b4ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c430 tx=0x7f1c6800c830 comp rx=0 tx=0).stop 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 shutdown_connections 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1c6006b810 0x7f1c6006dcd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1c7c15e2a0 0x7f1c7c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c15de40 0x7f1c7c0b4ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 --2- 172.21.15.32:0/514713666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c7c15da60 0x7f1c7c0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 >> 172.21.15.32:0/514713666 conn(0x7f1c7c06bfe0 msgr2=0x7f1c7c15cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.860+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 shutdown_connections 2024-02-17T00:37:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.861+0000 7f1c83187640 1 -- 172.21.15.32:0/514713666 wait complete. 2024-02-17T00:37:01.874 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2740259094},{"type":"v1","addr":"172.21.15.39:6833","nonce":2740259094}]},"active_addr":"172.21.15.39:6833/2740259094","active_change":"2024-02-17T00:36:17.936091+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":4038730132}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":3514178275}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2582360138}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2340458259}]}]} 2024-02-17T00:37:01.877 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-17T00:37:01.877 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-17T00:37:01.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:01.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.975+0000 7f46fc1bc640 1 Processor -- start 2024-02-17T00:37:01.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.975+0000 7f46fc1bc640 1 -- start start 2024-02-17T00:37:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fc1bc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f46f415db00 0x7f46f40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fc1bc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40b53b0 0x7f46f40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fc1bc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46f40ce2b0 0x7f46f4161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fc1bc640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40d1e80 con 0x7f46f40ce2b0 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fc1bc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40b5930 con 0x7f46f415db00 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fc1bc640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40b5c10 con 0x7f46f40b53b0 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46f40ce2b0 0x7f46f4161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46f40ce2b0 0x7f46f4161670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58548/0 (socket says 172.21.15.32:58548) 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 -- 172.21.15.32:0/998113158 learned_addr learned my addr 172.21.15.32:0/998113158 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46f9f58640 1 --2- 172.21.15.32:0/998113158 >> v2:172.21.15.39:3300/0 conn(0x7f46f415db00 0x7f46f40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46f9757640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40b53b0 0x7f46f40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 -- 172.21.15.32:0/998113158 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40b53b0 msgr2=0x7f46f40d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40b53b0 0x7f46f40d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 -- 172.21.15.32:0/998113158 >> v2:172.21.15.39:3300/0 conn(0x7f46f415db00 msgr2=0x7f46f40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.976+0000 7f46fa759640 1 --2- 172.21.15.32:0/998113158 >> v2:172.21.15.39:3300/0 conn(0x7f46f415db00 0x7f46f40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46fa759640 1 -- 172.21.15.32:0/998113158 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40b5ef0 con 0x7f46f40ce2b0 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46f9757640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40b53b0 0x7f46f40d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46f9f58640 1 --2- 172.21.15.32:0/998113158 >> v2:172.21.15.39:3300/0 conn(0x7f46f415db00 0x7f46f40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46fa759640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f40ce2b0 0x7f46f4161670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46f40d4940 tx=0x7f46ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee27a4a620ba5068 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46f8f56640 1 -- 172.21.15.32:0/998113158 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec02ca70 con 0x7f46f40ce2b0 2024-02-17T00:37:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46f8f56640 1 -- 172.21.15.32:0/998113158 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec02cbd0 con 0x7f46f40ce2b0 2024-02-17T00:37:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.977+0000 7f46f8f56640 1 -- 172.21.15.32:0/998113158 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0343f0 con 0x7f46f40ce2b0 2024-02-17T00:37:01.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 -- 172.21.15.32:0/998113158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f40ce2b0 msgr2=0x7f46f4161670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f40ce2b0 0x7f46f4161670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46f40d4940 tx=0x7f46ec02bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 -- 172.21.15.32:0/998113158 shutdown_connections 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f40ce2b0 0x7f46f4161670 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/998113158 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40b53b0 0x7f46f40d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/998113158 >> v2:172.21.15.39:3300/0 conn(0x7f46f415db00 0x7f46f40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 -- 172.21.15.32:0/998113158 >> 172.21.15.32:0/998113158 conn(0x7f46f4072290 msgr2=0x7f46f40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 -- 172.21.15.32:0/998113158 shutdown_connections 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.978+0000 7f46fc1bc640 1 -- 172.21.15.32:0/998113158 wait complete. 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.979+0000 7f46fc1bc640 1 Processor -- start 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.979+0000 7f46fc1bc640 1 -- start start 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fc1bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46f40b53b0 0x7f46f415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fc1bc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40ce2b0 0x7f46f40cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fc1bc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 0x7f46f41f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fc1bc640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40cc800 con 0x7f46f415db00 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fc1bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4153170 con 0x7f46f40b53b0 2024-02-17T00:37:01.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fc1bc640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4146cd0 con 0x7f46f40ce2b0 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 0x7f46f41f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 0x7f46f41f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58552/0 (socket says 172.21.15.32:58552) 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 -- 172.21.15.32:0/3962448232 learned_addr learned my addr 172.21.15.32:0/3962448232 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46f9f58640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46f40b53b0 0x7f46f415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 -- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40ce2b0 msgr2=0x7f46f40cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46f9757640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40ce2b0 0x7f46f40cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40ce2b0 0x7f46f40cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 -- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46f40b53b0 msgr2=0x7f46f415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46f40b53b0 0x7f46f415c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 -- 172.21.15.32:0/3962448232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec009b30 con 0x7f46f415db00 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.980+0000 7f46fa759640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 0x7f46f41f6fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46ec036040 tx=0x7f46ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.981+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec03e450 con 0x7f46f415db00 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.981+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec03e5d0 con 0x7f46f415db00 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.981+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec03e980 con 0x7f46f415db00 2024-02-17T00:37:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.981+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f41469f0 con 0x7f46f415db00 2024-02-17T00:37:01.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.981+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f40cccf0 con 0x7f46f415db00 2024-02-17T00:37:01.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.982+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f4068fd0 con 0x7f46f415db00 2024-02-17T00:37:01.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.982+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f46ec03eae0 con 0x7f46f415db00 2024-02-17T00:37:01.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.982+0000 7f46ea7fc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f46d806b810 0x7f46d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:01.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.983+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f46ec0ad400 con 0x7f46f415db00 2024-02-17T00:37:01.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.983+0000 7f46f9f58640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f46d806b810 0x7f46d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:01.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.983+0000 7f46f9f58640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f46d806b810 0x7f46d806dcd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46f000b7c0 tx=0x7f46f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:01.987+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46ec077b70 con 0x7f46f415db00 2024-02-17T00:37:02.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.171+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46f40d19d0 con 0x7f46f415db00 2024-02-17T00:37:02.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.172+0000 7f46ea7fc640 1 -- 172.21.15.32:0/3962448232 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f46ec07b230 con 0x7f46f415db00 2024-02-17T00:37:02.175 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:02.175 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.173+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f46d806b810 msgr2=0x7f46d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.173+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f46d806b810 0x7f46d806dcd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46f000b7c0 tx=0x7f46f0008040 comp rx=0 tx=0).stop 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.173+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 msgr2=0x7f46f41f6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.173+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 0x7f46f41f6fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46ec036040 tx=0x7f46ec004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.173+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 shutdown_connections 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.173+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46f415db00 0x7f46f41f6fa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.174+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f46d806b810 0x7f46d806dcd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.174+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f46f40ce2b0 0x7f46f40cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.174+0000 7f46fc1bc640 1 --2- 172.21.15.32:0/3962448232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46f40b53b0 0x7f46f415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.174+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 >> 172.21.15.32:0/3962448232 conn(0x7f46f4072290 msgr2=0x7f46f40c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.174+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 shutdown_connections 2024-02-17T00:37:02.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.174+0000 7f46fc1bc640 1 -- 172.21.15.32:0/3962448232 wait complete. 2024-02-17T00:37:02.187 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-17T00:37:02.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:02.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.286+0000 7f5700839640 1 Processor -- start 2024-02-17T00:37:02.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.286+0000 7f5700839640 1 -- start start 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f5700839640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15da60 0x7f56fc0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f5700839640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f56fc15e2a0 0x7f56fc0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f5700839640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc15e8a0 con 0x7f56fc15de40 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f5700839640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc161640 con 0x7f56fc15e2a0 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f5700839640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc15eb80 con 0x7f56fc15da60 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f56fad9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f56fc15e2a0 0x7f56fc0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f56fa59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15da60 0x7f56fc0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.287+0000 7f56f9d9b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f56fc15de40 0x7f56fc161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:56724/0 (socket says 172.21.15.32:56724) 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56f9d9b640 1 -- 172.21.15.32:0/1713672307 learned_addr learned my addr 172.21.15.32:0/1713672307 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56f959a640 1 -- 172.21.15.32:0/1713672307 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441657235 0 0) 0x7f56fc15e8a0 con 0x7f56fc15de40 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56f959a640 1 -- 172.21.15.32:0/1713672307 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e8003520 con 0x7f56fc15de40 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56fa59c640 1 -- 172.21.15.32:0/1713672307 >> v2:172.21.15.39:3300/0 conn(0x7f56fc15e2a0 msgr2=0x7f56fc0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56fa59c640 1 --2- 172.21.15.32:0/1713672307 >> v2:172.21.15.39:3300/0 conn(0x7f56fc15e2a0 0x7f56fc0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56fa59c640 1 -- 172.21.15.32:0/1713672307 >> v1:172.21.15.39:6789/0 conn(0x7f56fc15de40 legacy=0x7f56fc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56fa59c640 1 -- 172.21.15.32:0/1713672307 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc15ee60 con 0x7f56fc15da60 2024-02-17T00:37:02.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.288+0000 7f56fad9d640 1 --2- 172.21.15.32:0/1713672307 >> v2:172.21.15.39:3300/0 conn(0x7f56fc15e2a0 0x7f56fc0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:02.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f56fa59c640 1 --2- 172.21.15.32:0/1713672307 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15da60 0x7f56fc0d0aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f56f40097a0 tx=0x7f56f402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3da90cfa5482b275 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f56f959a640 1 -- 172.21.15.32:0/1713672307 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f402e070 con 0x7f56fc15da60 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f56f959a640 1 -- 172.21.15.32:0/1713672307 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f40315a0 con 0x7f56fc15da60 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f56f959a640 1 -- 172.21.15.32:0/1713672307 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4031910 con 0x7f56fc15da60 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f5700839640 1 -- 172.21.15.32:0/1713672307 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15da60 msgr2=0x7f56fc0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f5700839640 1 --2- 172.21.15.32:0/1713672307 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15da60 0x7f56fc0d0aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f56f40097a0 tx=0x7f56f402b840 comp rx=0 tx=0).stop 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f5700839640 1 -- 172.21.15.32:0/1713672307 shutdown_connections 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f5700839640 1 --2- 172.21.15.32:0/1713672307 >> v2:172.21.15.39:3300/0 conn(0x7f56fc15e2a0 0x7f56fc0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.289+0000 7f5700839640 1 --2- 172.21.15.32:0/1713672307 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15da60 0x7f56fc0d0aa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.290+0000 7f5700839640 1 -- 172.21.15.32:0/1713672307 >> 172.21.15.32:0/1713672307 conn(0x7f56fc06bfe0 msgr2=0x7f56fc06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.290+0000 7f5700839640 1 -- 172.21.15.32:0/1713672307 shutdown_connections 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.290+0000 7f5700839640 1 -- 172.21.15.32:0/1713672307 wait complete. 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 Processor -- start 2024-02-17T00:37:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 -- start start 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56fc15da60 0x7f56fc15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 0x7f56fc15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15e2a0 0x7f56fc15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0b5de0 con 0x7f56fc15de40 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1f3ed0 con 0x7f56fc15da60 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.291+0000 7f5700839640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1f41b0 con 0x7f56fc15e2a0 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 0x7f56fc15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 0x7f56fc15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58554/0 (socket says 172.21.15.32:58554) 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 -- 172.21.15.32:0/2881028468 learned_addr learned my addr 172.21.15.32:0/2881028468 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56fad9d640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15e2a0 0x7f56fc15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56fa59c640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56fc15da60 0x7f56fc15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 -- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15e2a0 msgr2=0x7f56fc15f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15e2a0 0x7f56fc15f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 -- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56fc15da60 msgr2=0x7f56fc15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56fc15da60 0x7f56fc15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 -- 172.21.15.32:0/2881028468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec009a70 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f9d9b640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 0x7f56fc15f0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c500 tx=0x7f56e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4005ce0 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4005e40 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f4009400 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e40072b0 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.292+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc162600 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.293+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc0680c0 con 0x7f56fc15de40 2024-02-17T00:37:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.294+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f56e40074d0 con 0x7f56fc15de40 2024-02-17T00:37:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.294+0000 7f56f2ffd640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f56dc06b810 0x7f56dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.294+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f56e4089a20 con 0x7f56fc15de40 2024-02-17T00:37:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.294+0000 7f56fa59c640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f56dc06b810 0x7f56dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.295+0000 7f56fa59c640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f56dc06b810 0x7f56dc06dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56f4036000 tx=0x7f56f403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.299+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56e40541f0 con 0x7f56fc15de40 2024-02-17T00:37:02.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.481+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56fc068fd0 con 0x7f56fc15de40 2024-02-17T00:37:02.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.482+0000 7f56f2ffd640 1 -- 172.21.15.32:0/2881028468 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f56e40578b0 con 0x7f56fc15de40 2024-02-17T00:37:02.485 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:02.485 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:02.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f56dc06b810 msgr2=0x7f56dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f56dc06b810 0x7f56dc06dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56f4036000 tx=0x7f56f403d040 comp rx=0 tx=0).stop 2024-02-17T00:37:02.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 msgr2=0x7f56fc15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 0x7f56fc15f0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c500 tx=0x7f56e400c900 comp rx=0 tx=0).stop 2024-02-17T00:37:02.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 shutdown_connections 2024-02-17T00:37:02.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f56dc06b810 0x7f56dc06dcd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56fc15e2a0 0x7f56fc15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56fc15de40 0x7f56fc15f0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 --2- 172.21.15.32:0/2881028468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56fc15da60 0x7f56fc15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 >> 172.21.15.32:0/2881028468 conn(0x7f56fc06bfe0 msgr2=0x7f56fc0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 shutdown_connections 2024-02-17T00:37:02.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.484+0000 7f5700839640 1 -- 172.21.15.32:0/2881028468 wait complete. 2024-02-17T00:37:02.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-17T00:37:02.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-17T00:37:02.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-17T00:37:02.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-17T00:37:02.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-17T00:37:02.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-17T00:37:02.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-17T00:37:02.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-17T00:37:02.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.670+0000 7f0ad0a53640 1 Processor -- start 2024-02-17T00:37:02.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.670+0000 7f900bb65640 1 Processor -- start 2024-02-17T00:37:02.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7fc8ce55e640 1 Processor -- start 2024-02-17T00:37:02.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7f5ea18d4640 1 Processor -- start 2024-02-17T00:37:02.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7fc8ce55e640 1 -- start start 2024-02-17T00:37:02.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7f5ea18d4640 1 -- start start 2024-02-17T00:37:02.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7fbe7ede9640 1 Processor -- start 2024-02-17T00:37:02.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7f900bb65640 1 -- start start 2024-02-17T00:37:02.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7fe8cbc2a640 1 Processor -- start 2024-02-17T00:37:02.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.670+0000 7f0ad0a53640 1 -- start start 2024-02-17T00:37:02.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7fe8cbc2a640 1 -- start start 2024-02-17T00:37:02.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7ff8a9c4c640 1 Processor -- start 2024-02-17T00:37:02.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0ad0a53640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0ad0a53640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0acc0d07d0 0x7f0acc0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0ad0a53640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0b28b0 con 0x7f0acc0d2380 2024-02-17T00:37:02.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0ad0a53640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc0d3dc0 con 0x7f0acc0d07d0 2024-02-17T00:37:02.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0ad0a53640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc0d27c0 con 0x7f0acc161200 2024-02-17T00:37:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.671+0000 7ff8a9c4c640 1 -- start start 2024-02-17T00:37:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f900bb65640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0acb7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0acb7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57578/0 (socket says 172.21.15.32:57578) 2024-02-17T00:37:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0acb7fe640 1 -- 172.21.15.32:0/3406938444 learned_addr learned my addr 172.21.15.32:0/3406938444 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7fbe7ede9640 1 -- start start 2024-02-17T00:37:02.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f0acbfff640 1 --2- 172.21.15.32:0/3406938444 >> v2:172.21.15.32:3300/0 conn(0x7f0acc0d07d0 0x7f0acc0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7f900bb65640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ffc04ffc0 0x7f8ffc037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7ff8a9c4c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c04fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a9c4c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff89c006270 0x7ff89c0066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a9c4c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c006c80 con 0x7ff89c055d10 2024-02-17T00:37:02.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a9c4c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c006f60 con 0x7ff89c006270 2024-02-17T00:37:02.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a9c4c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c007240 con 0x7ff89c0df800 2024-02-17T00:37:02.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f9009901640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7fc8ce55e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8c81657d0 0x7fc8c8165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7fc8ce55e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c80b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.672+0000 7fc8ce55e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c81633a0 con 0x7fc8c80cdf70 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fc8ce55e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c81660f0 con 0x7fc8c81657d0 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fc8ce55e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80ced00 con 0x7fc8c80b30c0 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5ea18d4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e94052480 0x7f5e940528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5ea18d4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e94038200 con 0x7f5e94037680 2024-02-17T00:37:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f9009901640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc04fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50248/0 (socket says 172.21.15.32:50248) 2024-02-17T00:37:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f9009901640 1 -- 172.21.15.32:0/520557367 learned_addr learned my addr 172.21.15.32:0/520557367 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a944b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff89c006270 0x7ff89c0066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a944b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff89c006270 0x7ff89c0066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58576/0 (socket says 172.21.15.32:58576) 2024-02-17T00:37:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a944b640 1 -- 172.21.15.32:0/2663565503 learned_addr learned my addr 172.21.15.32:0/2663565503 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc054320 con 0x7f8ffc038100 2024-02-17T00:37:02.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc053710 con 0x7f8ffc04ffc0 2024-02-17T00:37:02.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0539f0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fc8c77fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc8c80cdf70 0x7fc8c80ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38656/0 (socket says 172.21.15.32:38656) 2024-02-17T00:37:02.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fc8c77fe640 1 -- 172.21.15.32:0/376600888 learned_addr learned my addr 172.21.15.32:0/376600888 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:02.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5e9a7fc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5e94037a60 0x7f5e940366a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:56756/0 (socket says 172.21.15.32:56756) 2024-02-17T00:37:02.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f9009100640 1 --2- 172.21.15.32:0/520557367 >> v2:172.21.15.32:3300/0 conn(0x7f8ffc04ffc0 0x7f8ffc037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fc8ccafb640 1 --2- 172.21.15.32:0/376600888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c80b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8cbc2a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c41657d0 0x7fe8c4165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8cbc2a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8c40cdf70 0x7fe8c40ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8cbc2a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c41633a0 con 0x7fe8c4162190 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8cbc2a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c41660f0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8cbc2a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40ced00 con 0x7fe8c41657d0 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7ff8a3fff640 1 --2- 172.21.15.32:0/2663565503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c04fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f0acb7fe640 1 -- 172.21.15.32:0/3406938444 >> v2:172.21.15.32:3300/0 conn(0x7f0acc0d07d0 msgr2=0x7f0acc0b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f0acb7fe640 1 --2- 172.21.15.32:0/3406938444 >> v2:172.21.15.32:3300/0 conn(0x7f0acc0d07d0 0x7f0acc0b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f0acb7fe640 1 -- 172.21.15.32:0/3406938444 >> v1:172.21.15.39:6789/0 conn(0x7f0acc0d2380 legacy=0x7f0acc0d00c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T00:37:02.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f0acb7fe640 1 -- 172.21.15.32:0/3406938444 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0cf410 con 0x7f0acc161200 2024-02-17T00:37:02.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8ca1c7640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe8c4162190 0x7fe8c4162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:56772/0 (socket says 172.21.15.32:56772) 2024-02-17T00:37:02.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5e9a7fc640 1 -- 172.21.15.32:0/2839001143 learned_addr learned my addr 172.21.15.32:0/2839001143 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:02.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5e9b7fe640 1 --2- 172.21.15.32:0/2839001143 >> v2:172.21.15.32:3300/0 conn(0x7f5e94052480 0x7f5e940528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8ca1c7640 1 -- 172.21.15.32:0/3808075335 learned_addr learned my addr 172.21.15.32:0/3808075335 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:02.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e940558f0 con 0x7f5e94037a60 2024-02-17T00:37:02.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7fe8c99c6640 1 --2- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c41657d0 0x7fe8c4165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c91c5640 1 --2- 172.21.15.32:0/3808075335 >> v2:172.21.15.39:3300/0 conn(0x7fe8c40cdf70 0x7fe8c40ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.673+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e94052df0 con 0x7f5e94052480 2024-02-17T00:37:02.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f9009901640 1 -- 172.21.15.32:0/520557367 >> v2:172.21.15.32:3300/0 conn(0x7f8ffc04ffc0 msgr2=0x7f8ffc037bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe7ede9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe70039f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe7ede9640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe70033b90 0x7fbe7003a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c89c4640 1 -- 172.21.15.32:0/3808075335 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279696112 0 0) 0x7fe8c41633a0 con 0x7fe8c4162190 2024-02-17T00:37:02.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe7ede9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe70005fb0 con 0x7fbe70033640 2024-02-17T00:37:02.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe7ede9640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7003a9e0 con 0x7fbe70033b90 2024-02-17T00:37:02.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe7ede9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7004bbc0 con 0x7fbe700e4760 2024-02-17T00:37:02.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f9009901640 1 --2- 172.21.15.32:0/520557367 >> v2:172.21.15.32:3300/0 conn(0x7f8ffc04ffc0 0x7f8ffc037bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f9009901640 1 -- 172.21.15.32:0/520557367 >> v1:172.21.15.32:6789/0 conn(0x7f8ffc038100 legacy=0x7f8ffc038590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c89c4640 1 -- 172.21.15.32:0/3808075335 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b0003520 con 0x7fe8c4162190 2024-02-17T00:37:02.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f9009901640 1 -- 172.21.15.32:0/520557367 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc053cd0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c91c5640 1 -- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c41657d0 msgr2=0x7fe8c4165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c91c5640 1 --2- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c41657d0 0x7fe8c4165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c91c5640 1 -- 172.21.15.32:0/3808075335 >> v1:172.21.15.39:6789/0 conn(0x7fe8c4162190 legacy=0x7fe8c4162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fe8c91c5640 1 -- 172.21.15.32:0/3808075335 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40cefe0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe70033b90 0x7fbe7003a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe70033b90 0x7fbe7003a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58598/0 (socket says 172.21.15.32:58598) 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 -- 172.21.15.32:0/3245699241 learned_addr learned my addr 172.21.15.32:0/3245699241 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe7cb85640 1 --2- 172.21.15.32:0/3245699241 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe70039f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f2f4a4e6640 1 Processor -- start 2024-02-17T00:37:02.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fc8ccafb640 1 -- 172.21.15.32:0/376600888 >> v2:172.21.15.32:3300/0 conn(0x7fc8c81657d0 msgr2=0x7fc8c8165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 -- 172.21.15.32:0/3245699241 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 msgr2=0x7fbe70039f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 --2- 172.21.15.32:0/3245699241 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe70039f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 -- 172.21.15.32:0/3245699241 >> v1:172.21.15.39:6789/0 conn(0x7fbe70033640 legacy=0x7fbe7004f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fbe77fff640 1 -- 172.21.15.32:0/3245699241 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70051010 con 0x7fbe70033b90 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f0acb7fe640 1 --2- 172.21.15.32:0/3406938444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0acc08bed0 tx=0x7f0ac402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f112556a147821 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f5e9b7fe640 1 -- 172.21.15.32:0/2839001143 >> v1:172.21.15.39:6789/0 conn(0x7f5e94037a60 legacy=0x7f5e940366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f5e9b7fe640 1 -- 172.21.15.32:0/2839001143 >> v1:172.21.15.32:6789/0 conn(0x7f5e94037680 legacy=0x7f5e94057680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7f5e9b7fe640 1 -- 172.21.15.32:0/2839001143 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94055bd0 con 0x7f5e94052480 2024-02-17T00:37:02.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fc8ccafb640 1 --2- 172.21.15.32:0/376600888 >> v2:172.21.15.32:3300/0 conn(0x7fc8c81657d0 0x7fc8c8165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fc8ccafb640 1 -- 172.21.15.32:0/376600888 >> v1:172.21.15.32:6789/0 conn(0x7fc8c80cdf70 legacy=0x7fc8c80ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fc8c6ffd640 1 -- 172.21.15.32:0/376600888 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952341921 0 0) 0x7fc8c81633a0 con 0x7fc8c80cdf70 2024-02-17T00:37:02.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7fc8ccafb640 1 -- 172.21.15.32:0/376600888 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80cefe0 con 0x7fc8c80b30c0 2024-02-17T00:37:02.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f9009901640 1 --2- 172.21.15.32:0/520557367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc04fa80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9000009870 tx=0x7f900002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca3c8660ee45daf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f0aca7fc640 1 -- 172.21.15.32:0/3406938444 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac402ca80 con 0x7f0acc161200 2024-02-17T00:37:02.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f0aca7fc640 1 -- 172.21.15.32:0/3406938444 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac402cbe0 con 0x7f0acc161200 2024-02-17T00:37:02.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f90088ff640 1 -- 172.21.15.32:0/520557367 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000030840 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f90088ff640 1 -- 172.21.15.32:0/520557367 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90000309a0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f90088ff640 1 -- 172.21.15.32:0/520557367 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000030d30 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7fe8c91c5640 1 --2- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c40cdf70 0x7fe8c40ce3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097a0 tx=0x7fe8b402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d349450193a2a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7ff8a3fff640 1 -- 172.21.15.32:0/2663565503 >> v2:172.21.15.32:3300/0 conn(0x7ff89c006270 msgr2=0x7ff89c0066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7ff8a3fff640 1 --2- 172.21.15.32:0/2663565503 >> v2:172.21.15.32:3300/0 conn(0x7ff89c006270 0x7ff89c0066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7ff8a3fff640 1 -- 172.21.15.32:0/2663565503 >> v1:172.21.15.39:6789/0 conn(0x7ff89c055d10 legacy=0x7ff89c0366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7ff8a37fe640 1 -- 172.21.15.32:0/2663565503 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369198486 0 0) 0x7ff89c006c80 con 0x7ff89c055d10 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.674+0000 7ff8a3fff640 1 -- 172.21.15.32:0/2663565503 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c007520 con 0x7ff89c0df800 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f0aca7fc640 1 -- 172.21.15.32:0/3406938444 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac40343f0 con 0x7f0acc161200 2024-02-17T00:37:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.675+0000 7f5e9b7fe640 1 --2- 172.21.15.32:0/2839001143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94052480 0x7f5e940528b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e900097a0 tx=0x7f5e9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6826bec56ed3e8ab server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fe8c89c4640 1 -- 172.21.15.32:0/3808075335 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4031830 con 0x7fe8c40cdf70 2024-02-17T00:37:02.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fe8c89c4640 1 -- 172.21.15.32:0/3808075335 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4031990 con 0x7fe8c40cdf70 2024-02-17T00:37:02.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fe8c89c4640 1 -- 172.21.15.32:0/3808075335 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4031d00 con 0x7fe8c40cdf70 2024-02-17T00:37:02.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7ff8a3fff640 1 --2- 172.21.15.32:0/2663565503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c04fa40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff8980097a0 tx=0x7ff89802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0542adf6a4839b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f2f4a4e6640 1 -- start start 2024-02-17T00:37:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7ff8a37fe640 1 -- 172.21.15.32:0/2663565503 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898030800 con 0x7ff89c0df800 2024-02-17T00:37:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7ff8a37fe640 1 -- 172.21.15.32:0/2663565503 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898030960 con 0x7ff89c0df800 2024-02-17T00:37:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7ff8a37fe640 1 -- 172.21.15.32:0/2663565503 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898030cf0 con 0x7ff89c0df800 2024-02-17T00:37:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fbe77fff640 1 --2- 172.21.15.32:0/3245699241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe70033b90 0x7fbe7003a4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009870 tx=0x7fbe6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f36117770b7eb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f5e99ffb640 1 -- 172.21.15.32:0/2839001143 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90031830 con 0x7f5e94052480 2024-02-17T00:37:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f5e99ffb640 1 -- 172.21.15.32:0/2839001143 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e90031990 con 0x7f5e94052480 2024-02-17T00:37:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f5e99ffb640 1 -- 172.21.15.32:0/2839001143 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90031d20 con 0x7f5e94052480 2024-02-17T00:37:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 msgr2=0x7f8ffc04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fc8ccafb640 1 --2- 172.21.15.32:0/376600888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c80b3530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899746482eb5d06 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f0ad0a53640 1 -- 172.21.15.32:0/3406938444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc161200 msgr2=0x7f0acc0b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/3406938444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0acc08bed0 tx=0x7f0ac402bee0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c40cdf70 msgr2=0x7fe8c40ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fe8cbc2a640 1 --2- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c40cdf70 0x7fe8c40ce3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097a0 tx=0x7fe8b402b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fbe777fe640 1 -- 172.21.15.32:0/3245699241 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c031870 con 0x7fbe70033b90 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7fbe777fe640 1 -- 172.21.15.32:0/3245699241 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0319d0 con 0x7fbe70033b90 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fbe777fe640 1 -- 172.21.15.32:0/3245699241 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c031da0 con 0x7fbe70033b90 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3808075335 shutdown_connections 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fe8cbc2a640 1 --2- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c40cdf70 0x7fe8c40ce3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fe8cbc2a640 1 --2- 172.21.15.32:0/3808075335 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c41657d0 0x7fe8c4165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3808075335 >> 172.21.15.32:0/3808075335 conn(0x7fe8c4066d10 msgr2=0x7fe8c406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.676+0000 7f900bb65640 1 --2- 172.21.15.32:0/520557367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc04fa80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9000009870 tx=0x7f900002b980 comp rx=0 tx=0).stop 2024-02-17T00:37:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f0ad0a53640 1 -- 172.21.15.32:0/3406938444 shutdown_connections 2024-02-17T00:37:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/3406938444 >> v2:172.21.15.32:3300/0 conn(0x7f0acc0d07d0 0x7f0acc0b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/3406938444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f0ad0a53640 1 -- 172.21.15.32:0/3406938444 >> 172.21.15.32:0/3406938444 conn(0x7f0acc08af80 msgr2=0x7f0acc0d36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fc8c6ffd640 1 -- 172.21.15.32:0/376600888 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c002cc60 con 0x7fc8c80b30c0 2024-02-17T00:37:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3808075335 shutdown_connections 2024-02-17T00:37:02.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f4a4e6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2f4415a850 0x7f2f440cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94052480 msgr2=0x7f5e940528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 --2- 172.21.15.32:0/2839001143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94052480 0x7f5e940528b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e900097a0 tx=0x7f5e9002b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f4a4e6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/2663565503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 msgr2=0x7ff89c04fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 --2- 172.21.15.32:0/2663565503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c04fa40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff8980097a0 tx=0x7ff89802b940 comp rx=0 tx=0).stop 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/2663565503 shutdown_connections 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 --2- 172.21.15.32:0/2663565503 >> v2:172.21.15.32:3300/0 conn(0x7ff89c006270 0x7ff89c0066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 --2- 172.21.15.32:0/2663565503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c04fa40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/2663565503 >> 172.21.15.32:0/2663565503 conn(0x7ff89c01e6c0 msgr2=0x7ff89c0553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f4a4e6640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2f440cebf0 0x7f2f440caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 shutdown_connections 2024-02-17T00:37:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 --2- 172.21.15.32:0/2839001143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94052480 0x7f5e940528b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 >> 172.21.15.32:0/2839001143 conn(0x7f5e94020030 msgr2=0x7f5e94056d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/2663565503 shutdown_connections 2024-02-17T00:37:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f494e4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2f4415a850 0x7f2f440cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f494e4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2f4415a850 0x7f2f440cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57600/0 (socket says 172.21.15.32:57600) 2024-02-17T00:37:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 shutdown_connections 2024-02-17T00:37:02.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f48ce3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f494e4640 1 -- 172.21.15.32:0/448591926 learned_addr learned my addr 172.21.15.32:0/448591926 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f440cf040 con 0x7f2f440cebf0 2024-02-17T00:37:02.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f440b04b0 con 0x7f2f4415a850 2024-02-17T00:37:02.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440cdd60 con 0x7f2f440cd8b0 2024-02-17T00:37:02.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/2663565503 wait complete. 2024-02-17T00:37:02.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f0ad0a53640 1 -- 172.21.15.32:0/3406938444 shutdown_connections 2024-02-17T00:37:02.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 shutdown_connections 2024-02-17T00:37:02.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f900bb65640 1 --2- 172.21.15.32:0/520557367 >> v2:172.21.15.32:3300/0 conn(0x7f8ffc04ffc0 0x7f8ffc037bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f900bb65640 1 --2- 172.21.15.32:0/520557367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc04fa80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 >> 172.21.15.32:0/520557367 conn(0x7f8ffc009fa0 msgr2=0x7f8ffc00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f2f49ce5640 1 --2- 172.21.15.32:0/448591926 >> v2:172.21.15.32:3300/0 conn(0x7f2f440cebf0 0x7f2f440caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f2f494e4640 1 -- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 msgr2=0x7f2f440ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f2f494e4640 1 --2- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f2f494e4640 1 -- 172.21.15.32:0/448591926 >> v2:172.21.15.32:3300/0 conn(0x7f2f440cebf0 msgr2=0x7f2f440caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f2f494e4640 1 --2- 172.21.15.32:0/448591926 >> v2:172.21.15.32:3300/0 conn(0x7f2f440cebf0 0x7f2f440caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f2f494e4640 1 -- 172.21.15.32:0/448591926 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440afb80 con 0x7f2f4415a850 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fc8c6ffd640 1 -- 172.21.15.32:0/376600888 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c002cdc0 con 0x7fc8c80b30c0 2024-02-17T00:37:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 -- 172.21.15.32:0/376600888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 msgr2=0x7fc8c80b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f0ad0a53640 1 -- 172.21.15.32:0/3406938444 wait complete. 2024-02-17T00:37:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8c6ffd640 1 -- 172.21.15.32:0/376600888 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c002cc60 con 0x7fc8c80b30c0 2024-02-17T00:37:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 --2- 172.21.15.32:0/376600888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c80b3530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002beb0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3808075335 wait complete. 2024-02-17T00:37:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7f5ea18d4640 1 -- 172.21.15.32:0/2839001143 wait complete. 2024-02-17T00:37:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 -- 172.21.15.32:0/376600888 shutdown_connections 2024-02-17T00:37:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 --2- 172.21.15.32:0/376600888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c80b3530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 --2- 172.21.15.32:0/376600888 >> v2:172.21.15.32:3300/0 conn(0x7fc8c81657d0 0x7fc8c8165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 -- 172.21.15.32:0/376600888 >> 172.21.15.32:0/376600888 conn(0x7fc8c8066d10 msgr2=0x7fc8c806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fbe7ede9640 1 -- 172.21.15.32:0/3245699241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe70033b90 msgr2=0x7fbe7003a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.677+0000 7fbe7ede9640 1 --2- 172.21.15.32:0/3245699241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe70033b90 0x7fbe7003a4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009870 tx=0x7fbe6c02b910 comp rx=0 tx=0).stop 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fbe7ede9640 1 -- 172.21.15.32:0/3245699241 shutdown_connections 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fbe7ede9640 1 --2- 172.21.15.32:0/3245699241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe70033b90 0x7fbe7003a4a0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009870 tx=0x7fbe6c02b910 comp rx=0 tx=0).stop 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fbe7ede9640 1 --2- 172.21.15.32:0/3245699241 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe70039f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fbe7ede9640 1 -- 172.21.15.32:0/3245699241 >> 172.21.15.32:0/3245699241 conn(0x7fbe70009fe0 msgr2=0x7fbe7000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 -- 172.21.15.32:0/376600888 shutdown_connections 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 shutdown_connections 2024-02-17T00:37:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7f900bb65640 1 -- 172.21.15.32:0/520557367 wait complete. 2024-02-17T00:37:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7ff8a9c4c640 1 Processor -- start 2024-02-17T00:37:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7f2f49ce5640 1 --2- 172.21.15.32:0/448591926 >> v2:172.21.15.32:3300/0 conn(0x7f2f440cebf0 0x7f2f440caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7ff8a9c4c640 1 -- start start 2024-02-17T00:37:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7f5ea18d4640 1 Processor -- start 2024-02-17T00:37:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.678+0000 7fc8ce55e640 1 -- 172.21.15.32:0/376600888 wait complete. 2024-02-17T00:37:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7f2f494e4640 1 --2- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f4415a850 0x7f2f440cd370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f4406de90 tx=0x7f2f3c02e390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3db98ddfcb72390 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7fbe7ede9640 1 -- 172.21.15.32:0/3245699241 shutdown_connections 2024-02-17T00:37:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7fbe7ede9640 1 -- 172.21.15.32:0/3245699241 wait complete. 2024-02-17T00:37:02.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7f5ea18d4640 1 -- start start 2024-02-17T00:37:02.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7fe8cbc2a640 1 Processor -- start 2024-02-17T00:37:02.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.679+0000 7fe8cbc2a640 1 -- start start 2024-02-17T00:37:02.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f0ad0a53640 1 Processor -- start 2024-02-17T00:37:02.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f2f3bfff640 1 -- 172.21.15.32:0/448591926 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c035600 con 0x7f2f4415a850 2024-02-17T00:37:02.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f2f3bfff640 1 -- 172.21.15.32:0/448591926 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c031050 con 0x7f2f4415a850 2024-02-17T00:37:02.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f2f3bfff640 1 -- 172.21.15.32:0/448591926 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c035980 con 0x7f2f4415a850 2024-02-17T00:37:02.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f0ad0a53640 1 -- start start 2024-02-17T00:37:02.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fc8ce55e640 1 Processor -- start 2024-02-17T00:37:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f900bb65640 1 Processor -- start 2024-02-17T00:37:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7f900bb65640 1 -- start start 2024-02-17T00:37:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7ff8a9c4c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff89c006270 0x7ff89c04ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fc8ce55e640 1 -- start start 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7ff8a9c4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c055d10 0x7ff89c0dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7ff8a9c4c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c0e0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7ff8a9c4c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0d4e80 con 0x7ff89c006270 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7ff8a9c4c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0e1190 con 0x7ff89c055d10 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a9c4c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0e1470 con 0x7ff89c0df800 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8cbc2a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c40cdf70 0x7fe8c4145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8cbc2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c4162190 0x7fe8c41fae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8cbc2a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c41657d0 0x7fe8c41429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8cbc2a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41fb3b0 con 0x7fe8c41657d0 2024-02-17T00:37:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8cbc2a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41fb5e0 con 0x7fe8c4162190 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8cbc2a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41fb8c0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8ca1c7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c41657d0 0x7fe8c41429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8ca1c7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c41657d0 0x7fe8c41429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58620/0 (socket says 172.21.15.32:58620) 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8ca1c7640 1 -- 172.21.15.32:0/3352426084 learned_addr learned my addr 172.21.15.32:0/3352426084 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.680+0000 7fe8c99c6640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c40cdf70 0x7fe8c4145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff89c006270 0x7ff89c04ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff89c006270 0x7ff89c04ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58630/0 (socket says 172.21.15.32:58630) 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 -- 172.21.15.32:0/3849694059 learned_addr learned my addr 172.21.15.32:0/3849694059 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5ea18d4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94037680 0x7f5e9403afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a944b640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c0e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a3fff640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c055d10 0x7ff89c0dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5ea18d4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e94037a60 0x7f5e9403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7fe8c91c5640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c4162190 0x7fe8c41fae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5ea18d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5e94052480 0x7f5e940e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5ea18d4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940e4200 con 0x7f5e94037680 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5ea18d4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94186ab0 con 0x7f5e94037a60 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5ea18d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940e2a20 con 0x7f5e94052480 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5e9affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94037680 0x7f5e9403afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5e9affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94037680 0x7f5e9403afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58632/0 (socket says 172.21.15.32:58632) 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5e9affd640 1 -- 172.21.15.32:0/3892377212 learned_addr learned my addr 172.21.15.32:0/3892377212 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7f5e9a7fc640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e94037a60 0x7f5e9403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7fe8c99c6640 1 -- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c4162190 msgr2=0x7fe8c41fae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7fe8c99c6640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8c4162190 0x7fe8c41fae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 -- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 msgr2=0x7ff89c0e0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff89c0df800 0x7ff89c0e0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 -- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c055d10 msgr2=0x7ff89c0dfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c055d10 0x7ff89c0dfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0ad0a53640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0acc0d07d0 0x7f0acc0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7ff8a8c4a640 1 -- 172.21.15.32:0/3849694059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898009400 con 0x7ff89c006270 2024-02-17T00:37:02.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7fe8c99c6640 1 -- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c41657d0 msgr2=0x7fe8c41429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7fe8c99c6640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c41657d0 0x7fe8c41429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0ad0a53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc0d2380 0x7f0acc152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f900bb65640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ffc038100 0x7f8ffc04df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.681+0000 7fe8c99c6640 1 -- 172.21.15.32:0/3352426084 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009400 con 0x7fe8c40cdf70 2024-02-17T00:37:02.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0acb7fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0acc0d07d0 0x7f0acc0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f4415a850 msgr2=0x7f2f440cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 --2- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f4415a850 0x7f2f440cd370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f4406de90 tx=0x7f2f3c02e390 comp rx=0 tx=0).stop 2024-02-17T00:37:02.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0acb7fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0acc0d07d0 0x7f0acc0cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50340/0 (socket says 172.21.15.32:50340) 2024-02-17T00:37:02.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f900bb65640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ffc04ffc0 0x7f8ffc17c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7ff8a8c4a640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff89c006270 0x7ff89c04ecc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c460 tx=0x7ff89000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0acaffd640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc0d2380 0x7f0acc152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0acb7fe640 1 -- 172.21.15.32:0/2980767253 learned_addr learned my addr 172.21.15.32:0/2980767253 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f9009901640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ffc038100 0x7f8ffc04df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f9009901640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ffc038100 0x7f8ffc04df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57644/0 (socket says 172.21.15.32:57644) 2024-02-17T00:37:02.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f9009901640 1 -- 172.21.15.32:0/2314326474 learned_addr learned my addr 172.21.15.32:0/2314326474 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0acbfff640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f9009100640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ffc04ffc0 0x7f8ffc17c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0cb530 con 0x7f0acc161200 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f900bb65640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc0db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 shutdown_connections 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 --2- 172.21.15.32:0/448591926 >> v2:172.21.15.32:3300/0 conn(0x7f2f440cebf0 0x7f2f440caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 --2- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 --2- 172.21.15.32:0/448591926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f4415a850 0x7f2f440cd370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 >> 172.21.15.32:0/448591926 conn(0x7f2f440b1f70 msgr2=0x7f2f440b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc1530f0 con 0x7f0acc0d2380 2024-02-17T00:37:02.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7fbe7ede9640 1 Processor -- start 2024-02-17T00:37:02.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0ca8b0 con 0x7f0acc0d07d0 2024-02-17T00:37:02.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0db090 con 0x7f8ffc04ffc0 2024-02-17T00:37:02.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7fbe7ede9640 1 -- start start 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f5e9affd640 1 -- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5e94052480 msgr2=0x7f5e940e1cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f5e9affd640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5e94052480 0x7f5e940e1cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f5e9affd640 1 -- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e94037a60 msgr2=0x7f5e9403b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f5e9affd640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e94037a60 0x7f5e9403b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f5e9affd640 1 -- 172.21.15.32:0/3892377212 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90009400 con 0x7f5e94037680 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7fc8ce55e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c815f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0da410 con 0x7f8ffc038100 2024-02-17T00:37:02.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 shutdown_connections 2024-02-17T00:37:02.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7f900a102640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc0db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0da6f0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8ce55e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c80cdf70 0x7fc8c815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/448591926 wait complete. 2024-02-17T00:37:02.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8ce55e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c81657d0 0x7fc8c81f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8ce55e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c81f7d10 con 0x7fc8c81657d0 2024-02-17T00:37:02.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8ce55e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8153f20 con 0x7fc8c80cdf70 2024-02-17T00:37:02.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8ce55e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c815dfa0 con 0x7fc8c80b30c0 2024-02-17T00:37:02.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fe8c99c6640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c40cdf70 0x7fe8c4145f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d520 tx=0x7fe8c000d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f5e9affd640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94037680 0x7f5e9403afd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c050190 tx=0x7f5e9c068680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acaffd640 1 -- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0acc0d07d0 msgr2=0x7f0acc0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acaffd640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0acc0d07d0 0x7f0acc0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acaffd640 1 -- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0acc161200 msgr2=0x7f0acc0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890005480 con 0x7ff89c006270 2024-02-17T00:37:02.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8900035f0 con 0x7ff89c006270 2024-02-17T00:37:02.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.682+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8900039a0 con 0x7ff89c006270 2024-02-17T00:37:02.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acb7fe640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0acc0d07d0 0x7f0acc0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:02.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c815f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c815f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50368/0 (socket says 172.21.15.32:50368) 2024-02-17T00:37:02.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8c7fff640 1 -- 172.21.15.32:0/1958128458 learned_addr learned my addr 172.21.15.32:0/1958128458 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c0e1750 con 0x7ff89c006270 2024-02-17T00:37:02.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c0d7620 con 0x7ff89c006270 2024-02-17T00:37:02.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00125f0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0012750 con 0x7fe8c40cdf70 2024-02-17T00:37:02.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acaffd640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acaffd640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac4009b30 con 0x7f0acc0d2380 2024-02-17T00:37:02.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900a102640 1 -- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ffc038100 msgr2=0x7f8ffc04df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900a102640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ffc038100 0x7f8ffc04df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900a102640 1 -- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ffc04ffc0 msgr2=0x7f8ffc17c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acbfff640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0acc161200 0x7f0acc0b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:02.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0012ae0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900a102640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ffc04ffc0 0x7f8ffc17c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900a102640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000094d0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7fc8c77fe640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c80cdf70 0x7fc8c815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f900a102640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc0db4b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90040734b0 tx=0x7f9004068680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.683+0000 7f0acaffd640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc0d2380 0x7f0acc152bb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009fd0 tx=0x7f0ab400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c7fff640 1 -- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c80cdf70 msgr2=0x7fc8c815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c7fff640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c80cdf70 0x7fc8c815d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c7fff640 1 -- 172.21.15.32:0/1958128458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c81657d0 msgr2=0x7fc8c81f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7ff88effd640 1 -- 172.21.15.32:0/3849694059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff87c001030 con 0x7ff89c006270 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7ede9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe70033640 0x7fbe70049260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7ede9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe700497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7ede9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe700d42a0 0x7fbe7004ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7ede9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70035560 con 0x7fbe700d42a0 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7ede9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70034550 con 0x7fbe70033640 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7ede9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700347a0 con 0x7fbe700e4760 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c7fff640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c81657d0 0x7fc8c81f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c7fff640 1 -- 172.21.15.32:0/1958128458 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009a70 con 0x7fc8c80b30c0 2024-02-17T00:37:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c77fe640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c80cdf70 0x7fc8c815d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3352426084 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c41fbba0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3352426084 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c4142f30 con 0x7fe8c40cdf70 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7cb85640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe70033640 0x7fbe70049260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7cb85640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe70033640 0x7fbe70049260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57672/0 (socket says 172.21.15.32:57672) 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe7cb85640 1 -- 172.21.15.32:0/1549535115 learned_addr learned my addr 172.21.15.32:0/1549535115 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fbe77fff640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe700497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe700d42a0 0x7fbe7004ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7fc8c7fff640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c815f2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00b410 tx=0x7fc8bc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7f2f4a4e6640 1 Processor -- start 2024-02-17T00:37:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004067ef0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7f2f4a4e6640 1 -- start start 2024-02-17T00:37:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011830 con 0x7f0acc0d2380 2024-02-17T00:37:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4011990 con 0x7f0acc0d2380 2024-02-17T00:37:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011d40 con 0x7f0acc0d2380 2024-02-17T00:37:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc0cab90 con 0x7f0acc0d2380 2024-02-17T00:37:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc0cb150 con 0x7f0acc0d2380 2024-02-17T00:37:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9004073b40 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.684+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004092400 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc0da9d0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c073ae0 con 0x7f5e94037680 2024-02-17T00:37:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c073c40 con 0x7f5e94037680 2024-02-17T00:37:02.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3352426084 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8c4157530 con 0x7fe8c40cdf70 2024-02-17T00:37:02.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c092640 con 0x7f5e94037680 2024-02-17T00:37:02.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc011830 con 0x7fc8c80b30c0 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc011990 con 0x7fc8c80b30c0 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc011d40 con 0x7fc8c80b30c0 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c815e280 con 0x7fc8c80b30c0 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c815e840 con 0x7fc8c80b30c0 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f5ea18d4640 1 -- 172.21.15.32:0/3892377212 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e940e2d00 con 0x7f5e94037680 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc04e460 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0acc0d42b0 con 0x7f0acc0d2380 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0ab401a400 con 0x7f0acc0d2380 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f0ac3fff640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0aac06b8e0 0x7f0aac06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0ab408a500 con 0x7f0acc0d2380 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f0ac3fff640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] conn(0x7f0aac074fd0 0x7f0aac077410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0aac077ae0 con 0x7f0aac074fd0 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab4011ea0 con 0x7f0acc0d2380 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7f0acb7fe640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0aac06b8e0 0x7f0aac06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7f0acbfff640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] conn(0x7f0aac074fd0 0x7f0aac077410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ffc038ca0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 -- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 msgr2=0x7fbe700497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe700e4760 0x7fbe700497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 -- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe70033640 msgr2=0x7fbe70049260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe70033640 0x7fbe70049260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 -- 172.21.15.32:0/1549535115 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0094d0 con 0x7fbe700d42a0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.685+0000 7fbe7d386640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe700d42a0 0x7fbe7004ce10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe780734b0 tx=0x7fbe78068680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78073ce0 con 0x7fbe700d42a0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78067fd0 con 0x7fbe700d42a0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7fbe7ede9640 1 -- 172.21.15.32:0/1549535115 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe70034a80 con 0x7fbe700d42a0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78062260 con 0x7fbe700d42a0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7fbe7ede9640 1 -- 172.21.15.32:0/1549535115 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe70035040 con 0x7fbe700d42a0 2024-02-17T00:37:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f5ea18d4640 1 -- 172.21.15.32:0/3892377212 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e940e32c0 con 0x7f5e94037680 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f4a4e6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f4a4e6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f440cebf0 0x7f2f441ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f4a4e6640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f4415a850 0x7f2f4415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f4a4e6640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4415bb60 con 0x7f2f4415a850 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f4a4e6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4415d8f0 con 0x7f2f440cebf0 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f4a4e6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f441efeb0 con 0x7f2f440cd8b0 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f494e4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f494e4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50376/0 (socket says 172.21.15.32:50376) 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7f2f494e4640 1 -- 172.21.15.32:0/2053963571 learned_addr learned my addr 172.21.15.32:0/2053963571 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f2f49ce5640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f4415a850 0x7f2f4415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f2f49ce5640 1 -- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 msgr2=0x7f2f440c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f2f49ce5640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2f440cd8b0 0x7f2f440c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f2f49ce5640 1 -- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f440cebf0 msgr2=0x7f2f441ef970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f2f49ce5640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f440cebf0 0x7f2f441ef970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7f2f49ce5640 1 -- 172.21.15.32:0/2053963571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009b30 con 0x7f2f4415a850 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7f2f49ce5640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f4415a850 0x7f2f4415c970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c5c0 tx=0x7f2f3400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.686+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff890003b00 con 0x7ff89c006270 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7ff8a17fa640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff88806b8e0 0x7ff88806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff890089f90 con 0x7ff89c006270 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7ff8a17fa640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] conn(0x7ff888074fd0 0x7ff888077410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 --> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff888077ae0 con 0x7ff888074fd0 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8900546e0 con 0x7ff89c006270 2024-02-17T00:37:02.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7ff8a944b640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] conn(0x7ff888074fd0 0x7ff888077410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.687+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8c806b3d0 con 0x7fc8c80b30c0 2024-02-17T00:37:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc8bc01a400 con 0x7fc8c80b30c0 2024-02-17T00:37:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7ff8a944b640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] conn(0x7ff888074fd0 0x7ff888077410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe8c0012c40 con 0x7fe8c40cdf70 2024-02-17T00:37:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fe8ba7fc640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe8a806b8e0 0x7fe8a806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe8c008b530 con 0x7fe8c40cdf70 2024-02-17T00:37:02.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f0acb7fe640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0aac06b8e0 0x7f0aac06dda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ac402bf20 tx=0x7f0ac4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fe8ba7fc640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] conn(0x7fe8a8075050 0x7fe8a8077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9004092560 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34011800 con 0x7f2f4415a850 2024-02-17T00:37:02.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 --> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8a8077b60 con 0x7fe8a8075050 2024-02-17T00:37:02.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8c008b8e0 con 0x7fe8c40cdf70 2024-02-17T00:37:02.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7ff8a3fff640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff88806b8e0 0x7ff88806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34011960 con 0x7f2f4415a850 2024-02-17T00:37:02.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fe8ca1c7640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] conn(0x7fe8a8075050 0x7fe8a8077490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f8ffa7fc640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fe806b810 0x7f8fe806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9004104840 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f9009901640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fe806b810 0x7f8fe806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f8ffa7fc640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] conn(0x7f8fe8074f10 0x7f8fe8077350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fe8077a20 con 0x7f8fe8074f10 2024-02-17T00:37:02.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34011800 con 0x7f2f4415a850 2024-02-17T00:37:02.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f0acbfff640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] conn(0x7f0aac074fd0 0x7f0aac077410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90040ceea0 con 0x7f8ffc0eacf0 2024-02-17T00:37:02.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7f9009901640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fe806b810 0x7f8fe806dcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9000009280 tx=0x7f9000008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/2053963571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4415aee0 con 0x7f2f4415a850 2024-02-17T00:37:02.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7f2f4a4e6640 1 -- 172.21.15.32:0/2053963571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4415b4a0 con 0x7f2f4415a850 2024-02-17T00:37:02.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== osd.6 v2:172.21.15.39:6816/4203051677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff888077ae0 con 0x7ff888074fd0 2024-02-17T00:37:02.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7fc8c4ff9640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8b406b810 0x7fc8b406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc8bc08a6f0 con 0x7fc8c80b30c0 2024-02-17T00:37:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7fc8c4ff9640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] conn(0x7fc8b4074f00 0x7fc8b4077340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.688+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 --> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8b4077a10 con 0x7fc8b4074f00 2024-02-17T00:37:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fc8c77fe640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8b406b810 0x7fc8b406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8bc011ea0 con 0x7fc8c80b30c0 2024-02-17T00:37:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.689+0000 7fc8ccafb640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] conn(0x7fc8b4074f00 0x7fc8b4077340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7fe8ca1c7640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] conn(0x7fe8a8075050 0x7fe8a8077490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe50001030 con 0x7fbe700d42a0 2024-02-17T00:37:02.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbe780623c0 con 0x7fbe700d42a0 2024-02-17T00:37:02.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7f9009100640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] conn(0x7f8fe8074f10 0x7f8fe8077350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7fe8c91c5640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe8a806b8e0 0x7fe8a806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== osd.0 v2:172.21.15.32:6818/3739667141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0aac077ae0 con 0x7f0aac074fd0 2024-02-17T00:37:02.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7f5ea18d4640 1 -- 172.21.15.32:0/3892377212 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e94000b20 con 0x7f5e94037680 2024-02-17T00:37:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fbe757fa640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe5c06b8e0 0x7fbe5c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fbe7cb85640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe5c06b8e0 0x7fbe5c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f4406cda0 con 0x7f2f4415a850 2024-02-17T00:37:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbe78104120 con 0x7fbe700d42a0 2024-02-17T00:37:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fe8c91c5640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe8a806b8e0 0x7fe8a806dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4036000 tx=0x7fe8b403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.690+0000 7fc8c77fe640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8b406b810 0x7fc8b406dcd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8c81fbe00 tx=0x7fc8b8007c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fbe757fa640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] conn(0x7fbe5c074e60 0x7fbe5c0772a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 --> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe5c077970 con 0x7fbe5c074e60 2024-02-17T00:37:02.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== osd.1 v2:172.21.15.32:6816/3524684164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe8a8077b60 con 0x7fe8a8075050 2024-02-17T00:37:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7ff8a3fff640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff88806b8e0 0x7ff88806dda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff898036000 tx=0x7ff89803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5e9c0927a0 con 0x7f5e94037680 2024-02-17T00:37:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.691+0000 7f9009100640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] conn(0x7f8fe8074f10 0x7f8fe8077350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e83fff640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5e8806b8e0 0x7f5e8806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7fc8ccafb640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] conn(0x7fc8b4074f00 0x7fc8b4077340 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5e9c104aa0 con 0x7f5e94037680 2024-02-17T00:37:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e9a7fc640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5e8806b8e0 0x7f5e8806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7fbe7cb85640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe5c06b8e0 0x7fbe5c06dda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe64007a60 tx=0x7fbe64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e83fff640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] conn(0x7f5e88074fe0 0x7f5e88077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 --> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e88077af0 con 0x7f5e88074fe0 2024-02-17T00:37:02.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e9c0cef00 con 0x7f5e94037680 2024-02-17T00:37:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7fbe77fff640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] conn(0x7fbe5c074e60 0x7fbe5c0772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7f5e9b7fe640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] conn(0x7f5e88074fe0 0x7f5e88077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== osd.2 v2:172.21.15.32:6808/3819571530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8fe8077a20 con 0x7f8fe8074f10 2024-02-17T00:37:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7f5e9a7fc640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5e8806b8e0 0x7f5e8806dda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e9404d930 tx=0x7f5e8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2f34011ad0 con 0x7f2f4415a850 2024-02-17T00:37:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== osd.7 v2:172.21.15.39:6808/4207552871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc8b4077a10 con 0x7fc8b4074f00 2024-02-17T00:37:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7f5e9b7fe640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] conn(0x7f5e88074fe0 0x7f5e88077420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7f2f39ffb640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2f2806b900 0x7f2f2806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.692+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe780ce920 con 0x7fbe700d42a0 2024-02-17T00:37:02.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.693+0000 7fbe77fff640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] conn(0x7fbe5c074e60 0x7fbe5c0772a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== osd.4 v2:172.21.15.39:6817/3708375265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5e88077af0 con 0x7f5e88074fe0 2024-02-17T00:37:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2f340551f0 con 0x7f2f4415a850 2024-02-17T00:37:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f2f494e4640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2f2806b900 0x7f2f2806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f2f39ffb640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] conn(0x7f2f28074f70 0x7f2f280773b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 --> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f28077a80 con 0x7f2f28074f70 2024-02-17T00:37:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f34011800 con 0x7f2f4415a850 2024-02-17T00:37:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.695+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== osd.3 v2:172.21.15.32:6800/154825715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbe5c077970 con 0x7fbe5c074e60 2024-02-17T00:37:02.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.694+0000 7f2f48ce3640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] conn(0x7f2f28074f70 0x7f2f280773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:02.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.695+0000 7f2f494e4640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2f2806b900 0x7f2f2806ddc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c000f80 tx=0x7f2f3c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.700+0000 7f2f48ce3640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] conn(0x7f2f28074f70 0x7f2f280773b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:02.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.701+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== osd.5 v2:172.21.15.39:6800/3921495390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2f28077a80 con 0x7f2f28074f70 2024-02-17T00:37:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.712+0000 7ff88effd640 1 -- 172.21.15.32:0/3849694059 --> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff87c002d30 con 0x7ff888074fd0 2024-02-17T00:37:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.713+0000 7ff8a17fa640 1 -- 172.21.15.32:0/3849694059 <== osd.6 v2:172.21.15.39:6816/4203051677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff87c002d30 con 0x7ff888074fd0 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.713+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] conn(0x7ff888074fd0 msgr2=0x7ff888077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.713+0000 7ff8a9c4c640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6816/4203051677,v1:172.21.15.39:6818/4203051677] conn(0x7ff888074fd0 0x7ff888077410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff88806b8e0 msgr2=0x7ff88806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a9c4c640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff88806b8e0 0x7ff88806dda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff898036000 tx=0x7ff89803b040 comp rx=0 tx=0).stop 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff89c006270 msgr2=0x7ff89c04ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a9c4c640 1 --2- 172.21.15.32:0/3849694059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff89c006270 0x7ff89c04ecc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c460 tx=0x7ff89000c920 comp rx=0 tx=0).stop 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a944b640 1 -- 172.21.15.32:0/3849694059 reap_dead start 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 shutdown_connections 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.714+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 >> 172.21.15.32:0/3849694059 conn(0x7ff89c01e6c0 msgr2=0x7ff89c03a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.715+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 shutdown_connections 2024-02-17T00:37:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.715+0000 7ff8a9c4c640 1 -- 172.21.15.32:0/3849694059 wait complete. 2024-02-17T00:37:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.723+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 --> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0acc0d3fd0 con 0x7f0aac074fd0 2024-02-17T00:37:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.724+0000 7f0ac3fff640 1 -- 172.21.15.32:0/2980767253 <== osd.0 v2:172.21.15.32:6818/3739667141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0abc00b620 con 0x7f0aac074fd0 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.724+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] conn(0x7f0aac074fd0 msgr2=0x7f0aac077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.724+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.32:6818/3739667141,v1:172.21.15.32:6820/3739667141] conn(0x7f0aac074fd0 0x7f0aac077410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0aac06b8e0 msgr2=0x7f0aac06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0aac06b8e0 0x7f0aac06dda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ac402bf20 tx=0x7f0ac4030000 comp rx=0 tx=0).stop 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc0d2380 msgr2=0x7f0acc152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0ad0a53640 1 --2- 172.21.15.32:0/2980767253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0acc0d2380 0x7f0acc152bb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009fd0 tx=0x7f0ab400b870 comp rx=0 tx=0).stop 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0acbfff640 1 -- 172.21.15.32:0/2980767253 reap_dead start 2024-02-17T00:37:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 shutdown_connections 2024-02-17T00:37:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 >> 172.21.15.32:0/2980767253 conn(0x7f0acc08af80 msgr2=0x7f0acc0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.726+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 shutdown_connections 2024-02-17T00:37:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.725+0000 7fe8cbc2a640 1 -- 172.21.15.32:0/3352426084 --> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8c4071e10 con 0x7fe8a8075050 2024-02-17T00:37:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.726+0000 7fe8ba7fc640 1 -- 172.21.15.32:0/3352426084 <== osd.1 v2:172.21.15.32:6816/3524684164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe8c4071e10 con 0x7fe8a8075050 2024-02-17T00:37:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.726+0000 7f0ad0a53640 1 -- 172.21.15.32:0/2980767253 wait complete. 2024-02-17T00:37:02.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.726+0000 7f900bb65640 1 -- 172.21.15.32:0/2314326474 --> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ffc0db1d0 con 0x7f8fe8074f10 2024-02-17T00:37:02.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.726+0000 7f8ffa7fc640 1 -- 172.21.15.32:0/2314326474 <== osd.2 v2:172.21.15.32:6808/3819571530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ffc0db1d0 con 0x7f8fe8074f10 2024-02-17T00:37:02.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] conn(0x7fe8a8075050 msgr2=0x7fe8a8077490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.32:6816/3524684164,v1:172.21.15.32:6817/3524684164] conn(0x7fe8a8075050 0x7fe8a8077490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe8a806b8e0 msgr2=0x7fe8a806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe8a806b8e0 0x7fe8a806dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4036000 tx=0x7fe8b403d040 comp rx=0 tx=0).stop 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c40cdf70 msgr2=0x7fe8c4145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 --2- 172.21.15.32:0/3352426084 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe8c40cdf70 0x7fe8c4145f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d520 tx=0x7fe8c000d9e0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8ca1c7640 1 -- 172.21.15.32:0/3352426084 reap_dead start 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 shutdown_connections 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 >> 172.21.15.32:0/3352426084 conn(0x7fe8c4066d10 msgr2=0x7fe8c415fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] conn(0x7f8fe8074f10 msgr2=0x7f8fe8077350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f8fe7fff640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.32:6808/3819571530,v1:172.21.15.32:6809/3819571530] conn(0x7f8fe8074f10 0x7f8fe8077350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f5ea18d4640 1 -- 172.21.15.32:0/3892377212 --> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e94051970 con 0x7f5e88074fe0 2024-02-17T00:37:02.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 shutdown_connections 2024-02-17T00:37:02.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 --> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8c80b2ba0 con 0x7fc8b4074f00 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7fe8a7fff640 1 -- 172.21.15.32:0/3352426084 wait complete. 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fe806b810 msgr2=0x7f8fe806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f8fe7fff640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fe806b810 0x7f8fe806dcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9000009280 tx=0x7f9000008030 comp rx=0 tx=0).stop 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 msgr2=0x7f8ffc0db4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.727+0000 7f8fe7fff640 1 --2- 172.21.15.32:0/2314326474 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8ffc0eacf0 0x7f8ffc0db4b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90040734b0 tx=0x7f9004068680 comp rx=0 tx=0).stop 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7f900a102640 1 -- 172.21.15.32:0/2314326474 reap_dead start 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 shutdown_connections 2024-02-17T00:37:02.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 >> 172.21.15.32:0/2314326474 conn(0x7f8ffc009fa0 msgr2=0x7f8ffc004a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7f5e83fff640 1 -- 172.21.15.32:0/3892377212 <== osd.4 v2:172.21.15.39:6817/3708375265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e90031b00 con 0x7f5e88074fe0 2024-02-17T00:37:02.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7fc8c4ff9640 1 -- 172.21.15.32:0/1958128458 <== osd.7 v2:172.21.15.39:6808/4207552871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8c002cc30 con 0x7fc8b4074f00 2024-02-17T00:37:02.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 shutdown_connections 2024-02-17T00:37:02.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.728+0000 7f8fe7fff640 1 -- 172.21.15.32:0/2314326474 wait complete. 2024-02-17T00:37:02.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] conn(0x7f5e88074fe0 msgr2=0x7f5e88077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6817/3708375265,v1:172.21.15.39:6819/3708375265] conn(0x7f5e88074fe0 0x7f5e88077420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5e8806b8e0 msgr2=0x7f5e8806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5e8806b8e0 0x7f5e8806dda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e9404d930 tx=0x7f5e8c009040 comp rx=0 tx=0).stop 2024-02-17T00:37:02.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94037680 msgr2=0x7f5e9403afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 --2- 172.21.15.32:0/3892377212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e94037680 0x7f5e9403afd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c050190 tx=0x7f5e9c068680 comp rx=0 tx=0).stop 2024-02-17T00:37:02.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 --> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe50002cb0 con 0x7fbe5c074e60 2024-02-17T00:37:02.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e9b7fe640 1 -- 172.21.15.32:0/3892377212 reap_dead start 2024-02-17T00:37:02.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 shutdown_connections 2024-02-17T00:37:02.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 >> 172.21.15.32:0/3892377212 conn(0x7f5e94020030 msgr2=0x7f5e94004e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 shutdown_connections 2024-02-17T00:37:02.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7f5e81ffb640 1 -- 172.21.15.32:0/3892377212 wait complete. 2024-02-17T00:37:02.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.729+0000 7fbe757fa640 1 -- 172.21.15.32:0/1549535115 <== osd.3 v2:172.21.15.32:6800/154825715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe50002cb0 con 0x7fbe5c074e60 2024-02-17T00:37:02.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] conn(0x7fc8b4074f00 msgr2=0x7fc8b4077340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6808/4207552871,v1:172.21.15.39:6809/4207552871] conn(0x7fc8b4074f00 0x7fc8b4077340 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] conn(0x7fbe5c074e60 msgr2=0x7fbe5c0772a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fbe62ffd640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:6800/154825715,v1:172.21.15.32:6801/154825715] conn(0x7fbe5c074e60 0x7fbe5c0772a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.782 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:02.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8b406b810 msgr2=0x7fc8b406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8b406b810 0x7fc8b406dcd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8c81fbe00 tx=0x7fc8b8007c50 comp rx=0 tx=0).stop 2024-02-17T00:37:02.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 msgr2=0x7fc8c815f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 --2- 172.21.15.32:0/1958128458 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8c80b30c0 0x7fc8c815f2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00b410 tx=0x7fc8bc00b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ccafb640 1 -- 172.21.15.32:0/1958128458 reap_dead start 2024-02-17T00:37:02.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-17T00:37:02.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 --> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f4406cda0 con 0x7f2f28074f70 2024-02-17T00:37:02.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe5c06b8e0 msgr2=0x7fbe5c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fbe62ffd640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe5c06b8e0 0x7fbe5c06dda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe64007a60 tx=0x7fbe64008040 comp rx=0 tx=0).stop 2024-02-17T00:37:02.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 shutdown_connections 2024-02-17T00:37:02.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 >> 172.21.15.32:0/1958128458 conn(0x7fc8c8066d10 msgr2=0x7fc8c815a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe700d42a0 msgr2=0x7fbe7004ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.730+0000 7fbe62ffd640 1 --2- 172.21.15.32:0/1549535115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe700d42a0 0x7fbe7004ce10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe780734b0 tx=0x7fbe78068680 comp rx=0 tx=0).stop 2024-02-17T00:37:02.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fbe7d386640 1 -- 172.21.15.32:0/1549535115 reap_dead start 2024-02-17T00:37:02.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 shutdown_connections 2024-02-17T00:37:02.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 >> 172.21.15.32:0/1549535115 conn(0x7fbe70009fe0 msgr2=0x7fbe700503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7f2f39ffb640 1 -- 172.21.15.32:0/2053963571 <== osd.5 v2:172.21.15.39:6800/3921495390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f4406cda0 con 0x7f2f28074f70 2024-02-17T00:37:02.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 shutdown_connections 2024-02-17T00:37:02.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fbe62ffd640 1 -- 172.21.15.32:0/1549535115 wait complete. 2024-02-17T00:37:02.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 shutdown_connections 2024-02-17T00:37:02.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7fc8ce55e640 1 -- 172.21.15.32:0/1958128458 wait complete. 2024-02-17T00:37:02.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] conn(0x7f2f28074f70 msgr2=0x7f2f280773b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.731+0000 7f2f277fe640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6800/3921495390,v1:172.21.15.39:6801/3921495390] conn(0x7f2f28074f70 0x7f2f280773b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2f2806b900 msgr2=0x7f2f2806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2f2806b900 0x7f2f2806ddc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c000f80 tx=0x7f2f3c009000 comp rx=0 tx=0).stop 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f4415a850 msgr2=0x7f2f4415c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 --2- 172.21.15.32:0/2053963571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f4415a850 0x7f2f4415c970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c5c0 tx=0x7f2f3400ca80 comp rx=0 tx=0).stop 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f49ce5640 1 -- 172.21.15.32:0/2053963571 reap_dead start 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 shutdown_connections 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 >> 172.21.15.32:0/2053963571 conn(0x7f2f440b1f70 msgr2=0x7f2f440cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 shutdown_connections 2024-02-17T00:37:02.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.732+0000 7f2f277fe640 1 -- 172.21.15.32:0/2053963571 wait complete. 2024-02-17T00:37:02.790 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:02.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T00:37:02.791 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:02.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T00:37:02.792 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:02.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-17T00:37:02.793 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:02.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T00:37:02.794 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:02.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T00:37:02.795 INFO:teuthology.orchestra.run.smithi032.stdout:55834574858 2024-02-17T00:37:02.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T00:37:02.796 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:02.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T00:37:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.999+0000 7fec76af4640 1 Processor -- start 2024-02-17T00:37:03.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:02.999+0000 7fec76af4640 1 -- start start 2024-02-17T00:37:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.000+0000 7fec76af4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fec7015c570 0x7fec700b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.000+0000 7fec76af4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec700cdf80 0x7fec700ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec76af4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700ce8f0 con 0x7fec700d0020 2024-02-17T00:37:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec76af4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec701634a0 con 0x7fec700cdf80 2024-02-17T00:37:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7ff9d58c3640 1 Processor -- start 2024-02-17T00:37:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec76af4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec700b5930 con 0x7fec7015c570 2024-02-17T00:37:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec75091640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec700cdf80 0x7fec700ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7ff9d58c3640 1 -- start start 2024-02-17T00:37:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec75091640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec700cdf80 0x7fec700ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58664/0 (socket says 172.21.15.32:58664) 2024-02-17T00:37:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec75091640 1 -- 172.21.15.32:0/2667876021 learned_addr learned my addr 172.21.15.32:0/2667876021 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7fec74890640 1 --2- 172.21.15.32:0/2667876021 >> v2:172.21.15.39:3300/0 conn(0x7fec7015c570 0x7fec700b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.001+0000 7f54f1f93640 1 Processor -- start 2024-02-17T00:37:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7f54f1f93640 1 -- start start 2024-02-17T00:37:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7f0385c92640 1 Processor -- start 2024-02-17T00:37:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fec74890640 1 -- 172.21.15.32:0/2667876021 >> v2:172.21.15.32:3300/0 conn(0x7fec700cdf80 msgr2=0x7fec700ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fec74890640 1 --2- 172.21.15.32:0/2667876021 >> v2:172.21.15.32:3300/0 conn(0x7fec700cdf80 0x7fec700ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fb04da53640 1 Processor -- start 2024-02-17T00:37:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fb04da53640 1 -- start start 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fec74890640 1 -- 172.21.15.32:0/2667876021 >> v1:172.21.15.32:6789/0 conn(0x7fec700d0020 legacy=0x7fec70162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fec74890640 1 -- 172.21.15.32:0/2667876021 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700b6290 con 0x7fec7015c570 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7ff9d58c3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9c80ead00 0x7ff9c804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7ff9d58c3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c8007380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7ff9d58c3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c8054330 con 0x7ff9c804ffd0 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7ff9d58c3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c80078c0 con 0x7ff9c80ead00 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7ff9d58c3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8053720 con 0x7ff9c8006ef0 2024-02-17T00:37:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7f7af86a7640 1 Processor -- start 2024-02-17T00:37:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fd542e9d640 1 Processor -- start 2024-02-17T00:37:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7ff9d48c1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9c80ead00 0x7ff9c804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d48c1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9c80ead00 0x7ff9c804fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57698/0 (socket says 172.21.15.32:57698) 2024-02-17T00:37:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d48c1640 1 -- 172.21.15.32:0/1606153350 learned_addr learned my addr 172.21.15.32:0/1606153350 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d50c2640 1 --2- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c8007380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7f7af86a7640 1 -- start start 2024-02-17T00:37:03.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7fd542e9d640 1 -- start start 2024-02-17T00:37:03.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.002+0000 7f0385c92640 1 -- start start 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7f54f1f93640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54ec0cd410 0x7f54ec16ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7f54f1f93640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec1658a0 con 0x7f54ec15c380 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7f54f1f93640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec165af0 con 0x7f54ec0b16e0 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7f54f1f93640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec15c760 con 0x7f54ec0cd410 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7f54eaffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f54ec0b16e0 0x7f54ec0ccd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:56784/0 (socket says 172.21.15.32:56784) 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7f54eaffd640 1 -- 172.21.15.32:0/2510913293 learned_addr learned my addr 172.21.15.32:0/2510913293 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d48c1640 1 -- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 msgr2=0x7ff9c8007380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d48c1640 1 --2- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c8007380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d48c1640 1 -- 172.21.15.32:0/1606153350 >> v1:172.21.15.39:6789/0 conn(0x7ff9c804ffd0 legacy=0x7ff9c8037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7ff9d48c1640 1 -- 172.21.15.32:0/1606153350 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8053a00 con 0x7ff9c80ead00 2024-02-17T00:37:03.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7fb04da53640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040051640 0x7fb040055cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7fec74890640 1 --2- 172.21.15.32:0/2667876021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec7015c570 0x7fec700b5d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec700d4940 tx=0x7fec6802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d03c59841343d23e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7fb04da53640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb040056230 0x7fb040009db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f54ebfff640 1 --2- 172.21.15.32:0/2510913293 >> v2:172.21.15.32:3300/0 conn(0x7f54ec0cd410 0x7f54ec16ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd542e9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd534053e50 0x7fd5340542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd542e9d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd53404f930 0x7fd53404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f0384c90640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f038015d8a0 0x7f03800d3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38722/0 (socket says 172.21.15.32:38722) 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7fb04ca51640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb0400e1290 0x7fb04003a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38700/0 (socket says 172.21.15.32:38700) 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7fb047fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040051640 0x7fb040055cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.003+0000 7fb047fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040051640 0x7fb040055cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50404/0 (socket says 172.21.15.32:50404) 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04da53640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb040055860 con 0x7fb0400e1290 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04da53640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400527f0 con 0x7fb040056230 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04da53640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb040054c50 con 0x7fb040051640 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04ca51640 1 -- 172.21.15.32:0/3978795748 learned_addr learned my addr 172.21.15.32:0/3978795748 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:03.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04d252640 1 --2- 172.21.15.32:0/3978795748 >> v2:172.21.15.39:3300/0 conn(0x7fb040056230 0x7fb040009db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f0384c90640 1 -- 172.21.15.32:0/1328458339 learned_addr learned my addr 172.21.15.32:0/1328458339 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af86a7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ae80eacf0 0x7f7ae804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd540c39640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd534048100 0x7fd534006f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38718/0 (socket says 172.21.15.32:38718) 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd53bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd534053e50 0x7fd5340542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd54143a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd53404f930 0x7fd53404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd54143a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd53404f930 0x7fd53404fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58678/0 (socket says 172.21.15.32:58678) 2024-02-17T00:37:03.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd542e9d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd534006ae0 con 0x7fd534048100 2024-02-17T00:37:03.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340484e0 con 0x7fd53404f930 2024-02-17T00:37:03.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af86a7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd540c39640 1 -- 172.21.15.32:0/1306155549 learned_addr learned my addr 172.21.15.32:0/1306155549 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:03.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd534054820 con 0x7fd534053e50 2024-02-17T00:37:03.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04d252640 1 -- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040051640 msgr2=0x7fb040055cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04d252640 1 --2- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040051640 0x7fb040055cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04d252640 1 -- 172.21.15.32:0/3978795748 >> v1:172.21.15.32:6789/0 conn(0x7fb0400e1290 legacy=0x7fb04003a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af86a7640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae8054320 con 0x7f7ae804ffc0 2024-02-17T00:37:03.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fec6f7fe640 1 -- 172.21.15.32:0/2667876021 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6802cbf0 con 0x7fec7015c570 2024-02-17T00:37:03.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af86a7640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae80078b0 con 0x7f7ae80eacf0 2024-02-17T00:37:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af86a7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8053710 con 0x7f7ae8006ee0 2024-02-17T00:37:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af6c44640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af6c44640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8007370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50406/0 (socket says 172.21.15.32:50406) 2024-02-17T00:37:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af6c44640 1 -- 172.21.15.32:0/1221622649 learned_addr learned my addr 172.21.15.32:0/1221622649 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd96953a640 1 Processor -- start 2024-02-17T00:37:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fec6f7fe640 1 -- 172.21.15.32:0/2667876021 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6802cd50 con 0x7fec7015c570 2024-02-17T00:37:03.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f7af6443640 1 --2- 172.21.15.32:0/1221622649 >> v2:172.21.15.39:3300/0 conn(0x7f7ae80eacf0 0x7f7ae804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7fec6f7fe640 1 -- 172.21.15.32:0/2667876021 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68034660 con 0x7fec7015c570 2024-02-17T00:37:03.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fd96953a640 1 -- start start 2024-02-17T00:37:03.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f7af6c44640 1 -- 172.21.15.32:0/1221622649 >> v2:172.21.15.39:3300/0 conn(0x7f7ae80eacf0 msgr2=0x7f7ae804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7fb04d252640 1 -- 172.21.15.32:0/3978795748 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040054f30 con 0x7fb040056230 2024-02-17T00:37:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f7af6c44640 1 --2- 172.21.15.32:0/1221622649 >> v2:172.21.15.39:3300/0 conn(0x7f7ae80eacf0 0x7f7ae804fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f7af6c44640 1 -- 172.21.15.32:0/1221622649 >> v1:172.21.15.32:6789/0 conn(0x7f7ae804ffc0 legacy=0x7f7ae8037bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f7af6c44640 1 -- 172.21.15.32:0/1221622649 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae80539f0 con 0x7f7ae8006ee0 2024-02-17T00:37:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7ff9d48c1640 1 --2- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c804fa90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009870 tx=0x7ff9bc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adfcdeecb12e3585 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f0385c92640 1 --2- 172.21.15.32:0/1328458339 >> v2:172.21.15.32:3300/0 conn(0x7f03800b2f30 0x7f03800d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.004+0000 7f0385c92640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03801614e0 0x7f0380161990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038015ffe0 con 0x7f038015d8a0 2024-02-17T00:37:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0380161ed0 con 0x7f03800b2f30 2024-02-17T00:37:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038015f410 con 0x7f03801614e0 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f54ebfff640 1 -- 172.21.15.32:0/2510913293 >> v1:172.21.15.39:6789/0 conn(0x7f54ec0b16e0 legacy=0x7f54ec0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f54ebfff640 1 -- 172.21.15.32:0/2510913293 >> v1:172.21.15.32:6789/0 conn(0x7f54ec15c380 legacy=0x7f54ec06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7f54ebfff640 1 -- 172.21.15.32:0/2510913293 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec165dd0 con 0x7f54ec0cd410 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7fb04d252640 1 --2- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040056230 0x7fb040009db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb048050190 tx=0x7fb0480a6790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bb9a253c1bbaf70 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7fd53bfff640 1 -- 172.21.15.32:0/1306155549 >> v2:172.21.15.32:3300/0 conn(0x7fd53404f930 msgr2=0x7fd53404fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7fd53bfff640 1 --2- 172.21.15.32:0/1306155549 >> v2:172.21.15.32:3300/0 conn(0x7fd53404f930 0x7fd53404fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7fd53bfff640 1 -- 172.21.15.32:0/1306155549 >> v1:172.21.15.32:6789/0 conn(0x7fd534048100 legacy=0x7fd534006f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.005+0000 7fd53bfff640 1 -- 172.21.15.32:0/1306155549 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534050280 con 0x7fd534053e50 2024-02-17T00:37:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fb0477fe640 1 -- 172.21.15.32:0/3978795748 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480ab7d0 con 0x7fb040056230 2024-02-17T00:37:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f0385491640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03801614e0 0x7f0380161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fb0477fe640 1 -- 172.21.15.32:0/3978795748 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0480a9050 con 0x7fb040056230 2024-02-17T00:37:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fb0477fe640 1 -- 172.21.15.32:0/3978795748 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480abbb0 con 0x7fb040056230 2024-02-17T00:37:03.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f037ffff640 1 --2- 172.21.15.32:0/1328458339 >> v2:172.21.15.32:3300/0 conn(0x7f03800b2f30 0x7f03800d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 -- 172.21.15.32:0/2667876021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec7015c570 msgr2=0x7fec700b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 --2- 172.21.15.32:0/2667876021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec7015c570 0x7fec700b5d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec700d4940 tx=0x7fec6802be40 comp rx=0 tx=0).stop 2024-02-17T00:37:03.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 -- 172.21.15.32:0/2667876021 shutdown_connections 2024-02-17T00:37:03.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f7af6c44640 1 --2- 172.21.15.32:0/1221622649 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8007370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7af0074ab0 tx=0x7f7af00a6850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ae968ec7867e6e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 --2- 172.21.15.32:0/2667876021 >> v2:172.21.15.32:3300/0 conn(0x7fec700cdf80 0x7fec700ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 --2- 172.21.15.32:0/2667876021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec7015c570 0x7fec700b5d50 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec700d4940 tx=0x7fec6802be40 comp rx=0 tx=0).stop 2024-02-17T00:37:03.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 -- 172.21.15.32:0/2667876021 >> 172.21.15.32:0/2667876021 conn(0x7fec70072290 msgr2=0x7fec700726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd962ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd96415c380 0x7fd96406e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:56790/0 (socket says 172.21.15.32:56790) 2024-02-17T00:37:03.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd96953a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd9640cd410 0x7fd96416ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd962ffd640 1 -- 172.21.15.32:0/3485361249 learned_addr learned my addr 172.21.15.32:0/3485361249 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9641658a0 con 0x7fd9640b16e0 2024-02-17T00:37:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd964165af0 con 0x7fd96415c380 2024-02-17T00:37:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 -- 172.21.15.32:0/2667876021 shutdown_connections 2024-02-17T00:37:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd9637fe640 1 --2- 172.21.15.32:0/3485361249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd9640cd410 0x7fd96416ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96415c760 con 0x7fd9640cd410 2024-02-17T00:37:03.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7ff9cf7fe640 1 -- 172.21.15.32:0/1606153350 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc031640 con 0x7ff9c80ead00 2024-02-17T00:37:03.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f7af5441640 1 -- 172.21.15.32:0/1221622649 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b1070 con 0x7f7ae8006ee0 2024-02-17T00:37:03.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f7af5441640 1 -- 172.21.15.32:0/1221622649 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00a9070 con 0x7f7ae8006ee0 2024-02-17T00:37:03.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7fec76af4640 1 -- 172.21.15.32:0/2667876021 wait complete. 2024-02-17T00:37:03.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f7af5441640 1 -- 172.21.15.32:0/1221622649 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00ac660 con 0x7f7ae8006ee0 2024-02-17T00:37:03.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f54ebfff640 1 --2- 172.21.15.32:0/2510913293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec16ca20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009720 tx=0x7f54d402b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5635f7af8959c642 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 -- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040056230 msgr2=0x7fb040009db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 --2- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040056230 0x7fb040009db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb048050190 tx=0x7fb0480a6790 comp rx=0 tx=0).stop 2024-02-17T00:37:03.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52883145 0 0) 0x7fd964165af0 con 0x7fd96415c380 2024-02-17T00:37:03.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd950003520 con 0x7fd96415c380 2024-02-17T00:37:03.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7ff9cf7fe640 1 -- 172.21.15.32:0/1606153350 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0317a0 con 0x7ff9c80ead00 2024-02-17T00:37:03.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7ff9cf7fe640 1 -- 172.21.15.32:0/1606153350 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc031b30 con 0x7ff9c80ead00 2024-02-17T00:37:03.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd53bfff640 1 --2- 172.21.15.32:0/1306155549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd5340542e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd534052e70 tx=0x7fd52802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc60c3833823b17 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f037f7fe640 1 -- 172.21.15.32:0/1328458339 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825605835 0 0) 0x7f038015ffe0 con 0x7f038015d8a0 2024-02-17T00:37:03.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f037ffff640 1 -- 172.21.15.32:0/1328458339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03801614e0 msgr2=0x7f0380161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f037ffff640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03801614e0 0x7f0380161990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f037ffff640 1 -- 172.21.15.32:0/1328458339 >> v1:172.21.15.32:6789/0 conn(0x7f038015d8a0 legacy=0x7f03800d3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.006+0000 7f037ffff640 1 -- 172.21.15.32:0/1328458339 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038015f6b0 con 0x7f03800b2f30 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 -- 172.21.15.32:0/3978795748 shutdown_connections 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 --2- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040056230 0x7fb040009db0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 --2- 172.21.15.32:0/3978795748 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040051640 0x7fb040055cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 -- 172.21.15.32:0/3978795748 >> 172.21.15.32:0/3978795748 conn(0x7fb040056cc0 msgr2=0x7fb0400570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446942757 0 0) 0x7fd9641658a0 con 0x7fd9640b16e0 2024-02-17T00:37:03.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd964165af0 con 0x7fd9640b16e0 2024-02-17T00:37:03.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 -- 172.21.15.32:0/3978795748 shutdown_connections 2024-02-17T00:37:03.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7f0385491640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03801614e0 0x7f0380161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:03.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fb04da53640 1 -- 172.21.15.32:0/3978795748 wait complete. 2024-02-17T00:37:03.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7f54ea7fc640 1 -- 172.21.15.32:0/2510913293 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d402bea0 con 0x7f54ec0cd410 2024-02-17T00:37:03.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7f037ffff640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03800b2f30 0x7f03800d2570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f03680097a0 tx=0x7f036802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9ee8936af585db server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 -- 172.21.15.32:0/1221622649 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 msgr2=0x7f7ae8007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 --2- 172.21.15.32:0/1221622649 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8007370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7af0074ab0 tx=0x7f7af00a6850 comp rx=0 tx=0).stop 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9637fe640 1 -- 172.21.15.32:0/3485361249 >> v1:172.21.15.39:6789/0 conn(0x7fd96415c380 legacy=0x7fd96406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9637fe640 1 -- 172.21.15.32:0/3485361249 >> v1:172.21.15.32:6789/0 conn(0x7fd9640b16e0 legacy=0x7fd9640ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7fd9637fe640 1 -- 172.21.15.32:0/3485361249 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964165dd0 con 0x7fd9640cd410 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 -- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 msgr2=0x7ff9c804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c804fa90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009870 tx=0x7ff9bc02b8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7fd53b7fe640 1 -- 172.21.15.32:0/1306155549 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528030610 con 0x7fd534053e50 2024-02-17T00:37:03.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7fd53b7fe640 1 -- 172.21.15.32:0/1306155549 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528030770 con 0x7fd534053e50 2024-02-17T00:37:03.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7fd53b7fe640 1 -- 172.21.15.32:0/1306155549 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528030b00 con 0x7fd534053e50 2024-02-17T00:37:03.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.007+0000 7f54ea7fc640 1 -- 172.21.15.32:0/2510913293 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d402e050 con 0x7f54ec0cd410 2024-02-17T00:37:03.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 -- 172.21.15.32:0/1606153350 shutdown_connections 2024-02-17T00:37:03.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c8007380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/1606153350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c804fa90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 -- 172.21.15.32:0/1606153350 >> 172.21.15.32:0/1606153350 conn(0x7ff9c8009fb0 msgr2=0x7ff9c800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f54ea7fc640 1 -- 172.21.15.32:0/2510913293 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d402bea0 con 0x7f54ec0cd410 2024-02-17T00:37:03.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 -- 172.21.15.32:0/1606153350 shutdown_connections 2024-02-17T00:37:03.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f037f7fe640 1 -- 172.21.15.32:0/1328458339 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680316f0 con 0x7f03800b2f30 2024-02-17T00:37:03.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f037f7fe640 1 -- 172.21.15.32:0/1328458339 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368031850 con 0x7f03800b2f30 2024-02-17T00:37:03.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f037f7fe640 1 -- 172.21.15.32:0/1328458339 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368031be0 con 0x7f03800b2f30 2024-02-17T00:37:03.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7fec76af4640 1 Processor -- start 2024-02-17T00:37:03.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7ff9d58c3640 1 -- 172.21.15.32:0/1606153350 wait complete. 2024-02-17T00:37:03.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f54f1f93640 1 -- 172.21.15.32:0/2510913293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 msgr2=0x7f54ec16ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f54f1f93640 1 --2- 172.21.15.32:0/2510913293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec16ca20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009720 tx=0x7f54d402b620 comp rx=0 tx=0).stop 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7fec76af4640 1 -- start start 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 -- 172.21.15.32:0/1221622649 shutdown_connections 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 --2- 172.21.15.32:0/1221622649 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8007370 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 --2- 172.21.15.32:0/1221622649 >> v2:172.21.15.39:3300/0 conn(0x7f7ae80eacf0 0x7f7ae804fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 -- 172.21.15.32:0/1221622649 >> 172.21.15.32:0/1221622649 conn(0x7f7ae8009fa0 msgr2=0x7f7ae800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f54f1f93640 1 -- 172.21.15.32:0/2510913293 shutdown_connections 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f54f1f93640 1 --2- 172.21.15.32:0/2510913293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec16ca20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f54f1f93640 1 -- 172.21.15.32:0/2510913293 >> 172.21.15.32:0/2510913293 conn(0x7f54ec071150 msgr2=0x7f54ec071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.008+0000 7f7af86a7640 1 -- 172.21.15.32:0/1221622649 shutdown_connections 2024-02-17T00:37:03.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7f7af86a7640 1 -- 172.21.15.32:0/1221622649 wait complete. 2024-02-17T00:37:03.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fb04da53640 1 Processor -- start 2024-02-17T00:37:03.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd9637fe640 1 --2- 172.21.15.32:0/3485361249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd9640cd410 0x7fd96416ca20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009dc0 tx=0x7fd95c02bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76ce37c1de5f55d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 msgr2=0x7fd5340542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 --2- 172.21.15.32:0/1306155549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd5340542e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd534052e70 tx=0x7fd52802b960 comp rx=0 tx=0).stop 2024-02-17T00:37:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 shutdown_connections 2024-02-17T00:37:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 --2- 172.21.15.32:0/1306155549 >> v2:172.21.15.32:3300/0 conn(0x7fd53404f930 0x7fd53404fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 --2- 172.21.15.32:0/1306155549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd5340542e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 >> 172.21.15.32:0/1306155549 conn(0x7fd534009fe0 msgr2=0x7fd53400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7f54f1f93640 1 -- 172.21.15.32:0/2510913293 shutdown_connections 2024-02-17T00:37:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 shutdown_connections 2024-02-17T00:37:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954001670 con 0x7fd9640cd410 2024-02-17T00:37:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c02c750 con 0x7fd9640cd410 2024-02-17T00:37:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd9627fc640 1 -- 172.21.15.32:0/3485361249 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02cae0 con 0x7fd9640cd410 2024-02-17T00:37:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03800b2f30 msgr2=0x7f03800d2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7f0385c92640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03800b2f30 0x7f03800d2570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f03680097a0 tx=0x7f036802b790 comp rx=0 tx=0).stop 2024-02-17T00:37:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7fd542e9d640 1 -- 172.21.15.32:0/1306155549 wait complete. 2024-02-17T00:37:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 shutdown_connections 2024-02-17T00:37:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f0385c92640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03800b2f30 0x7f03800d2570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.009+0000 7f54f1f93640 1 -- 172.21.15.32:0/2510913293 wait complete. 2024-02-17T00:37:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f0385c92640 1 --2- 172.21.15.32:0/1328458339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03801614e0 0x7f0380161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 >> 172.21.15.32:0/1328458339 conn(0x7f038008af80 msgr2=0x7f03800d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd9640cd410 msgr2=0x7fd96416ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 --2- 172.21.15.32:0/3485361249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd9640cd410 0x7fd96416ca20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009dc0 tx=0x7fd95c02bc20 comp rx=0 tx=0).stop 2024-02-17T00:37:03.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 shutdown_connections 2024-02-17T00:37:03.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fec76af4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec700cdf80 0x7fec70150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 --2- 172.21.15.32:0/3485361249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd9640cd410 0x7fd96416ca20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fb04da53640 1 -- start start 2024-02-17T00:37:03.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 >> 172.21.15.32:0/3485361249 conn(0x7fd964071150 msgr2=0x7fd964071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f7af86a7640 1 Processor -- start 2024-02-17T00:37:03.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 shutdown_connections 2024-02-17T00:37:03.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f7af86a7640 1 -- start start 2024-02-17T00:37:03.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7ff9d58c3640 1 Processor -- start 2024-02-17T00:37:03.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f0385c92640 1 -- 172.21.15.32:0/1328458339 wait complete. 2024-02-17T00:37:03.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7ff9d58c3640 1 -- start start 2024-02-17T00:37:03.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 shutdown_connections 2024-02-17T00:37:03.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7f54f1f93640 1 Processor -- start 2024-02-17T00:37:03.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7f54f1f93640 1 -- start start 2024-02-17T00:37:03.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fd542e9d640 1 Processor -- start 2024-02-17T00:37:03.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.010+0000 7fd96953a640 1 -- 172.21.15.32:0/3485361249 wait complete. 2024-02-17T00:37:03.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fec76af4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec700d0020 0x7fec700b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fec76af4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fec700b7d50 0x7fec7006fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fec76af4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700b73f0 con 0x7fec700cdf80 2024-02-17T00:37:03.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fb04da53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040051640 0x7fb040037fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af86a7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8049a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af86a7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae804ffc0 0x7f7ae80447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fb04da53640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040056230 0x7fb0400d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af86a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 0x7f7ae80dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fb04da53640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0400e1290 0x7fb0400d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af86a7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8044ce0 con 0x7f7ae804ffc0 2024-02-17T00:37:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af86a7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8049590 con 0x7f7ae80eacf0 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af86a7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8048980 con 0x7f7ae8006ee0 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fb04da53640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040037bb0 con 0x7fb0400e1290 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54f1f93640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54ec0b16e0 0x7f54ec0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54f1f93640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54f1f93640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f54ec15c380 0x7f54ec155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54f1f93640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec151d10 con 0x7f54ec0cd410 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54f1f93640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec153010 con 0x7f54ec0b16e0 2024-02-17T00:37:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54f1f93640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec1f74c0 con 0x7f54ec15c380 2024-02-17T00:37:03.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb04da53640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040036ee0 con 0x7fb040051640 2024-02-17T00:37:03.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 0x7f7ae80dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af5c42640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae804ffc0 0x7f7ae80447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 0x7f7ae80dbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57752/0 (socket says 172.21.15.32:57752) 2024-02-17T00:37:03.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 -- 172.21.15.32:0/3693501105 learned_addr learned my addr 172.21.15.32:0/3693501105 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb04da53640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400e1780 con 0x7fb040056230 2024-02-17T00:37:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb04d252640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0400e1290 0x7fb0400d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb04d252640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0400e1290 0x7fb0400d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58710/0 (socket says 172.21.15.32:58710) 2024-02-17T00:37:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb04d252640 1 -- 172.21.15.32:0/3874296062 learned_addr learned my addr 172.21.15.32:0/3874296062 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb04ca51640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040051640 0x7fb040037fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fb047fff640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040056230 0x7fb0400d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6443640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8049a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54ec0b16e0 0x7f54ec0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54eaffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54eaffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58724/0 (socket says 172.21.15.32:58724) 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54ebfff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f54ec15c380 0x7f54ec155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f54eaffd640 1 -- 172.21.15.32:0/1921570311 learned_addr learned my addr 172.21.15.32:0/1921570311 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fd96953a640 1 Processor -- start 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.011+0000 7fd542e9d640 1 -- start start 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fd542e9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 0x7fd5340e55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fd542e9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd53404f930 0x7fd534171010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fd542e9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd53404a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 -- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 msgr2=0x7f7ae8049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8049a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 -- 172.21.15.32:0/3693501105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae804ffc0 msgr2=0x7f7ae80447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae804ffc0 0x7f7ae80447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7f7af6c44640 1 -- 172.21.15.32:0/3693501105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae8048c60 con 0x7f7ae80eacf0 2024-02-17T00:37:03.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54ebfff640 1 -- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54ec0b16e0 msgr2=0x7f54ec0b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54ebfff640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54ec0b16e0 0x7f54ec0b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54ebfff640 1 -- 172.21.15.32:0/1921570311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 msgr2=0x7f54ec154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54ebfff640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54ebfff640 1 -- 172.21.15.32:0/1921570311 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d4009400 con 0x7f54ec15c380 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb047fff640 1 -- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040051640 msgr2=0x7fb040037fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb047fff640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040051640 0x7fb040037fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb047fff640 1 -- 172.21.15.32:0/3874296062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0400e1290 msgr2=0x7fb0400d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb047fff640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0400e1290 0x7fb0400d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb047fff640 1 -- 172.21.15.32:0/3874296062 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480746d0 con 0x7fb040056230 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb04ca51640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040051640 0x7fb040037fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f7af6c44640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 0x7f7ae80dbf50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7af00692b0 tx=0x7f7af006aa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb047fff640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040056230 0x7fb0400d08e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb03400d5f0 tx=0x7fb03400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fec6ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec700d0020 0x7fec700b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.012+0000 7fd96953a640 1 -- start start 2024-02-17T00:37:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fec6ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec700d0020 0x7fec700b7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57772/0 (socket says 172.21.15.32:57772) 2024-02-17T00:37:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fec6ffff640 1 -- 172.21.15.32:0/1864098801 learned_addr learned my addr 172.21.15.32:0/1864098801 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd540c39640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 0x7fd5340e55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54ebfff640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f54ec15c380 0x7f54ec155400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54ec06f2e0 tx=0x7f54d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd540c39640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 0x7fd5340e55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58726/0 (socket says 172.21.15.32:58726) 2024-02-17T00:37:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00bd070 con 0x7f7ae80eacf0 2024-02-17T00:37:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00b7700 con 0x7f7ae80eacf0 2024-02-17T00:37:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fec74890640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec700cdf80 0x7fec70150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fec76af4640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700b6520 con 0x7fec700d0020 2024-02-17T00:37:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fec76af4640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec700b6770 con 0x7fec700b7d50 2024-02-17T00:37:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd542e9d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53404ada0 con 0x7fd534048100 2024-02-17T00:37:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7ff9d58c3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c80d9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd542e9d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534049160 con 0x7fd534053e50 2024-02-17T00:37:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd542e9d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340e5b20 con 0x7fd53404f930 2024-02-17T00:37:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b1040 con 0x7f7ae80eacf0 2024-02-17T00:37:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae8048f40 con 0x7f7ae80eacf0 2024-02-17T00:37:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae8047510 con 0x7f7ae80eacf0 2024-02-17T00:37:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd54143a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd53404a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd54143a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd53404a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57776/0 (socket says 172.21.15.32:57776) 2024-02-17T00:37:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd54143a640 1 -- 172.21.15.32:0/2469044107 learned_addr learned my addr 172.21.15.32:0/2469044107 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4030710 con 0x7f54ec15c380 2024-02-17T00:37:03.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4030870 con 0x7f54ec15c380 2024-02-17T00:37:03.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4030c00 con 0x7f54ec15c380 2024-02-17T00:37:03.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7f54f1f93640 1 -- 172.21.15.32:0/1921570311 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec151470 con 0x7f54ec15c380 2024-02-17T00:37:03.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fd96953a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9640b16e0 0x7fd96415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7f54f1f93640 1 -- 172.21.15.32:0/1921570311 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec151a30 con 0x7f54ec15c380 2024-02-17T00:37:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd96953a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9640cd410 0x7fd96414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd96953a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 0x7fd964152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd96953a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641f7ca0 con 0x7fd9640b16e0 2024-02-17T00:37:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7f0385c92640 1 Processor -- start 2024-02-17T00:37:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7ff9d58c3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9c804ffd0 0x7ff9c80466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7ff9d58c3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c8046c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7f0385c92640 1 -- start start 2024-02-17T00:37:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7ff9d58c3640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8047310 con 0x7ff9c804ffd0 2024-02-17T00:37:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7ff9d58c3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8043cc0 con 0x7ff9c80ead00 2024-02-17T00:37:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7ff9d58c3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80daf00 con 0x7ff9c8006ef0 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd96953a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96414cb80 con 0x7fd9640cd410 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd96953a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641533b0 con 0x7fd96415c380 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd95bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9640cd410 0x7fd96414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd9637fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 0x7fd964152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd9637fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 0x7fd964152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50466/0 (socket says 172.21.15.32:50466) 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd9637fe640 1 -- 172.21.15.32:0/2636017236 learned_addr learned my addr 172.21.15.32:0/2636017236 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd95bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9640cd410 0x7fd96414c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:57778/0 (socket says 172.21.15.32:57778) 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7ff9d48c1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c80d9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c80d9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50462/0 (socket says 172.21.15.32:50462) 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 -- 172.21.15.32:0/3028875938 learned_addr learned my addr 172.21.15.32:0/3028875938 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d50c2640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c8046c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd9637fe640 1 -- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9640cd410 msgr2=0x7fd96414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd9637fe640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9640cd410 0x7fd96414c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd9637fe640 1 -- 172.21.15.32:0/2636017236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9640b16e0 msgr2=0x7fd96415b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd9637fe640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9640b16e0 0x7fd96415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd9637fe640 1 -- 172.21.15.32:0/2636017236 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c009a70 con 0x7fd96415c380 2024-02-17T00:37:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7f54f1f93640 1 -- 172.21.15.32:0/1921570311 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec152e50 con 0x7f54ec15c380 2024-02-17T00:37:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fec74890640 1 -- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fec700b7d50 msgr2=0x7fec7006fa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-17T00:37:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fec74890640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fec700b7d50 0x7fec7006fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fec74890640 1 -- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec700d0020 msgr2=0x7fec700b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fec74890640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec700d0020 0x7fec700b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fec74890640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009a70 con 0x7fec700cdf80 2024-02-17T00:37:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd53bfff640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd53404f930 0x7fd534171010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd540c39640 1 -- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd53404f930 msgr2=0x7fd534171010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd540c39640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd53404f930 0x7fd534171010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd540c39640 1 -- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 msgr2=0x7fd53404a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae8049720 con 0x7f7ae80eacf0 2024-02-17T00:37:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd540c39640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd53404a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.014+0000 7fd540c39640 1 -- 172.21.15.32:0/2469044107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009400 con 0x7fd534048100 2024-02-17T00:37:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd540c39640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 0x7fd5340e55e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd530000f60 tx=0x7fd53000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300058b0 con 0x7fd534048100 2024-02-17T00:37:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0385c92640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 0x7f03801545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340487c0 con 0x7fd534048100 2024-02-17T00:37:03.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fec74890640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec700cdf80 0x7fec70150d30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec68033000 tx=0x7fec68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd534048d80 con 0x7fd534048100 2024-02-17T00:37:03.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0385c92640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f038015d8a0 0x7f03800b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0384c90640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 0x7f03801545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0384c90640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 0x7f03801545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:50468/0 (socket says 172.21.15.32:50468) 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6803e610 con 0x7fec700cdf80 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0340125f0 con 0x7fb040056230 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb040037210 con 0x7fb040056230 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0400377d0 con 0x7fb040056230 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034012750 con 0x7fb040056230 2024-02-17T00:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.013+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034012b00 con 0x7fb040056230 2024-02-17T00:37:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0384c90640 1 -- 172.21.15.32:0/3665154266 learned_addr learned my addr 172.21.15.32:0/3665154266 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb034012c60 con 0x7fb040056230 2024-02-17T00:37:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6803e790 con 0x7fec700cdf80 2024-02-17T00:37:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f037ffff640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f038015d8a0 0x7f03800b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fec76af4640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec700b6a50 con 0x7fec700cdf80 2024-02-17T00:37:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03801614e0 0x7f0380154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0380154af0 con 0x7f03801614e0 2024-02-17T00:37:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800b01d0 con 0x7f038015d8a0 2024-02-17T00:37:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800b04b0 con 0x7f03800b2f30 2024-02-17T00:37:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9cffff640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9c804ffd0 0x7ff9c80466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 -- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 msgr2=0x7ff9c8046c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c8046c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 -- 172.21.15.32:0/3028875938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9c804ffd0 msgr2=0x7ff9c80466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9c804ffd0 0x7ff9c80466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.015+0000 7ff9d48c1640 1 -- 172.21.15.32:0/3028875938 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0094d0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7ff9d48c1640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c80d9e80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0090b0 tx=0x7ff9bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc03ac60 con 0x7ff9c8006ef0 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc03adc0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc044630 con 0x7ff9c8006ef0 2024-02-17T00:37:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fd9637fe640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 0x7fd964152e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009ee0 tx=0x7fd95c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.016+0000 7fec76af4640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec700b7010 con 0x7fec700cdf80 2024-02-17T00:37:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f54d4030d60 con 0x7f54ec15c380 2024-02-17T00:37:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c80da3c0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c80da8b0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f0384c90640 1 -- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f038015d8a0 msgr2=0x7f03800b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f0384c90640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f038015d8a0 0x7f03800b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f0384c90640 1 -- 172.21.15.32:0/3665154266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03801614e0 msgr2=0x7f0380154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7af00b7ab0 con 0x7f7ae80eacf0 2024-02-17T00:37:03.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f54e3fff640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f54cc06b8e0 0x7f54cc06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f54d40ac2a0 con 0x7f54ec15c380 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f7ae6ffd640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ad406b910 0x7f7ad406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7af0126b00 con 0x7f7ae80eacf0 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53400ad00 con 0x7fd534048100 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530005a10 con 0x7fd534048100 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300058b0 con 0x7fd534048100 2024-02-17T00:37:03.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7fb0457fa640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb02c06b810 0x7fb02c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6803eb40 con 0x7fec700cdf80 2024-02-17T00:37:03.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f0384c90640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03801614e0 0x7f0380154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.017+0000 7f0384c90640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368009400 con 0x7f03800b2f30 2024-02-17T00:37:03.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec700b7530 con 0x7fec700cdf80 2024-02-17T00:37:03.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7f54eb7fe640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f54cc06b8e0 0x7f54cc06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb03408a980 con 0x7fb040056230 2024-02-17T00:37:03.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7fb04ca51640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb02c06b810 0x7fb02c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7f0384c90640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 0x7f03801545b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f037000c3e0 tx=0x7f0370001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.018+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb028005290 con 0x7fb040056230 2024-02-17T00:37:03.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7f54eb7fe640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f54cc06b8e0 0x7f54cc06dda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0012e0 tx=0x7f54dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7f7af6443640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ad406b910 0x7f7ad406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7fb04ca51640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb02c06b810 0x7fb02c06dcd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb03c006d50 tx=0x7fb03c006ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c80da6f0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd530005bc0 con 0x7fd534048100 2024-02-17T00:37:03.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fec6803b050 con 0x7fec700cdf80 2024-02-17T00:37:03.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.019+0000 7f7af6443640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ad406b910 0x7f7ad406ddd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006fd0 tx=0x7f7aec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fd5397fa640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd52006b870 0x7fd52006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fec6d7fa640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fec5c06b860 0x7fec5c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd530089cc0 con 0x7fd534048100 2024-02-17T00:37:03.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fec680acdd0 con 0x7fec700cdf80 2024-02-17T00:37:03.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fec6ffff640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fec5c06b860 0x7fec5c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fd53bfff640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd52006b870 0x7fd52006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fec6ffff640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fec5c06b860 0x7fec5c06dd20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec701fafe0 tx=0x7fec64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.020+0000 7fd53bfff640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd52006b870 0x7fd52006dd30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd528036000 tx=0x7fd52803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700074e0 con 0x7f03800b2f30 2024-02-17T00:37:03.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.021+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c034c00 con 0x7fd96415c380 2024-02-17T00:37:03.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd964153650 con 0x7fd96415c380 2024-02-17T00:37:03.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03800b0790 con 0x7f03800b2f30 2024-02-17T00:37:03.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964153c10 con 0x7fd96415c380 2024-02-17T00:37:03.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03800b0d50 con 0x7f03800b2f30 2024-02-17T00:37:03.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54d4076960 con 0x7f54ec15c380 2024-02-17T00:37:03.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.022+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7af00f1130 con 0x7f7ae80eacf0 2024-02-17T00:37:03.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.023+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964068fd0 con 0x7fd96415c380 2024-02-17T00:37:03.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.023+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03800b0f90 con 0x7f03800b2f30 2024-02-17T00:37:03.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.023+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd5300545c0 con 0x7fd534048100 2024-02-17T00:37:03.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.026+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370007640 con 0x7f03800b2f30 2024-02-17T00:37:03.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.026+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370004a00 con 0x7f03800b2f30 2024-02-17T00:37:03.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.027+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb034054fe0 con 0x7fb040056230 2024-02-17T00:37:03.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.027+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c009450 con 0x7fd96415c380 2024-02-17T00:37:03.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.028+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c040450 con 0x7fd96415c380 2024-02-17T00:37:03.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.028+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff9bc02f050 con 0x7ff9c8006ef0 2024-02-17T00:37:03.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.028+0000 7ff9cd7fa640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff9b406b8e0 0x7ff9b406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.028+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff9bc0ac6d0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.028+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd95c040670 con 0x7fd96415c380 2024-02-17T00:37:03.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.029+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec68077640 con 0x7fec700cdf80 2024-02-17T00:37:03.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.029+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f03700133c0 con 0x7f03800b2f30 2024-02-17T00:37:03.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.029+0000 7ff9cffff640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff9b406b8e0 0x7ff9b406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.029+0000 7fd95b7fe640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd94406b810 0x7fd94406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.029+0000 7ff9cffff640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff9b406b8e0 0x7ff9b406dda0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4007fd0 tx=0x7ff9c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.029+0000 7f037d7fa640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f036006b810 0x7f036006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:03.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.030+0000 7fd962ffd640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd94406b810 0x7fd94406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.030+0000 7f037ffff640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f036006b810 0x7f036006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:03.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.030+0000 7f037ffff640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f036006b810 0x7f036006dcd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0368036000 tx=0x7f0368008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.030+0000 7fd962ffd640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd94406b810 0x7fd94406dcd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd954001eb0 tx=0x7fd954001580 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:03.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.031+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd95c07bea0 con 0x7fd96415c380 2024-02-17T00:37:03.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.031+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0370059400 con 0x7f03800b2f30 2024-02-17T00:37:03.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.032+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9bc076e20 con 0x7ff9c8006ef0 2024-02-17T00:37:03.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.036+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd95c077a40 con 0x7fd96415c380 2024-02-17T00:37:03.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.040+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0370054fa0 con 0x7f03800b2f30 2024-02-17T00:37:03.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.424+0000 7f54f1f93640 1 -- 172.21.15.32:0/1921570311 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54ec1531d0 con 0x7f54ec15c380 2024-02-17T00:37:03.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.425+0000 7f54e3fff640 1 -- 172.21.15.32:0/1921570311 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54d407a020 con 0x7f54ec15c380 2024-02-17T00:37:03.428 INFO:teuthology.orchestra.run.smithi032.stdout:64424509449 2024-02-17T00:37:03.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.428+0000 7f54e1ffb640 1 -- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f54cc06b8e0 msgr2=0x7f54cc06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.428+0000 7f54e1ffb640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f54cc06b8e0 0x7f54cc06dda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0012e0 tx=0x7f54dc009040 comp rx=0 tx=0).stop 2024-02-17T00:37:03.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.428+0000 7f54e1ffb640 1 -- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f54ec15c380 msgr2=0x7f54ec155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.428+0000 7f54e1ffb640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f54ec15c380 0x7f54ec155400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54ec06f2e0 tx=0x7f54d40046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 -- 172.21.15.32:0/1921570311 shutdown_connections 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f54cc06b8e0 0x7f54cc06dda0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f54ec15c380 0x7f54ec155400 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54ec0cd410 0x7f54ec154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 --2- 172.21.15.32:0/1921570311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54ec0b16e0 0x7f54ec0b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 -- 172.21.15.32:0/1921570311 >> 172.21.15.32:0/1921570311 conn(0x7f54ec071150 msgr2=0x7f54ec164020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 -- 172.21.15.32:0/1921570311 shutdown_connections 2024-02-17T00:37:03.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.429+0000 7f54e1ffb640 1 -- 172.21.15.32:0/1921570311 wait complete. 2024-02-17T00:37:03.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.443+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9c80052c0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.444+0000 7ff9cd7fa640 1 -- 172.21.15.32:0/3028875938 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9bc07a4e0 con 0x7ff9c8006ef0 2024-02-17T00:37:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.444+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ae80052b0 con 0x7f7ae80eacf0 2024-02-17T00:37:03.449 INFO:teuthology.orchestra.run.smithi032.stdout:64424509449 2024-02-17T00:37:03.449 INFO:teuthology.orchestra.run.smithi032.stdout:64424509449 2024-02-17T00:37:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.444+0000 7f7ae6ffd640 1 -- 172.21.15.32:0/3693501105 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7af00f47f0 con 0x7f7ae80eacf0 2024-02-17T00:37:03.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-02-17T00:37:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.446+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5340052f0 con 0x7fd534048100 2024-02-17T00:37:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.446+0000 7fd5397fa640 1 -- 172.21.15.32:0/2469044107 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd530021020 con 0x7fd534048100 2024-02-17T00:37:03.451 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff9b406b8e0 msgr2=0x7ff9b406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff9b406b8e0 0x7ff9b406dda0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4007fd0 tx=0x7ff9c4009040 comp rx=0 tx=0).stop 2024-02-17T00:37:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 msgr2=0x7ff9c80d9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c80d9e80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0090b0 tx=0x7ff9bc0046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 shutdown_connections 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9c80ead00 0x7ff9c8046c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9c804ffd0 0x7ff9c80466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff9b406b8e0 0x7ff9b406dda0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 --2- 172.21.15.32:0/3028875938 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff9c8006ef0 0x7ff9c80d9e80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 >> 172.21.15.32:0/3028875938 conn(0x7ff9c8009fb0 msgr2=0x7ff9c8038100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ad406b910 msgr2=0x7f7ad406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7f7af86a7640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ad406b910 0x7f7ad406ddd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006fd0 tx=0x7f7aec008040 comp rx=0 tx=0).stop 2024-02-17T00:37:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 msgr2=0x7f7ae80dbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7f7af86a7640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 0x7f7ae80dbf50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7af00692b0 tx=0x7f7af006aa10 comp rx=0 tx=0).stop 2024-02-17T00:37:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 shutdown_connections 2024-02-17T00:37:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7ff9d58c3640 1 -- 172.21.15.32:0/3028875938 wait complete. 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 shutdown_connections 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.447+0000 7f7af86a7640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ae80eacf0 0x7f7ae80dbf50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.448+0000 7f7af86a7640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae804ffc0 0x7f7ae80447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.448+0000 7f7af86a7640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7ad406b910 0x7f7ad406ddd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.448+0000 7f7af86a7640 1 --2- 172.21.15.32:0/3693501105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ae8006ee0 0x7f7ae8049a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.448+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 >> 172.21.15.32:0/3693501105 conn(0x7f7ae8009fa0 msgr2=0x7f7ae80372e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.448+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 shutdown_connections 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.448+0000 7f7af86a7640 1 -- 172.21.15.32:0/3693501105 wait complete. 2024-02-17T00:37:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd964163ac0 con 0x7fd96415c380 2024-02-17T00:37:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd52006b870 msgr2=0x7fd52006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd52006b870 0x7fd52006dd30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd528036000 tx=0x7fd52803b040 comp rx=0 tx=0).stop 2024-02-17T00:37:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 msgr2=0x7fd5340e55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 0x7fd5340e55e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd530000f60 tx=0x7fd53000cbe0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 shutdown_connections 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd534053e50 0x7fd53404a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd52006b870 0x7fd52006dd30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd53404f930 0x7fd534171010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 --2- 172.21.15.32:0/2469044107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd534048100 0x7fd5340e55e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 >> 172.21.15.32:0/2469044107 conn(0x7fd534009fe0 msgr2=0x7fd5340e9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 shutdown_connections 2024-02-17T00:37:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.449+0000 7fd95b7fe640 1 -- 172.21.15.32:0/2636017236 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd95c039020 con 0x7fd96415c380 2024-02-17T00:37:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.450+0000 7fd542e9d640 1 -- 172.21.15.32:0/2469044107 wait complete. 2024-02-17T00:37:03.457 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd94406b810 msgr2=0x7fd94406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd94406b810 0x7fd94406dcd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd954001eb0 tx=0x7fd954001580 comp rx=0 tx=0).stop 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 msgr2=0x7fd964152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 0x7fd964152e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009ee0 tx=0x7fd95c004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 shutdown_connections 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd94406b810 0x7fd94406dcd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd96415c380 0x7fd964152e70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9640cd410 0x7fd96414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 --2- 172.21.15.32:0/2636017236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9640b16e0 0x7fd96415b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.453+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 >> 172.21.15.32:0/2636017236 conn(0x7fd964071150 msgr2=0x7fd96414ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.454+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 shutdown_connections 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.454+0000 7fd96953a640 1 -- 172.21.15.32:0/2636017236 wait complete. 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.454+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fec700b7530 con 0x7fec700cdf80 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.455+0000 7fec6d7fa640 1 -- 172.21.15.32:0/1864098801 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec6804e020 con 0x7fec700cdf80 2024-02-17T00:37:03.459 INFO:teuthology.orchestra.run.smithi032.stdout:55834574857 2024-02-17T00:37:03.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.458+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fec5c06b860 msgr2=0x7fec5c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.458+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb028005540 con 0x7fb040056230 2024-02-17T00:37:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.458+0000 7fec56ffd640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fec5c06b860 0x7fec5c06dd20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec701fafe0 tx=0x7fec64009040 comp rx=0 tx=0).stop 2024-02-17T00:37:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.458+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec700cdf80 msgr2=0x7fec70150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.458+0000 7fec56ffd640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec700cdf80 0x7fec70150d30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec68033000 tx=0x7fec68004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 shutdown_connections 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fec5c06b860 0x7fec5c06dd20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fec700b7d50 0x7fec7006fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec700d0020 0x7fec700b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 --2- 172.21.15.32:0/1864098801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec700cdf80 0x7fec70150d30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 >> 172.21.15.32:0/1864098801 conn(0x7fec70072290 msgr2=0x7fec700cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fb0457fa640 1 -- 172.21.15.32:0/3874296062 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0340586a0 con 0x7fb040056230 2024-02-17T00:37:03.464 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:03.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 shutdown_connections 2024-02-17T00:37:03.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.459+0000 7fec56ffd640 1 -- 172.21.15.32:0/1864098801 wait complete. 2024-02-17T00:37:03.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.460+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f03800b05f0 con 0x7f03800b2f30 2024-02-17T00:37:03.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.461+0000 7f037d7fa640 1 -- 172.21.15.32:0/3665154266 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03800b05f0 con 0x7f03800b2f30 2024-02-17T00:37:03.465 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb02c06b810 msgr2=0x7fb02c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb02c06b810 0x7fb02c06dcd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb03c006d50 tx=0x7fb03c006ca0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040056230 msgr2=0x7fb0400d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040056230 0x7fb0400d08e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb03400d5f0 tx=0x7fb03400dab0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 shutdown_connections 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0400e1290 0x7fb0400d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb02c06b810 0x7fb02c06dcd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb040056230 0x7fb0400d08e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 --2- 172.21.15.32:0/3874296062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb040051640 0x7fb040037fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 >> 172.21.15.32:0/3874296062 conn(0x7fb040056cc0 msgr2=0x7fb040008e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 shutdown_connections 2024-02-17T00:37:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.462+0000 7fb04da53640 1 -- 172.21.15.32:0/3874296062 wait complete. 2024-02-17T00:37:03.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.464+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f036006b810 msgr2=0x7f036006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.464+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f036006b810 0x7f036006dcd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0368036000 tx=0x7f0368008030 comp rx=0 tx=0).stop 2024-02-17T00:37:03.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.464+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 msgr2=0x7f03801545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.464+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 0x7f03801545b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f037000c3e0 tx=0x7f0370001e70 comp rx=0 tx=0).stop 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 shutdown_connections 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03801614e0 0x7f0380154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f038015d8a0 0x7f03800b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f036006b810 0x7f036006dcd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 --2- 172.21.15.32:0/3665154266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03800b2f30 0x7f03801545b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 >> 172.21.15.32:0/3665154266 conn(0x7f038008af80 msgr2=0x7f03800b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 shutdown_connections 2024-02-17T00:37:03.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:03.465+0000 7f0385c92640 1 -- 172.21.15.32:0/3665154266 wait complete. 2024-02-17T00:37:03.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-02-17T00:37:03.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-02-17T00:37:03.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-02-17T00:37:03.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.4 2024-02-17T00:37:03.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2024-02-17T00:37:03.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-02-17T00:37:03.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-02-17T00:37:04.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T00:37:04.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T00:37:04.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-17T00:37:04.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T00:37:04.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T00:37:04.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-17T00:37:04.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T00:37:04.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T00:37:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.617+0000 7f9eeab4a640 1 Processor -- start 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.617+0000 7f9eeab4a640 1 -- start start 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.619+0000 7f9eeab4a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9ee416a460 0x7f9ee40b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.619+0000 7f9eeab4a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ee4071710 0x7f9ee406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.619+0000 7f9eeab4a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40b3740 con 0x7f9ee40b46d0 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.619+0000 7f9eeab4a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee406dd20 con 0x7f9ee416a460 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.619+0000 7f9eeab4a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee406e000 con 0x7f9ee4071710 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.620+0000 7f9eea349640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ee4071710 0x7f9ee406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.620+0000 7f9eea349640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ee4071710 0x7f9ee406d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45146/0 (socket says 172.21.15.32:45146) 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.620+0000 7f9eea349640 1 -- 172.21.15.32:0/454902580 learned_addr learned my addr 172.21.15.32:0/454902580 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.620+0000 7f9ee9b48640 1 --2- 172.21.15.32:0/454902580 >> v2:172.21.15.32:3300/0 conn(0x7f9ee416a460 0x7f9ee40b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.620+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923333256 0 0) 0x7f9ee40b3740 con 0x7f9ee40b46d0 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed0003420 con 0x7f9ee40b46d0 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20395085 0 0) 0x7f9ed0003420 con 0x7f9ee40b46d0 2024-02-17T00:37:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 >> v2:172.21.15.39:3300/0 conn(0x7f9ee4071710 msgr2=0x7f9ee406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 --2- 172.21.15.32:0/454902580 >> v2:172.21.15.39:3300/0 conn(0x7f9ee4071710 0x7f9ee406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 >> v2:172.21.15.32:3300/0 conn(0x7f9ee416a460 msgr2=0x7f9ee40b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 --2- 172.21.15.32:0/454902580 >> v2:172.21.15.32:3300/0 conn(0x7f9ee416a460 0x7f9ee40b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40b3990 con 0x7f9ee40b46d0 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f9ed4001670 con 0x7f9ee40b46d0 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 >> v1:172.21.15.32:6789/0 conn(0x7f9ee40b46d0 legacy=0x7f9ee4071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0004a50 0x7f9ed0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ed0003660 0x7f9ed0003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ed0004140 0x7f9ed001c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee406dd20 con 0x7f9ed0003660 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.621+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee406e000 con 0x7f9ed0004140 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.622+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed001cfe0 con 0x7f9ed0004a50 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.622+0000 7f9ee9b48640 1 --2- 172.21.15.32:0/454902580 >> v2:172.21.15.32:3300/0 conn(0x7f9ee416a460 0x7f9ee40b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.622+0000 7f9ee9347640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ed0003660 0x7f9ed0003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.623+0000 7f9ee9347640 1 -- 172.21.15.32:0/454902580 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0004a50 msgr2=0x7f9ed0004e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.623+0000 7f9ee9347640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0004a50 0x7f9ed0004e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.623+0000 7f9ee9347640 1 -- 172.21.15.32:0/454902580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ed0004140 msgr2=0x7f9ed001c770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.623+0000 7f9ee9347640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ed0004140 0x7f9ed001c770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.623+0000 7f9ee9347640 1 -- 172.21.15.32:0/454902580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40b3990 con 0x7f9ed0003660 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.624+0000 7f9ee9347640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ed0003660 0x7f9ed0003ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4007c00 tx=0x7f9ed00046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37530af3fc9cc294 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.625+0000 7f9eea349640 1 -- 172.21.15.32:0/454902580 reap_dead start 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.625+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed404ecc0 con 0x7f9ed0003660 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.625+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed404ee20 con 0x7f9ed0003660 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.625+0000 7f9ee8b46640 1 -- 172.21.15.32:0/454902580 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4056680 con 0x7f9ed0003660 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.626+0000 7f9eeab4a640 1 -- 172.21.15.32:0/454902580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ed0003660 msgr2=0x7f9ed0003ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.626+0000 7f9eeab4a640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ed0003660 0x7f9ed0003ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4007c00 tx=0x7f9ed00046e0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.628+0000 7f9eeab4a640 1 -- 172.21.15.32:0/454902580 shutdown_connections 2024-02-17T00:37:04.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.628+0000 7f9eeab4a640 1 --2- 172.21.15.32:0/454902580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ed0003660 0x7f9ed0003ae0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.628+0000 7f9eeab4a640 1 -- 172.21.15.32:0/454902580 >> 172.21.15.32:0/454902580 conn(0x7f9ee4066b00 msgr2=0x7f9ee406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.629+0000 7f9eeab4a640 1 -- 172.21.15.32:0/454902580 shutdown_connections 2024-02-17T00:37:04.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.629+0000 7f9eeab4a640 1 -- 172.21.15.32:0/454902580 wait complete. 2024-02-17T00:37:04.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.631+0000 7f9eeab4a640 1 Processor -- start 2024-02-17T00:37:04.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.631+0000 7f9eeab4a640 1 -- start start 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eeab4a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0003660 0x7f9ee415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eeab4a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee42006c0 0x7f9ee40cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eeab4a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 0x7f9ee40cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eeab4a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee414f9c0 con 0x7f9ee4200b40 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eeab4a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee414fca0 con 0x7f9ee42006c0 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eeab4a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee414ff80 con 0x7f9ed0003660 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9ee9b48640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0003660 0x7f9ee415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eea349640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 0x7f9ee40cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eea349640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 0x7f9ee40cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43686/0 (socket says 172.21.15.32:43686) 2024-02-17T00:37:04.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.632+0000 7f9eea349640 1 -- 172.21.15.32:0/4187115028 learned_addr learned my addr 172.21.15.32:0/4187115028 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.633+0000 7f9eea349640 1 -- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0003660 msgr2=0x7f9ee415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.633+0000 7f9eea349640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0003660 0x7f9ee415f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.633+0000 7f9eea349640 1 -- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee42006c0 msgr2=0x7f9ee40cd210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-17T00:37:04.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.633+0000 7f9eea349640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee42006c0 0x7f9ee40cd210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.633+0000 7f9eea349640 1 -- 172.21.15.32:0/4187115028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4150260 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.633+0000 7f9eea349640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 0x7f9ee40cd750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ee406b350 tx=0x7f9edc004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.635+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc018030 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.635+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc008c00 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.635+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00a0d0 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.635+0000 7f9eeab4a640 1 -- 172.21.15.32:0/4187115028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee4150540 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.635+0000 7f9eeab4a640 1 -- 172.21.15.32:0/4187115028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee4200100 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.637+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9edc01b070 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.638+0000 7f9eda7fc640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9ed006d1b0 0x7f9ed006f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.639+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9edc019070 con 0x7f9ee4200b40 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.639+0000 7f9ee9b48640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9ed006d1b0 0x7f9ed006f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.639+0000 7f9eeab4a640 1 -- 172.21.15.32:0/4187115028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc005290 con 0x7f9ee4200b40 2024-02-17T00:37:04.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.647+0000 7f9ee9b48640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9ed006d1b0 0x7f9ed006f670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0006fd0 tx=0x7f9ee0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.650+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9edc054dd0 con 0x7f9ee4200b40 2024-02-17T00:37:04.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.669+0000 7fbca0b0a640 1 Processor -- start 2024-02-17T00:37:04.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.669+0000 7fbca0b0a640 1 -- start start 2024-02-17T00:37:04.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fa8a6efb640 1 Processor -- start 2024-02-17T00:37:04.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbca0b0a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbca0b0a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc9c0cc480 0x7fbc9c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbca0b0a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c15a100 con 0x7fbc9c0ae6c0 2024-02-17T00:37:04.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbca0b0a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c15ad80 con 0x7fbc9c0cc480 2024-02-17T00:37:04.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbca0b0a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c15a3e0 con 0x7fbc9c1509b0 2024-02-17T00:37:04.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fa8a6efb640 1 -- start start 2024-02-17T00:37:04.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbe1ae4d640 1 Processor -- start 2024-02-17T00:37:04.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbe1ae4d640 1 -- start start 2024-02-17T00:37:04.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7febc9b25640 1 Processor -- start 2024-02-17T00:37:04.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbc9bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc9c0cc480 0x7fbc9c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbc9bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc9c0cc480 0x7fbc9c0cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45156/0 (socket says 172.21.15.32:45156) 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.671+0000 7fbc9bfff640 1 -- 172.21.15.32:0/637779267 learned_addr learned my addr 172.21.15.32:0/637779267 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbc9bfff640 1 -- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 msgr2=0x7fbc9c0b2f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbc9bfff640 1 --2- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c0b2f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbc9bfff640 1 -- 172.21.15.32:0/637779267 >> v1:172.21.15.32:6789/0 conn(0x7fbc9c0ae6c0 legacy=0x7fbc9c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbc9bfff640 1 -- 172.21.15.32:0/637779267 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c15a6c0 con 0x7fbc9c0cc480 2024-02-17T00:37:04.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fa8a6efb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8980e3290 0x7fa89804ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbe1ae4d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe14147230 0x7fbe140cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbe1ae4d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe140ca590 0x7fbe1406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbe1ae4d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1406d640 con 0x7fbe140cba10 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbe1ae4d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140cbe80 con 0x7fbe14147230 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fbe1ae4d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140ca9a0 con 0x7fbe140ca590 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe14147230 0x7fbe140cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe193ea640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe140ca590 0x7fbe1406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe14147230 0x7fbe140cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45166/0 (socket says 172.21.15.32:45166) 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 -- 172.21.15.32:0/1078814953 learned_addr learned my addr 172.21.15.32:0/1078814953 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbc9bfff640 1 --2- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 0x7fbc9c0cd9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc94010520 tx=0x7fbc940304a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d6355e8d3b72ed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7f8fcf59e640 1 Processor -- start 2024-02-17T00:37:04.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7f8fcf59e640 1 -- start start 2024-02-17T00:37:04.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbc9a7fc640 1 -- 172.21.15.32:0/637779267 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94036480 con 0x7fbc9c0cc480 2024-02-17T00:37:04.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbc9a7fc640 1 -- 172.21.15.32:0/637779267 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc94033030 con 0x7fbc9c0cc480 2024-02-17T00:37:04.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbc9a7fc640 1 -- 172.21.15.32:0/637779267 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94036800 con 0x7fbc9c0cc480 2024-02-17T00:37:04.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7febc9b25640 1 -- start start 2024-02-17T00:37:04.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7febc9b25640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7febc415de30 0x7febc415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7febc9b25640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc40ce2b0 con 0x7febc40d0280 2024-02-17T00:37:04.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7febc9b25640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc415e960 con 0x7febc415da50 2024-02-17T00:37:04.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7febc9b25640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc415ef20 con 0x7febc415de30 2024-02-17T00:37:04.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 -- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe140ca590 msgr2=0x7fbe1406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 --2- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe140ca590 0x7fbe1406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 -- 172.21.15.32:0/1078814953 >> v1:172.21.15.32:6789/0 conn(0x7fbe140cba10 legacy=0x7fbe140c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fbe18be9640 1 -- 172.21.15.32:0/1078814953 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1415f020 con 0x7fbe14147230 2024-02-17T00:37:04.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7febc3fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7febc40d0280 0x7febc40d06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57580/0 (socket says 172.21.15.32:57580) 2024-02-17T00:37:04.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7febc3fff640 1 -- 172.21.15.32:0/487221228 learned_addr learned my addr 172.21.15.32:0/487221228 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fa8a6efb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804f2c0 0x7fa89804f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fa8a6efb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89804fc60 con 0x7fa898037c50 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fa8a6efb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa898007530 con 0x7fa8980e3290 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.672+0000 7fa8a6efb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980e3670 con 0x7fa89804f2c0 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa8a5498640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa898037c50 0x7fa898038100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:49344/0 (socket says 172.21.15.32:49344) 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa8a5498640 1 -- 172.21.15.32:0/3180250065 learned_addr learned my addr 172.21.15.32:0/3180250065 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa8a4c97640 1 --2- 172.21.15.32:0/3180250065 >> v2:172.21.15.39:3300/0 conn(0x7fa8980e3290 0x7fa89804ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa89ffff640 1 --2- 172.21.15.32:0/3180250065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804f2c0 0x7fa89804f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa89ffff640 1 -- 172.21.15.32:0/3180250065 >> v2:172.21.15.39:3300/0 conn(0x7fa8980e3290 msgr2=0x7fa89804ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa89ffff640 1 --2- 172.21.15.32:0/3180250065 >> v2:172.21.15.39:3300/0 conn(0x7fa8980e3290 0x7fa89804ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa89ffff640 1 -- 172.21.15.32:0/3180250065 >> v1:172.21.15.39:6789/0 conn(0x7fa898037c50 legacy=0x7fa898038100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.673+0000 7fa89ffff640 1 -- 172.21.15.32:0/3180250065 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898006c00 con 0x7fa89804f2c0 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcf59e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fc8047c90 0x7f8fc80065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcdd9b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fc8047c90 0x7f8fc80065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcf59e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8fc8052f70 0x7f8fc8053380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcf59e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc804f730 con 0x7f8fc80e7550 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcf59e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc8037b30 con 0x7f8fc8047c90 2024-02-17T00:37:04.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcf59e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc804f450 con 0x7f8fc8052f70 2024-02-17T00:37:04.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbca0b0a640 1 -- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 msgr2=0x7fbc9c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 0x7fbc9c0cd9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc94010520 tx=0x7fbc940304a0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fce59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8fc80e7550 0x7f8fc8005ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:49368/0 (socket says 172.21.15.32:49368) 2024-02-17T00:37:04.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fce59c640 1 -- 172.21.15.32:0/2937788933 learned_addr learned my addr 172.21.15.32:0/2937788933 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:04.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8fcdd9b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fc8047c90 0x7f8fc80065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43694/0 (socket says 172.21.15.32:43694) 2024-02-17T00:37:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbca0b0a640 1 -- 172.21.15.32:0/637779267 shutdown_connections 2024-02-17T00:37:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 0x7fbc9c0cd9b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/637779267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c0b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7fbca0b0a640 1 -- 172.21.15.32:0/637779267 >> 172.21.15.32:0/637779267 conn(0x7fbc9c066f20 msgr2=0x7fbc9c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fa89ffff640 1 --2- 172.21.15.32:0/3180250065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804f2c0 0x7fa89804f720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002d370 tx=0x7fa8a00a6800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1c20871ac9dcda server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.674+0000 7f8883592640 1 Processor -- start 2024-02-17T00:37:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8883592640 1 -- start start 2024-02-17T00:37:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654673187 0 0) 0x7febc415e960 con 0x7febc415da50 2024-02-17T00:37:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febac003520 con 0x7febc415da50 2024-02-17T00:37:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc2ffd640 1 --2- 172.21.15.32:0/487221228 >> v2:172.21.15.39:3300/0 conn(0x7febc415de30 0x7febc415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fbe18be9640 1 --2- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe14147230 0x7fbe140cb4d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009870 tx=0x7fbe0802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6246f8bcba0b116 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3402806507 0 0) 0x7febac003520 con 0x7febc415da50 2024-02-17T00:37:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 >> v2:172.21.15.39:3300/0 conn(0x7febc415de30 msgr2=0x7febc415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 --2- 172.21.15.32:0/487221228 >> v2:172.21.15.39:3300/0 conn(0x7febc415de30 0x7febc415e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 >> v1:172.21.15.32:6789/0 conn(0x7febc40d0280 legacy=0x7febc40d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fbca0b0a640 1 -- 172.21.15.32:0/637779267 shutdown_connections 2024-02-17T00:37:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc415ec40 con 0x7febc415da50 2024-02-17T00:37:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fa89f7fe640 1 -- 172.21.15.32:0/3180250065 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00b1070 con 0x7fa89804f2c0 2024-02-17T00:37:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fa89f7fe640 1 -- 172.21.15.32:0/3180250065 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00ac620 con 0x7fa89804f2c0 2024-02-17T00:37:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fa89f7fe640 1 -- 172.21.15.32:0/3180250065 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00aca50 con 0x7fa89804f2c0 2024-02-17T00:37:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7febb4001670 con 0x7febc415da50 2024-02-17T00:37:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007068494 0 0) 0x7f8fc804f730 con 0x7f8fc80e7550 2024-02-17T00:37:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb8003520 con 0x7f8fc80e7550 2024-02-17T00:37:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 >> v1:172.21.15.39:6789/0 conn(0x7febc415da50 legacy=0x7febc40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fced9d640 1 --2- 172.21.15.32:0/2937788933 >> v2:172.21.15.39:3300/0 conn(0x7f8fc8052f70 0x7f8fc8053380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157354909 0 0) 0x7f8fb8003520 con 0x7f8fc80e7550 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 >> v2:172.21.15.39:3300/0 conn(0x7f8fc8052f70 msgr2=0x7f8fc8053380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 --2- 172.21.15.32:0/2937788933 >> v2:172.21.15.39:3300/0 conn(0x7f8fc8052f70 0x7f8fc8053380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 >> v2:172.21.15.32:3300/0 conn(0x7f8fc8047c90 msgr2=0x7f8fc80065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 --2- 172.21.15.32:0/2937788933 >> v2:172.21.15.32:3300/0 conn(0x7f8fc8047c90 0x7f8fc80065e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc804fbb0 con 0x7f8fc80e7550 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f8fc0001670 con 0x7f8fc80e7550 2024-02-17T00:37:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febac0039c0 0x7febac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 >> v1:172.21.15.39:6789/0 conn(0x7f8fc80e7550 legacy=0x7f8fc8005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fb8003970 0x7f8fb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febac0047c0 0x7febac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fb8005180 0x7f8fb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8037b30 con 0x7f8fb8005180 2024-02-17T00:37:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc804f450 con 0x7f8fb80047c0 2024-02-17T00:37:04.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb800c050 con 0x7f8fb8003970 2024-02-17T00:37:04.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc415ef20 con 0x7febac005380 2024-02-17T00:37:04.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac00c1f0 con 0x7febac0047c0 2024-02-17T00:37:04.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac00c3b0 con 0x7febac0039c0 2024-02-17T00:37:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7fbca0b0a640 1 -- 172.21.15.32:0/637779267 wait complete. 2024-02-17T00:37:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.675+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7febc3fff640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7fbe137fe640 1 -- 172.21.15.32:0/1078814953 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08030840 con 0x7fbe14147230 2024-02-17T00:37:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7fbe137fe640 1 -- 172.21.15.32:0/1078814953 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe080309a0 con 0x7fbe14147230 2024-02-17T00:37:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7fbe137fe640 1 -- 172.21.15.32:0/1078814953 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08030d30 con 0x7fbe14147230 2024-02-17T00:37:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8fce59c640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fb8003970 0x7f8fb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8883592640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f887c0b2f30 0x7f887c0ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8883592640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c150e50 con 0x7f887c06f080 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8883592640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c15a3e0 con 0x7f887c0aec00 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8883592640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c15ad80 con 0x7f887c0b2f30 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8882590640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f887c06f080 0x7f887c150740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57584/0 (socket says 172.21.15.32:57584) 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7f8882590640 1 -- 172.21.15.32:0/3820394892 learned_addr learned my addr 172.21.15.32:0/3820394892 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe14147230 msgr2=0x7fbe140cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe14147230 0x7fbe140cb4d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009870 tx=0x7fbe0802b980 comp rx=0 tx=0).stop 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1078814953 shutdown_connections 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe140ca590 0x7fbe1406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1078814953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe14147230 0x7fbe140cb4d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1078814953 >> 172.21.15.32:0/1078814953 conn(0x7fbe14071150 msgr2=0x7fbe14071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fa8a6efb640 1 -- 172.21.15.32:0/3180250065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804f2c0 msgr2=0x7fa89804f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/3180250065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804f2c0 0x7fa89804f720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002d370 tx=0x7fa8a00a6800 comp rx=0 tx=0).stop 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8881d8f640 1 --2- 172.21.15.32:0/3820394892 >> v2:172.21.15.39:3300/0 conn(0x7f887c0b2f30 0x7f887c0ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f888158e640 1 -- 172.21.15.32:0/3820394892 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019458602 0 0) 0x7f8878001110 con 0x7f887c06f080 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f888158e640 1 -- 172.21.15.32:0/3820394892 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868003520 con 0x7f887c06f080 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8881d8f640 1 -- 172.21.15.32:0/3820394892 >> v1:172.21.15.39:6789/0 conn(0x7f887c0aec00 legacy=0x7f887c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8881d8f640 1 -- 172.21.15.32:0/3820394892 >> v1:172.21.15.32:6789/0 conn(0x7f887c06f080 legacy=0x7f887c150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8881d8f640 1 -- 172.21.15.32:0/3820394892 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c15a6c0 con 0x7f887c0b2f30 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fced9d640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fb8005180 0x7f8fb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fb8003970 msgr2=0x7f8fb8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fb8003970 0x7f8fb8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/2937788933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fb8005180 msgr2=0x7f8fb800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fb8005180 0x7f8fb800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/2937788933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc804fbb0 con 0x7f8fb80047c0 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7f8fce59c640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fb8003970 0x7f8fb8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7f8fced9d640 1 -- 172.21.15.32:0/2937788933 reap_dead start 2024-02-17T00:37:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fb8004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009a90 tx=0x7f8fb80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=383a600920055c39 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7febc3fff640 1 -- 172.21.15.32:0/487221228 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febac0039c0 msgr2=0x7febac003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7febc3fff640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febac0039c0 0x7febac003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7febc3fff640 1 -- 172.21.15.32:0/487221228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febac0047c0 msgr2=0x7febac004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7febc3fff640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febac0047c0 0x7febac004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.676+0000 7febc3fff640 1 -- 172.21.15.32:0/487221228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac003520 con 0x7febac005380 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7febc3fff640 1 -- 172.21.15.32:0/487221228 reap_dead start 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7febc3fff640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febac00b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c190 tx=0x7febac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b394c8908ba6b0aa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7fbca0b0a640 1 Processor -- start 2024-02-17T00:37:04.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.677+0000 7fbca0b0a640 1 -- start start 2024-02-17T00:37:04.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fa8a6efb640 1 -- 172.21.15.32:0/3180250065 shutdown_connections 2024-02-17T00:37:04.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/3180250065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804f2c0 0x7fa89804f720 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002d370 tx=0x7fa8a00a6800 comp rx=0 tx=0).stop 2024-02-17T00:37:04.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/3180250065 >> v2:172.21.15.39:3300/0 conn(0x7fa8980e3290 0x7fa89804ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fa8a6efb640 1 -- 172.21.15.32:0/3180250065 >> 172.21.15.32:0/3180250065 conn(0x7fa898009fe0 msgr2=0x7fa89800a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1078814953 shutdown_connections 2024-02-17T00:37:04.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbca0b0a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc9c0ae6c0 0x7fbc9c1ef160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc402c6b0 con 0x7f8fb80047c0 2024-02-17T00:37:04.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc02ca50 con 0x7febac005380 2024-02-17T00:37:04.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc402c810 con 0x7f8fb80047c0 2024-02-17T00:37:04.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbca0b0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 0x7fbc9c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc02cbd0 con 0x7febac005380 2024-02-17T00:37:04.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbca0b0a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7febc27fc640 1 -- 172.21.15.32:0/487221228 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc035470 con 0x7febac005380 2024-02-17T00:37:04.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbca0b0a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c154c90 con 0x7fbc9c0ae6c0 2024-02-17T00:37:04.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbca0b0a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c154f70 con 0x7fbc9c0cc480 2024-02-17T00:37:04.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbca0b0a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c155250 con 0x7fbc9c1509b0 2024-02-17T00:37:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.678+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1078814953 wait complete. 2024-02-17T00:37:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc9c0ae6c0 0x7fbc9c1ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:45824/0 (socket says 172.21.15.32:45824) 2024-02-17T00:37:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 -- 172.21.15.32:0/4288986970 learned_addr learned my addr 172.21.15.32:0/4288986970 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcd59a640 1 -- 172.21.15.32:0/2937788933 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc402cba0 con 0x7f8fb80047c0 2024-02-17T00:37:04.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fa8a6efb640 1 -- 172.21.15.32:0/3180250065 shutdown_connections 2024-02-17T00:37:04.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8881d8f640 1 --2- 172.21.15.32:0/3820394892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 0x7f887c0ae6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f886c0097a0 tx=0x7f886c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e163fd2b5177e8c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fa8a6efb640 1 -- 172.21.15.32:0/3180250065 wait complete. 2024-02-17T00:37:04.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 -- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 msgr2=0x7fbc9c154590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-17T00:37:04.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 0x7fbc9c154590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 -- 172.21.15.32:0/4288986970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc9c0ae6c0 msgr2=0x7fbc9c1ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc9c0ae6c0 0x7fbc9c1ef160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 -- 172.21.15.32:0/4288986970 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94007790 con 0x7fbc9c1509b0 2024-02-17T00:37:04.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcf59e640 1 -- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 msgr2=0x7f8fb8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fb8004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009a90 tx=0x7f8fb80057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcf59e640 1 -- 172.21.15.32:0/2937788933 shutdown_connections 2024-02-17T00:37:04.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/2937788933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fb8004c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcf59e640 1 -- 172.21.15.32:0/2937788933 >> 172.21.15.32:0/2937788933 conn(0x7f8fc8009fa0 msgr2=0x7f8fc800a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7febc9b25640 1 -- 172.21.15.32:0/487221228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 msgr2=0x7febac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7fbc9bfff640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c153dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007210 tx=0x7fbc94004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7febc9b25640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febac00b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c190 tx=0x7febac0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f8fcf59e640 1 -- 172.21.15.32:0/2937788933 shutdown_connections 2024-02-17T00:37:04.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94036480 con 0x7fbc9c1509b0 2024-02-17T00:37:04.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7f8fcf59e640 1 -- 172.21.15.32:0/2937788933 wait complete. 2024-02-17T00:37:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc940365e0 con 0x7fbc9c1509b0 2024-02-17T00:37:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94036950 con 0x7fbc9c1509b0 2024-02-17T00:37:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c155530 con 0x7fbc9c1509b0 2024-02-17T00:37:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c151230 con 0x7fbc9c1509b0 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbe1ae4d640 1 Processor -- start 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7fbe1ae4d640 1 -- start start 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f888158e640 1 -- 172.21.15.32:0/3820394892 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c030610 con 0x7f887c0b2f30 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f888158e640 1 -- 172.21.15.32:0/3820394892 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c030770 con 0x7f887c0b2f30 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.679+0000 7f888158e640 1 -- 172.21.15.32:0/3820394892 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c030b00 con 0x7f887c0b2f30 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7f8883592640 1 -- 172.21.15.32:0/3820394892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 msgr2=0x7f887c0ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.680+0000 7f8883592640 1 --2- 172.21.15.32:0/3820394892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 0x7f887c0ae6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f886c0097a0 tx=0x7f886c02b960 comp rx=0 tx=0).stop 2024-02-17T00:37:04.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fa8a6efb640 1 Processor -- start 2024-02-17T00:37:04.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7febc9b25640 1 -- 172.21.15.32:0/487221228 shutdown_connections 2024-02-17T00:37:04.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7febc9b25640 1 --2- 172.21.15.32:0/487221228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febac00b980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7febc9b25640 1 -- 172.21.15.32:0/487221228 >> 172.21.15.32:0/487221228 conn(0x7febc4072290 msgr2=0x7febc4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fa8a6efb640 1 -- start start 2024-02-17T00:37:04.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fa5b5f65640 1 Processor -- start 2024-02-17T00:37:04.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7febc9b25640 1 -- 172.21.15.32:0/487221228 shutdown_connections 2024-02-17T00:37:04.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fa5b5f65640 1 -- start start 2024-02-17T00:37:04.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7febc9b25640 1 -- 172.21.15.32:0/487221228 wait complete. 2024-02-17T00:37:04.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fbe1ae4d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 0x7fbe141f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fbe1ae4d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe140cba10 0x7fbe1413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.681+0000 7fbe18be9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 0x7fbe141f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe18be9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 0x7fbe141f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45214/0 (socket says 172.21.15.32:45214) 2024-02-17T00:37:04.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7f8fcf59e640 1 Processor -- start 2024-02-17T00:37:04.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe18be9640 1 -- 172.21.15.32:0/1324466340 learned_addr learned my addr 172.21.15.32:0/1324466340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7f8fcf59e640 1 -- start start 2024-02-17T00:37:04.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe14147230 0x7fbe141458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140b4b10 con 0x7fbe140cba10 2024-02-17T00:37:04.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fa8a6efb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 0x7fa8980d84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14143380 con 0x7fbe140ca590 2024-02-17T00:37:04.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14143660 con 0x7fbe14147230 2024-02-17T00:37:04.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe13fff640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe140cba10 0x7fbe1413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbe193ea640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe14147230 0x7fbe141458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fa8a6efb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8980e3290 0x7fa8980d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b5f65640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5a8050bf0 0x7fa5a80e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fa8a4c97640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 0x7fa8980d84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b5f65640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa5a80e0f10 0x7fa5a80e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b5f65640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80512f0 con 0x7fa5a80dfee0 2024-02-17T00:37:04.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b5f65640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80090c0 con 0x7fa5a8050bf0 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbe18be9640 1 -- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe14147230 msgr2=0x7fbe141458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbe18be9640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe14147230 0x7fbe141458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbe18be9640 1 -- 172.21.15.32:0/1324466340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe140cba10 msgr2=0x7fbe1413e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbe18be9640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe140cba10 0x7fbe1413e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbe18be9640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080094d0 con 0x7fbe140ca590 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbe193ea640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe14147230 0x7fbe141458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:04.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b5f65640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a8051080 con 0x7fa5a80e0f10 2024-02-17T00:37:04.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa8a4c97640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 0x7fa8980d84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45220/0 (socket says 172.21.15.32:45220) 2024-02-17T00:37:04.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.682+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbc94040050 con 0x7fbc9c1509b0 2024-02-17T00:37:04.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbc83fff640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc8806b910 0x7fbc8806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbc940b0f20 con 0x7fbc9c1509b0 2024-02-17T00:37:04.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa8a4c97640 1 -- 172.21.15.32:0/1007271067 learned_addr learned my addr 172.21.15.32:0/1007271067 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa89ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8980e3290 0x7fa8980d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c155a50 con 0x7fbc9c1509b0 2024-02-17T00:37:04.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804dd90 0x7fa89804e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8fcf59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fc804c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8fcf59e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 0x7f8fc80e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898033c20 con 0x7fa8980e3290 2024-02-17T00:37:04.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5affff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5a8050bf0 0x7fa5a80e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b4f63640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa5a80dfee0 0x7fa5a80e02c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:49386/0 (socket says 172.21.15.32:49386) 2024-02-17T00:37:04.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa5b4f63640 1 -- 172.21.15.32:0/2134780832 learned_addr learned my addr 172.21.15.32:0/2134780832 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:04.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980d80c0 con 0x7fa898037c50 2024-02-17T00:37:04.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89804e740 con 0x7fa89804dd90 2024-02-17T00:37:04.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8883592640 1 -- 172.21.15.32:0/3820394892 shutdown_connections 2024-02-17T00:37:04.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8883592640 1 --2- 172.21.15.32:0/3820394892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 0x7f887c0ae6c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8883592640 1 -- 172.21.15.32:0/3820394892 >> 172.21.15.32:0/3820394892 conn(0x7f887c066f20 msgr2=0x7f887c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8fcdd9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 0x7f8fc80e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7fbc9b7fe640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc8806b910 0x7fbc8806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8fcdd9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 0x7f8fc80e9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43738/0 (socket says 172.21.15.32:43738) 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/4185036192 learned_addr learned my addr 172.21.15.32:0/4185036192 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.683+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc80d7dd0 0x7f8fc80e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa5affff640 1 -- 172.21.15.32:0/2134780832 >> v2:172.21.15.39:3300/0 conn(0x7fa5a80e0f10 msgr2=0x7fa5a80e9c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa5affff640 1 --2- 172.21.15.32:0/2134780832 >> v2:172.21.15.39:3300/0 conn(0x7fa5a80e0f10 0x7fa5a80e9c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa5affff640 1 -- 172.21.15.32:0/2134780832 >> v1:172.21.15.39:6789/0 conn(0x7fa5a80dfee0 legacy=0x7fa5a80e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa5affff640 1 -- 172.21.15.32:0/2134780832 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8009550 con 0x7fa5a8050bf0 2024-02-17T00:37:04.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8049190 con 0x7f8fc80d51e0 2024-02-17T00:37:04.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8883592640 1 -- 172.21.15.32:0/3820394892 shutdown_connections 2024-02-17T00:37:04.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc804bcb0 con 0x7f8fb80047c0 2024-02-17T00:37:04.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc804bf90 con 0x7f8fc80d7dd0 2024-02-17T00:37:04.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa8a4c97640 1 -- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804dd90 msgr2=0x7fa89804e200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T00:37:04.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa8a4c97640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804dd90 0x7fa89804e200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa8a4c97640 1 -- 172.21.15.32:0/1007271067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8980e3290 msgr2=0x7fa8980d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa8a4c97640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8980e3290 0x7fa8980d4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa8a4c97640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a004fe10 con 0x7fa898037c50 2024-02-17T00:37:04.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fbe18be9640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 0x7fbe141f9000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000c00 tx=0x7fbe08004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fce59c640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fc804c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fa8a4c97640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 0x7fa8980d84e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa89400e8a0 tx=0x7fa89400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08039a90 con 0x7fbe140ca590 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7fbc9b7fe640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc8806b910 0x7fbc8806ddd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0cd3f0 tx=0x7fbc90009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fced9d640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc80d7dd0 0x7f8fc80e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc80d7dd0 msgr2=0x7f8fc80e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc80d7dd0 0x7f8fc80e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 msgr2=0x7f8fc804c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fc804c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fcdd9b640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc804c270 con 0x7f8fc80d51e0 2024-02-17T00:37:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fced9d640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc80d7dd0 0x7f8fc80e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8fce59c640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fc804c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14143940 con 0x7fbe140ca590 2024-02-17T00:37:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe141f9540 con 0x7fbe140ca590 2024-02-17T00:37:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe08039bf0 con 0x7fbe140ca590 2024-02-17T00:37:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa5affff640 1 --2- 172.21.15.32:0/2134780832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a8050bf0 0x7fa5a80e09d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8056c70 tx=0x7fa59c02b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3531a3e2c737427b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08043410 con 0x7fbe140ca590 2024-02-17T00:37:04.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7febc9b25640 1 Processor -- start 2024-02-17T00:37:04.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7febc9b25640 1 -- start start 2024-02-17T00:37:04.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa5af7fe640 1 -- 172.21.15.32:0/2134780832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c030710 con 0x7fa5a8050bf0 2024-02-17T00:37:04.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa5af7fe640 1 -- 172.21.15.32:0/2134780832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c02e050 con 0x7fa5a8050bf0 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa5af7fe640 1 -- 172.21.15.32:0/2134780832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c030a90 con 0x7fa5a8050bf0 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7febc9b25640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febc40aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7febc9b25640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febc415b4c0 0x7febc415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7febc9b25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 0x7febc40ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7febc9b25640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc40ac8a0 con 0x7febac005380 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7febc9b25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc415b270 con 0x7febc40abee0 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7febc9b25640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc40aa820 con 0x7febc415b4c0 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894009510 con 0x7fa898037c50 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400c940 con 0x7fa898037c50 2024-02-17T00:37:04.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400ccf0 con 0x7fa898037c50 2024-02-17T00:37:04.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.685+0000 7f8fcdd9b640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 0x7f8fc80e9220 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4000c00 tx=0x7f8fc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2134780832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a8050bf0 msgr2=0x7fa5a80e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003810 con 0x7f8fc80d51e0 2024-02-17T00:37:04.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf4005290 con 0x7fbe140ca590 2024-02-17T00:37:04.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2134780832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a8050bf0 0x7fa5a80e09d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8056c70 tx=0x7fa59c02b680 comp rx=0 tx=0).stop 2024-02-17T00:37:04.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2134780832 shutdown_connections 2024-02-17T00:37:04.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2134780832 >> v2:172.21.15.39:3300/0 conn(0x7fa5a80e0f10 0x7fa5a80e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2134780832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a8050bf0 0x7fa5a80e09d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2134780832 >> 172.21.15.32:0/2134780832 conn(0x7fa5a8055bd0 msgr2=0x7fa5a8055fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4003970 con 0x7f8fc80d51e0 2024-02-17T00:37:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003d00 con 0x7f8fc80d51e0 2024-02-17T00:37:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2134780832 shutdown_connections 2024-02-17T00:37:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc8049470 con 0x7f8fc80d51e0 2024-02-17T00:37:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2134780832 wait complete. 2024-02-17T00:37:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc80d8320 con 0x7f8fc80d51e0 2024-02-17T00:37:04.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7febc2ffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febc415b4c0 0x7febc415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 0x7febc40ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 0x7febc40ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45240/0 (socket says 172.21.15.32:45240) 2024-02-17T00:37:04.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc3fff640 1 -- 172.21.15.32:0/2973674809 learned_addr learned my addr 172.21.15.32:0/2973674809 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.684+0000 7f8883592640 1 -- 172.21.15.32:0/3820394892 wait complete. 2024-02-17T00:37:04.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8883592640 1 Processor -- start 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.686+0000 7f8883592640 1 -- start start 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8883592640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f887c06f080 0x7f887c14ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8883592640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 0x7f887c08a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8883592640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 0x7f887c140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8883592640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0b3390 con 0x7f887c0aec00 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8883592640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0b1c00 con 0x7f887c0b2f30 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8883592640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0b0030 con 0x7f887c06f080 2024-02-17T00:37:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8980d7440 con 0x7fa898037c50 2024-02-17T00:37:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8980d7a00 con 0x7fa898037c50 2024-02-17T00:37:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc3fff640 1 -- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febc415b4c0 msgr2=0x7febc415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc3fff640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febc415b4c0 0x7febc415ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc3fff640 1 -- 172.21.15.32:0/2973674809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 msgr2=0x7febc40aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc804c400 con 0x7f8fc80d51e0 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7febc37fe640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febc40aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7febc3fff640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febc40aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7febc3fff640 1 -- 172.21.15.32:0/2973674809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40aab00 con 0x7febc40abee0 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7febc37fe640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febc40aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 0x7f887c08a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 0x7f887c08a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43750/0 (socket says 172.21.15.32:43750) 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 -- 172.21.15.32:0/412819404 learned_addr learned my addr 172.21.15.32:0/412819404 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 -- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f887c06f080 msgr2=0x7f887c14ea00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f887c06f080 0x7f887c14ea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 -- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 msgr2=0x7f887c140c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 0x7f887c140c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.687+0000 7f8881d8f640 1 -- 172.21.15.32:0/412819404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009400 con 0x7f887c0aec00 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7f8881d8f640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 0x7f887c08a550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f886c02bf70 tx=0x7f886c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7fa5b5f65640 1 Processor -- start 2024-02-17T00:37:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8980052f0 con 0x7fa898037c50 2024-02-17T00:37:04.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c03e070 con 0x7f887c0aec00 2024-02-17T00:37:04.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7febc3fff640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 0x7febc40ac360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c2b0 tx=0x7febbc0014a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7fa5b5f65640 1 -- start start 2024-02-17T00:37:04.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.688+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c039840 con 0x7f887c0aec00 2024-02-17T00:37:04.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc036ca0 con 0x7febc40abee0 2024-02-17T00:37:04.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc03a050 con 0x7febc40abee0 2024-02-17T00:37:04.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc040470 con 0x7febc40abee0 2024-02-17T00:37:04.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc9c155a50 con 0x7fbc9c1509b0 2024-02-17T00:37:04.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbe0802f390 con 0x7fbe140ca590 2024-02-17T00:37:04.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc40aade0 con 0x7febc40abee0 2024-02-17T00:37:04.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc415bcd0 con 0x7febc40abee0 2024-02-17T00:37:04.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8fc4040450 con 0x7f8fc80d51e0 2024-02-17T00:37:04.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.689+0000 7fbe117fa640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe0006b810 0x7fbe0006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbe080ac590 con 0x7fbe140ca590 2024-02-17T00:37:04.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c039bf0 con 0x7f887c0aec00 2024-02-17T00:37:04.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b5f65640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 0x7fa5a804cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b5f65640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a80dfee0 0x7fa5a80d9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b5f65640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5a80e0f10 0x7fa5a80da500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b5f65640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8039d50 con 0x7fa5a80dfee0 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b5f65640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8039460 con 0x7fa5a80e0f10 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b5f65640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8039700 con 0x7fa5a8050bf0 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c0b02d0 con 0x7f887c0aec00 2024-02-17T00:37:04.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fbe13fff640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe0006b810 0x7fbe0006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b4f63640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 0x7fa5a804cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c0b0890 con 0x7f887c0aec00 2024-02-17T00:37:04.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b4f63640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 0x7fa5a804cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:45884/0 (socket says 172.21.15.32:45884) 2024-02-17T00:37:04.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5b4f63640 1 -- 172.21.15.32:0/2244251985 learned_addr learned my addr 172.21.15.32:0/2244251985 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:04.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7fa5affff640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a80dfee0 0x7fa5a80d9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.690+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc4068fd0 con 0x7febc40abee0 2024-02-17T00:37:04.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b5764640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5a80e0f10 0x7fa5a80da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b4f63640 1 -- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5a80e0f10 msgr2=0x7fa5a80da500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b4f63640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5a80e0f10 0x7fa5a80da500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b4f63640 1 -- 172.21.15.32:0/2244251985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a80dfee0 msgr2=0x7fa5a80d9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b4f63640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a80dfee0 0x7fa5a80d9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b4f63640 1 -- 172.21.15.32:0/2244251985 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009400 con 0x7fa5a8050bf0 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa894013470 con 0x7fa898037c50 2024-02-17T00:37:04.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7f8fbeffd640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fb006b910 0x7f8fb006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7f8fce59c640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fb006b910 0x7f8fb006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8fc40ac3f0 con 0x7f8fc80d51e0 2024-02-17T00:37:04.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa5b4f63640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 0x7fa5a804cdf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5b006ab00 tx=0x7fa5b0067f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7fa89d7fa640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa88406b8e0 0x7fa88406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.691+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c068f60 con 0x7f887c0aec00 2024-02-17T00:37:04.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0073280 con 0x7fa5a8050bf0 2024-02-17T00:37:04.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b006ad70 con 0x7fa5a8050bf0 2024-02-17T00:37:04.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa89408a5d0 con 0x7fa898037c50 2024-02-17T00:37:04.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80399e0 con 0x7fa5a8050bf0 2024-02-17T00:37:04.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7f8fce59c640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fb006b910 0x7f8fb006ddd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0001eb0 tx=0x7f8fc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa89ffff640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa88406b8e0 0x7fa88406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a804d840 con 0x7fa5a8050bf0 2024-02-17T00:37:04.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00737f0 con 0x7fa5a8050bf0 2024-02-17T00:37:04.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fbe13fff640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe0006b810 0x7fbe0006dcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe140b15b0 tx=0x7fbe0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.692+0000 7fa89ffff640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa88406b8e0 0x7fa88406dda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8980e37b0 tx=0x7fa8a006e030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.693+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a8050070 con 0x7fa5a8050bf0 2024-02-17T00:37:04.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.694+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa5b0073950 con 0x7fa5a8050bf0 2024-02-17T00:37:04.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.694+0000 7fa5ad7fa640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa59406b810 0x7fa59406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.694+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5b0104720 con 0x7fa5a8050bf0 2024-02-17T00:37:04.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.694+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe08076c80 con 0x7fbe140ca590 2024-02-17T00:37:04.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.694+0000 7fa5affff640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa59406b810 0x7fa59406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.695+0000 7fa5affff640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa59406b810 0x7fa59406dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa59c034000 tx=0x7fa59c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.696+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7febbc032070 con 0x7febc40abee0 2024-02-17T00:37:04.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.696+0000 7febabfff640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7febb006b860 0x7febb006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.697+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8fc4076b40 con 0x7f8fc80d51e0 2024-02-17T00:37:04.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.697+0000 7febc37fe640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7febb006b860 0x7febb006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.697+0000 7febc37fe640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7febb006b860 0x7febb006dd20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7febb40079c0 tx=0x7febb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.699+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7febbc07c150 con 0x7febc40abee0 2024-02-17T00:37:04.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.698+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f886c039d50 con 0x7f887c0aec00 2024-02-17T00:37:04.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.699+0000 7f8872ffd640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f886006b890 0x7f886006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:04.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.699+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa894054d40 con 0x7fa898037c50 2024-02-17T00:37:04.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.699+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f886c0ad210 con 0x7f887c0aec00 2024-02-17T00:37:04.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.700+0000 7f8882590640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f886006b890 0x7f886006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:04.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.700+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5b00cee90 con 0x7fa5a8050bf0 2024-02-17T00:37:04.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.700+0000 7f8882590640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f886006b890 0x7f886006dd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f887c072430 tx=0x7f88780010d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:04.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.704+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f886c0779d0 con 0x7f887c0aec00 2024-02-17T00:37:04.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:04.704+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febbc077cf0 con 0x7febc40abee0 2024-02-17T00:37:05.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.062+0000 7f9eeab4a640 1 -- 172.21.15.32:0/4187115028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ecc005540 con 0x7f9ee4200b40 2024-02-17T00:37:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.063+0000 7f9eda7fc640 1 -- 172.21.15.32:0/4187115028 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9edc059e60 con 0x7f9ee4200b40 2024-02-17T00:37:05.066 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:05.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.066+0000 7f9ec7fff640 1 -- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9ed006d1b0 msgr2=0x7f9ed006f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.066+0000 7f9ec7fff640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9ed006d1b0 0x7f9ed006f670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0006fd0 tx=0x7f9ee0008040 comp rx=0 tx=0).stop 2024-02-17T00:37:05.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 -- 172.21.15.32:0/4187115028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 msgr2=0x7f9ee40cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 0x7f9ee40cd750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ee406b350 tx=0x7f9edc004700 comp rx=0 tx=0).stop 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 -- 172.21.15.32:0/4187115028 shutdown_connections 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee4200b40 0x7f9ee40cd750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee42006c0 0x7f9ee40cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9ed006d1b0 0x7f9ed006f670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 --2- 172.21.15.32:0/4187115028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9ed0003660 0x7f9ee415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.067+0000 7f9ec7fff640 1 -- 172.21.15.32:0/4187115028 >> 172.21.15.32:0/4187115028 conn(0x7f9ee4066b00 msgr2=0x7f9ee40ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.068+0000 7f9ec7fff640 1 -- 172.21.15.32:0/4187115028 shutdown_connections 2024-02-17T00:37:05.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.068+0000 7f9ec7fff640 1 -- 172.21.15.32:0/4187115028 wait complete. 2024-02-17T00:37:05.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-02-17T00:37:05.088 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.093+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbc9c155a50 con 0x7fbc9c1509b0 2024-02-17T00:37:05.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.094+0000 7fbc83fff640 1 -- 172.21.15.32:0/4288986970 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc9c155a50 con 0x7fbc9c1509b0 2024-02-17T00:37:05.097 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc8806b910 msgr2=0x7fbc8806ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc8806b910 0x7fbc8806ddd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0cd3f0 tx=0x7fbc90009060 comp rx=0 tx=0).stop 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 msgr2=0x7fbc9c153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c153dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007210 tx=0x7fbc94004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 shutdown_connections 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc8806b910 0x7fbc8806ddd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc9c1509b0 0x7fbc9c153dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc9c0cc480 0x7fbc9c154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 --2- 172.21.15.32:0/4288986970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc9c0ae6c0 0x7fbc9c1ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.096+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 >> 172.21.15.32:0/4288986970 conn(0x7fbc9c066f20 msgr2=0x7fbc9c06e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.097+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 shutdown_connections 2024-02-17T00:37:05.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.097+0000 7fbca0b0a640 1 -- 172.21.15.32:0/4288986970 wait complete. 2024-02-17T00:37:05.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.5 2024-02-17T00:37:05.111 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.110+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8fc80052b0 con 0x7f8fc80d51e0 2024-02-17T00:37:05.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.111+0000 7f8fbeffd640 1 -- 172.21.15.32:0/4185036192 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc40044e0 con 0x7f8fc80d51e0 2024-02-17T00:37:05.114 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:05.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fb006b910 msgr2=0x7f8fb006ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fb006b910 0x7f8fb006ddd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0001eb0 tx=0x7f8fc0009040 comp rx=0 tx=0).stop 2024-02-17T00:37:05.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 msgr2=0x7f8fc80e9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 0x7f8fc80e9220 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4000c00 tx=0x7f8fc4004730 comp rx=0 tx=0).stop 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 shutdown_connections 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fb006b910 0x7f8fb006ddd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc80d7dd0 0x7f8fc80e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc80d51e0 0x7f8fc80e9220 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 --2- 172.21.15.32:0/4185036192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fb80047c0 0x7f8fc804c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 >> 172.21.15.32:0/4185036192 conn(0x7f8fc8009fa0 msgr2=0x7f8fc80056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 shutdown_connections 2024-02-17T00:37:05.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.114+0000 7f8fcf59e640 1 -- 172.21.15.32:0/4185036192 wait complete. 2024-02-17T00:37:05.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.122+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbdf4005540 con 0x7fbe140ca590 2024-02-17T00:37:05.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.123+0000 7fbe117fa640 1 -- 172.21.15.32:0/1324466340 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe0807a340 con 0x7fbe140ca590 2024-02-17T00:37:05.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.123+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8980e2560 con 0x7fa898037c50 2024-02-17T00:37:05.126 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:05.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.123+0000 7fa89d7fa640 1 -- 172.21.15.32:0/1007271067 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa894058400 con 0x7fa898037c50 2024-02-17T00:37:05.126 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:05.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe0006b810 msgr2=0x7fbe0006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa88406b8e0 msgr2=0x7fa88406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe0006b810 0x7fbe0006dcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe140b15b0 tx=0x7fbe0c009040 comp rx=0 tx=0).stop 2024-02-17T00:37:05.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa88406b8e0 0x7fa88406dda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8980e37b0 tx=0x7fa8a006e030 comp rx=0 tx=0).stop 2024-02-17T00:37:05.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 msgr2=0x7fbe141f9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 0x7fbe141f9000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000c00 tx=0x7fbe08004730 comp rx=0 tx=0).stop 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 msgr2=0x7fa8980d84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 0x7fa8980d84e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa89400e8a0 tx=0x7fa89400eca0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 shutdown_connections 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 shutdown_connections 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa88406b8e0 0x7fa88406dda0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa89804dd90 0x7fa89804e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8980e3290 0x7fa8980d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 --2- 172.21.15.32:0/1007271067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898037c50 0x7fa8980d84e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbe0006b810 0x7fbe0006dcd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 >> 172.21.15.32:0/1007271067 conn(0x7fa898009fe0 msgr2=0x7fa898036560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbe14147230 0x7fbe141458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe140cba10 0x7fbe1413e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 --2- 172.21.15.32:0/1324466340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe140ca590 0x7fbe141f9000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 >> 172.21.15.32:0/1324466340 conn(0x7fbe14071150 msgr2=0x7fbe1406e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 shutdown_connections 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fa8a6efb640 1 -- 172.21.15.32:0/1007271067 wait complete. 2024-02-17T00:37:05.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7febc40d1610 con 0x7febc40abee0 2024-02-17T00:37:05.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 shutdown_connections 2024-02-17T00:37:05.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7fbe1ae4d640 1 -- 172.21.15.32:0/1324466340 wait complete. 2024-02-17T00:37:05.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.127+0000 7febabfff640 1 -- 172.21.15.32:0/2973674809 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febbc07b3b0 con 0x7febc40abee0 2024-02-17T00:37:05.134 INFO:teuthology.orchestra.run.smithi032.stdout:55834574859 2024-02-17T00:37:05.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.129+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5a8005710 con 0x7fa5a8050bf0 2024-02-17T00:37:05.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.129+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f887c15da60 con 0x7f887c0aec00 2024-02-17T00:37:05.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.129+0000 7fa5ad7fa640 1 -- 172.21.15.32:0/2244251985 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5b008e020 con 0x7fa5a8050bf0 2024-02-17T00:37:05.135 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-02-17T00:37:05.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.130+0000 7f8872ffd640 1 -- 172.21.15.32:0/412819404 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f886c034090 con 0x7f887c0aec00 2024-02-17T00:37:05.136 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-02-17T00:37:05.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.6 2024-02-17T00:37:05.137 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.130+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7febb006b860 msgr2=0x7febb006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.130+0000 7febc9b25640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7febb006b860 0x7febb006dd20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7febb40079c0 tx=0x7febb4009040 comp rx=0 tx=0).stop 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 msgr2=0x7febc40ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 0x7febc40ac360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c2b0 tx=0x7febbc0014a0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 shutdown_connections 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc40abee0 0x7febc40ac360 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7febb006b860 0x7febb006dd20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7febc415b4c0 0x7febc415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 --2- 172.21.15.32:0/2973674809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac005380 0x7febc40aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 >> 172.21.15.32:0/2973674809 conn(0x7febc4072290 msgr2=0x7febc4161940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 shutdown_connections 2024-02-17T00:37:05.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.131+0000 7febc9b25640 1 -- 172.21.15.32:0/2973674809 wait complete. 2024-02-17T00:37:05.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa59406b810 msgr2=0x7fa59406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa59406b810 0x7fa59406dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa59c034000 tx=0x7fa59c008030 comp rx=0 tx=0).stop 2024-02-17T00:37:05.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 msgr2=0x7fa5a804cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 0x7fa5a804cdf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5b006ab00 tx=0x7fa5b0067f70 comp rx=0 tx=0).stop 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f886006b890 msgr2=0x7f886006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f886006b890 0x7f886006dd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f887c072430 tx=0x7f88780010d0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 msgr2=0x7f887c08a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 shutdown_connections 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5a80e0f10 0x7fa5a80da500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5a80dfee0 0x7fa5a80d9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa59406b810 0x7fa59406dcd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 --2- 172.21.15.32:0/2244251985 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5a8050bf0 0x7fa5a804cdf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 >> 172.21.15.32:0/2244251985 conn(0x7fa5a8055bd0 msgr2=0x7fa5a80e2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 0x7f887c08a550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f886c02bf70 tx=0x7f886c0046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 shutdown_connections 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f887c0b2f30 0x7f887c140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0aec00 0x7f887c08a550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f886006b890 0x7f886006dd50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 --2- 172.21.15.32:0/412819404 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f887c06f080 0x7f887c14ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 shutdown_connections 2024-02-17T00:37:05.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 >> 172.21.15.32:0/412819404 conn(0x7f887c066f20 msgr2=0x7f887c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7fa5b5f65640 1 -- 172.21.15.32:0/2244251985 wait complete. 2024-02-17T00:37:05.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 shutdown_connections 2024-02-17T00:37:05.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.133+0000 7f8883592640 1 -- 172.21.15.32:0/412819404 wait complete. 2024-02-17T00:37:05.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.7 2024-02-17T00:37:05.148 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2024-02-17T00:37:05.151 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-02-17T00:37:05.151 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2024-02-17T00:37:05.156 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-02-17T00:37:05.157 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:05.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T00:37:05.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.295+0000 7ff81bed4640 1 Processor -- start 2024-02-17T00:37:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.295+0000 7ff81bed4640 1 -- start start 2024-02-17T00:37:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81bed4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406bc70 0x7ff81409a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81bed4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140d06e0 con 0x7ff81406c330 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81bed4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81409a940 con 0x7ff81415da20 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81bed4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140cfad0 con 0x7ff81406bc70 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81a471640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff81406c330 0x7ff8140cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57598/0 (socket says 172.21.15.32:57598) 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81a471640 1 -- 172.21.15.32:0/3819580815 learned_addr learned my addr 172.21.15.32:0/3819580815 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81946f640 1 --2- 172.21.15.32:0/3819580815 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406bc70 0x7ff81409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521044094 0 0) 0x7ff8140d06e0 con 0x7ff81406c330 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff800003520 con 0x7ff81406c330 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592954762 0 0) 0x7ff81409a940 con 0x7ff81415da20 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8140d06e0 con 0x7ff81415da20 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81946f640 1 -- 172.21.15.32:0/3819580815 >> v1:172.21.15.39:6789/0 conn(0x7ff81415da20 legacy=0x7ff8140d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81946f640 1 -- 172.21.15.32:0/3819580815 >> v1:172.21.15.32:6789/0 conn(0x7ff81406c330 legacy=0x7ff8140cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81946f640 1 -- 172.21.15.32:0/3819580815 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140cfdb0 con 0x7ff81406bc70 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff81946f640 1 --2- 172.21.15.32:0/3819580815 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406bc70 0x7ff81409a400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8040097d0 tx=0x7ff80402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b5dd27aebf84ec server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804031890 con 0x7ff81406bc70 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8040319f0 con 0x7ff81406bc70 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.296+0000 7ff818c6e640 1 -- 172.21.15.32:0/3819580815 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804031d60 con 0x7ff81406bc70 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 -- 172.21.15.32:0/3819580815 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406bc70 msgr2=0x7ff81409a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 --2- 172.21.15.32:0/3819580815 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406bc70 0x7ff81409a400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8040097d0 tx=0x7ff80402b930 comp rx=0 tx=0).stop 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 -- 172.21.15.32:0/3819580815 shutdown_connections 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 --2- 172.21.15.32:0/3819580815 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406bc70 0x7ff81409a400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 -- 172.21.15.32:0/3819580815 >> 172.21.15.32:0/3819580815 conn(0x7ff8140d16f0 msgr2=0x7ff8140d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 -- 172.21.15.32:0/3819580815 shutdown_connections 2024-02-17T00:37:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.297+0000 7ff81bed4640 1 -- 172.21.15.32:0/3819580815 wait complete. 2024-02-17T00:37:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.298+0000 7ff81bed4640 1 Processor -- start 2024-02-17T00:37:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.298+0000 7ff81bed4640 1 -- start start 2024-02-17T00:37:05.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81bed4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff81406bc70 0x7ff81414bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81bed4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406c330 0x7ff8140b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81bed4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 0x7ff8140b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81bed4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b5920 con 0x7ff81415da20 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81bed4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff814158170 con 0x7ff81406bc70 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81bed4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b4d10 con 0x7ff81406c330 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 0x7ff8140b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 0x7ff8140b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43774/0 (socket says 172.21.15.32:43774) 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 -- 172.21.15.32:0/121083849 learned_addr learned my addr 172.21.15.32:0/121083849 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81946f640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406c330 0x7ff8140b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff819c70640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff81406bc70 0x7ff81414bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 -- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406c330 msgr2=0x7ff8140b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406c330 0x7ff8140b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 -- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff81406bc70 msgr2=0x7ff81414bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff81406bc70 0x7ff81414bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 -- 172.21.15.32:0/121083849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804009400 con 0x7ff81415da20 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.299+0000 7ff81a471640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 0x7ff8140b46e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00caf0 tx=0x7ff80c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.300+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c00aca0 con 0x7ff81415da20 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.300+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c00ae00 con 0x7ff81415da20 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.300+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c012620 con 0x7ff81415da20 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.300+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140b4ff0 con 0x7ff81415da20 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.300+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8140b55b0 con 0x7ff81415da20 2024-02-17T00:37:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.301+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8140b5a90 con 0x7ff81415da20 2024-02-17T00:37:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.301+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff80c007070 con 0x7ff81415da20 2024-02-17T00:37:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.301+0000 7ff80a7fc640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff7f806b810 0x7ff7f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.301+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff80c08a3c0 con 0x7ff81415da20 2024-02-17T00:37:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.302+0000 7ff819c70640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff7f806b810 0x7ff7f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.302+0000 7ff819c70640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff7f806b810 0x7ff7f806dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff810007fd0 tx=0x7ff810009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.306+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff80c054be0 con 0x7ff81415da20 2024-02-17T00:37:05.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.481+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8140d0370 con 0x7ff7f806b810 2024-02-17T00:37:05.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.491+0000 7ff80a7fc640 1 -- 172.21.15.32:0/121083849 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345228 (secure 0 0 0) 0x7ff81000f850 con 0x7ff7f806b810 2024-02-17T00:37:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:05.499 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:05.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff7f806b810 msgr2=0x7ff7f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff7f806b810 0x7ff7f806dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff810007fd0 tx=0x7ff810009040 comp rx=0 tx=0).stop 2024-02-17T00:37:05.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 msgr2=0x7ff8140b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 0x7ff8140b46e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00caf0 tx=0x7ff80c00a060 comp rx=0 tx=0).stop 2024-02-17T00:37:05.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 shutdown_connections 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff81415da20 0x7ff8140b46e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff7f806b810 0x7ff7f806dcd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff81406c330 0x7ff8140b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 --2- 172.21.15.32:0/121083849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff81406bc70 0x7ff81414bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 >> 172.21.15.32:0/121083849 conn(0x7ff8140d16f0 msgr2=0x7ff81415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 shutdown_connections 2024-02-17T00:37:05.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.493+0000 7ff81bed4640 1 -- 172.21.15.32:0/121083849 wait complete. 2024-02-17T00:37:05.507 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-02-17T00:37:03.951948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248732,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725988,"statfs":{"total":773094113280,"available":772839411712,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831592+0000","last_change":"2024-02-17T00:36:37.030662+0000","last_active":"2024-02-17T00:36:43.831592+0000","last_peered":"2024-02-17T00:36:43.831592+0000","last_clean":"2024-02-17T00:36:43.831592+0000","last_became_active":"2024-02-17T00:36:37.030370+0000","last_became_peered":"2024-02-17T00:36:37.030370+0000","last_unstale":"2024-02-17T00:36:43.831592+0000","last_undegraded":"2024-02-17T00:36:43.831592+0000","last_fullsized":"2024-02-17T00:36:43.831592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097375+0000","last_change":"2024-02-17T00:36:38.055521+0000","last_active":"2024-02-17T00:36:43.097375+0000","last_peered":"2024-02-17T00:36:43.097375+0000","last_clean":"2024-02-17T00:36:43.097375+0000","last_became_active":"2024-02-17T00:36:38.054923+0000","last_became_peered":"2024-02-17T00:36:38.054923+0000","last_unstale":"2024-02-17T00:36:43.097375+0000","last_undegraded":"2024-02-17T00:36:43.097375+0000","last_fullsized":"2024-02-17T00:36:43.097375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068785+0000","last_change":"2024-02-17T00:36:42.106155+0000","last_active":"2024-02-17T00:36:43.068785+0000","last_peered":"2024-02-17T00:36:43.068785+0000","last_clean":"2024-02-17T00:36:43.068785+0000","last_became_active":"2024-02-17T00:36:42.105538+0000","last_became_peered":"2024-02-17T00:36:42.105538+0000","last_unstale":"2024-02-17T00:36:43.068785+0000","last_undegraded":"2024-02-17T00:36:43.068785+0000","last_fullsized":"2024-02-17T00:36:43.068785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:31:04.425166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097461+0000","last_change":"2024-02-17T00:36:37.028529+0000","last_active":"2024-02-17T00:36:43.097461+0000","last_peered":"2024-02-17T00:36:43.097461+0000","last_clean":"2024-02-17T00:36:43.097461+0000","last_became_active":"2024-02-17T00:36:37.027869+0000","last_became_peered":"2024-02-17T00:36:37.027869+0000","last_unstale":"2024-02-17T00:36:43.097461+0000","last_undegraded":"2024-02-17T00:36:43.097461+0000","last_fullsized":"2024-02-17T00:36:43.097461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097406+0000","last_change":"2024-02-17T00:36:38.049523+0000","last_active":"2024-02-17T00:36:43.097406+0000","last_peered":"2024-02-17T00:36:43.097406+0000","last_clean":"2024-02-17T00:36:43.097406+0000","last_became_active":"2024-02-17T00:36:38.048836+0000","last_became_peered":"2024-02-17T00:36:38.048836+0000","last_unstale":"2024-02-17T00:36:43.097406+0000","last_undegraded":"2024-02-17T00:36:43.097406+0000","last_fullsized":"2024-02-17T00:36:43.097406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068282+0000","last_change":"2024-02-17T00:36:42.106437+0000","last_active":"2024-02-17T00:36:43.068282+0000","last_peered":"2024-02-17T00:36:43.068282+0000","last_clean":"2024-02-17T00:36:43.068282+0000","last_became_active":"2024-02-17T00:36:42.105260+0000","last_became_peered":"2024-02-17T00:36:42.105260+0000","last_unstale":"2024-02-17T00:36:43.068282+0000","last_undegraded":"2024-02-17T00:36:43.068282+0000","last_fullsized":"2024-02-17T00:36:43.068282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:43.059445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831042+0000","last_change":"2024-02-17T00:36:37.031714+0000","last_active":"2024-02-17T00:36:43.831042+0000","last_peered":"2024-02-17T00:36:43.831042+0000","last_clean":"2024-02-17T00:36:43.831042+0000","last_became_active":"2024-02-17T00:36:37.031420+0000","last_became_peered":"2024-02-17T00:36:37.031420+0000","last_unstale":"2024-02-17T00:36:43.831042+0000","last_undegraded":"2024-02-17T00:36:43.831042+0000","last_fullsized":"2024-02-17T00:36:43.831042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069643+0000","last_change":"2024-02-17T00:36:38.056370+0000","last_active":"2024-02-17T00:36:43.069643+0000","last_peered":"2024-02-17T00:36:43.069643+0000","last_clean":"2024-02-17T00:36:43.069643+0000","last_became_active":"2024-02-17T00:36:38.056088+0000","last_became_peered":"2024-02-17T00:36:38.056088+0000","last_unstale":"2024-02-17T00:36:43.069643+0000","last_undegraded":"2024-02-17T00:36:43.069643+0000","last_fullsized":"2024-02-17T00:36:43.069643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068302+0000","last_change":"2024-02-17T00:36:42.102716+0000","last_active":"2024-02-17T00:36:43.068302+0000","last_peered":"2024-02-17T00:36:43.068302+0000","last_clean":"2024-02-17T00:36:43.068302+0000","last_became_active":"2024-02-17T00:36:42.102320+0000","last_became_peered":"2024-02-17T00:36:42.102320+0000","last_unstale":"2024-02-17T00:36:43.068302+0000","last_undegraded":"2024-02-17T00:36:43.068302+0000","last_fullsized":"2024-02-17T00:36:43.068302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832076+0000","last_change":"2024-02-17T00:36:37.030968+0000","last_active":"2024-02-17T00:36:43.832076+0000","last_peered":"2024-02-17T00:36:43.832076+0000","last_clean":"2024-02-17T00:36:43.832076+0000","last_became_active":"2024-02-17T00:36:37.030633+0000","last_became_peered":"2024-02-17T00:36:37.030633+0000","last_unstale":"2024-02-17T00:36:43.832076+0000","last_undegraded":"2024-02-17T00:36:43.832076+0000","last_fullsized":"2024-02-17T00:36:43.832076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832222+0000","last_change":"2024-02-17T00:36:38.059509+0000","last_active":"2024-02-17T00:36:43.832222+0000","last_peered":"2024-02-17T00:36:43.832222+0000","last_clean":"2024-02-17T00:36:43.832222+0000","last_became_active":"2024-02-17T00:36:38.059254+0000","last_became_peered":"2024-02-17T00:36:38.059254+0000","last_unstale":"2024-02-17T00:36:43.832222+0000","last_undegraded":"2024-02-17T00:36:43.832222+0000","last_fullsized":"2024-02-17T00:36:43.832222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:03.666531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068026+0000","last_change":"2024-02-17T00:36:42.104635+0000","last_active":"2024-02-17T00:36:43.068026+0000","last_peered":"2024-02-17T00:36:43.068026+0000","last_clean":"2024-02-17T00:36:43.068026+0000","last_became_active":"2024-02-17T00:36:42.104078+0000","last_became_peered":"2024-02-17T00:36:42.104078+0000","last_unstale":"2024-02-17T00:36:43.068026+0000","last_undegraded":"2024-02-17T00:36:43.068026+0000","last_fullsized":"2024-02-17T00:36:43.068026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831402+0000","last_change":"2024-02-17T00:36:38.044922+0000","last_active":"2024-02-17T00:36:43.831402+0000","last_peered":"2024-02-17T00:36:43.831402+0000","last_clean":"2024-02-17T00:36:43.831402+0000","last_became_active":"2024-02-17T00:36:38.044635+0000","last_became_peered":"2024-02-17T00:36:38.044635+0000","last_unstale":"2024-02-17T00:36:43.831402+0000","last_undegraded":"2024-02-17T00:36:43.831402+0000","last_fullsized":"2024-02-17T00:36:43.831402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:07:57.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831908+0000","last_change":"2024-02-17T00:36:37.027914+0000","last_active":"2024-02-17T00:36:43.831908+0000","last_peered":"2024-02-17T00:36:43.831908+0000","last_clean":"2024-02-17T00:36:43.831908+0000","last_became_active":"2024-02-17T00:36:37.027428+0000","last_became_peered":"2024-02-17T00:36:37.027428+0000","last_unstale":"2024-02-17T00:36:43.831908+0000","last_undegraded":"2024-02-17T00:36:43.831908+0000","last_fullsized":"2024-02-17T00:36:43.831908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:41.254351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832120+0000","last_change":"2024-02-17T00:36:42.112759+0000","last_active":"2024-02-17T00:36:43.832120+0000","last_peered":"2024-02-17T00:36:43.832120+0000","last_clean":"2024-02-17T00:36:43.832120+0000","last_became_active":"2024-02-17T00:36:42.112040+0000","last_became_peered":"2024-02-17T00:36:42.112040+0000","last_unstale":"2024-02-17T00:36:43.832120+0000","last_undegraded":"2024-02-17T00:36:43.832120+0000","last_fullsized":"2024-02-17T00:36:43.832120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:15.987819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069089+0000","last_change":"2024-02-17T00:36:38.057079+0000","last_active":"2024-02-17T00:36:43.069089+0000","last_peered":"2024-02-17T00:36:43.069089+0000","last_clean":"2024-02-17T00:36:43.069089+0000","last_became_active":"2024-02-17T00:36:38.056788+0000","last_became_peered":"2024-02-17T00:36:38.056788+0000","last_unstale":"2024-02-17T00:36:43.069089+0000","last_undegraded":"2024-02-17T00:36:43.069089+0000","last_fullsized":"2024-02-17T00:36:43.069089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:56:11.007052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832223+0000","last_change":"2024-02-17T00:36:37.032242+0000","last_active":"2024-02-17T00:36:43.832223+0000","last_peered":"2024-02-17T00:36:43.832223+0000","last_clean":"2024-02-17T00:36:43.832223+0000","last_became_active":"2024-02-17T00:36:37.031951+0000","last_became_peered":"2024-02-17T00:36:37.031951+0000","last_unstale":"2024-02-17T00:36:43.832223+0000","last_undegraded":"2024-02-17T00:36:43.832223+0000","last_fullsized":"2024-02-17T00:36:43.832223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831617+0000","last_change":"2024-02-17T00:36:42.105780+0000","last_active":"2024-02-17T00:36:43.831617+0000","last_peered":"2024-02-17T00:36:43.831617+0000","last_clean":"2024-02-17T00:36:43.831617+0000","last_became_active":"2024-02-17T00:36:42.105405+0000","last_became_peered":"2024-02-17T00:36:42.105405+0000","last_unstale":"2024-02-17T00:36:43.831617+0000","last_undegraded":"2024-02-17T00:36:43.831617+0000","last_fullsized":"2024-02-17T00:36:43.831617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:40.401581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831013+0000","last_change":"2024-02-17T00:36:38.053301+0000","last_active":"2024-02-17T00:36:43.831013+0000","last_peered":"2024-02-17T00:36:43.831013+0000","last_clean":"2024-02-17T00:36:43.831013+0000","last_became_active":"2024-02-17T00:36:38.052981+0000","last_became_peered":"2024-02-17T00:36:38.052981+0000","last_unstale":"2024-02-17T00:36:43.831013+0000","last_undegraded":"2024-02-17T00:36:43.831013+0000","last_fullsized":"2024-02-17T00:36:43.831013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831734+0000","last_change":"2024-02-17T00:36:37.032841+0000","last_active":"2024-02-17T00:36:43.831734+0000","last_peered":"2024-02-17T00:36:43.831734+0000","last_clean":"2024-02-17T00:36:43.831734+0000","last_became_active":"2024-02-17T00:36:37.032569+0000","last_became_peered":"2024-02-17T00:36:37.032569+0000","last_unstale":"2024-02-17T00:36:43.831734+0000","last_undegraded":"2024-02-17T00:36:43.831734+0000","last_fullsized":"2024-02-17T00:36:43.831734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069627+0000","last_change":"2024-02-17T00:36:42.110199+0000","last_active":"2024-02-17T00:36:43.069627+0000","last_peered":"2024-02-17T00:36:43.069627+0000","last_clean":"2024-02-17T00:36:43.069627+0000","last_became_active":"2024-02-17T00:36:42.109821+0000","last_became_peered":"2024-02-17T00:36:42.109821+0000","last_unstale":"2024-02-17T00:36:43.069627+0000","last_undegraded":"2024-02-17T00:36:43.069627+0000","last_fullsized":"2024-02-17T00:36:43.069627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:09:09.535328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830918+0000","last_change":"2024-02-17T00:36:38.054753+0000","last_active":"2024-02-17T00:36:43.830918+0000","last_peered":"2024-02-17T00:36:43.830918+0000","last_clean":"2024-02-17T00:36:43.830918+0000","last_became_active":"2024-02-17T00:36:38.054461+0000","last_became_peered":"2024-02-17T00:36:38.054461+0000","last_unstale":"2024-02-17T00:36:43.830918+0000","last_undegraded":"2024-02-17T00:36:43.830918+0000","last_fullsized":"2024-02-17T00:36:43.830918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:40.337939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830476+0000","last_change":"2024-02-17T00:36:37.036152+0000","last_active":"2024-02-17T00:36:43.830476+0000","last_peered":"2024-02-17T00:36:43.830476+0000","last_clean":"2024-02-17T00:36:43.830476+0000","last_became_active":"2024-02-17T00:36:37.035247+0000","last_became_peered":"2024-02-17T00:36:37.035247+0000","last_unstale":"2024-02-17T00:36:43.830476+0000","last_undegraded":"2024-02-17T00:36:43.830476+0000","last_fullsized":"2024-02-17T00:36:43.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068880+0000","last_change":"2024-02-17T00:36:42.107390+0000","last_active":"2024-02-17T00:36:43.068880+0000","last_peered":"2024-02-17T00:36:43.068880+0000","last_clean":"2024-02-17T00:36:43.068880+0000","last_became_active":"2024-02-17T00:36:42.106991+0000","last_became_peered":"2024-02-17T00:36:42.106991+0000","last_unstale":"2024-02-17T00:36:43.068880+0000","last_undegraded":"2024-02-17T00:36:43.068880+0000","last_fullsized":"2024-02-17T00:36:43.068880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831870+0000","last_change":"2024-02-17T00:36:38.056121+0000","last_active":"2024-02-17T00:36:43.831870+0000","last_peered":"2024-02-17T00:36:43.831870+0000","last_clean":"2024-02-17T00:36:43.831870+0000","last_became_active":"2024-02-17T00:36:38.055860+0000","last_became_peered":"2024-02-17T00:36:38.055860+0000","last_unstale":"2024-02-17T00:36:43.831870+0000","last_undegraded":"2024-02-17T00:36:43.831870+0000","last_fullsized":"2024-02-17T00:36:43.831870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832500+0000","last_change":"2024-02-17T00:36:37.038395+0000","last_active":"2024-02-17T00:36:43.832500+0000","last_peered":"2024-02-17T00:36:43.832500+0000","last_clean":"2024-02-17T00:36:43.832500+0000","last_became_active":"2024-02-17T00:36:37.038139+0000","last_became_peered":"2024-02-17T00:36:37.038139+0000","last_unstale":"2024-02-17T00:36:43.832500+0000","last_undegraded":"2024-02-17T00:36:43.832500+0000","last_fullsized":"2024-02-17T00:36:43.832500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068014+0000","last_change":"2024-02-17T00:36:42.106502+0000","last_active":"2024-02-17T00:36:43.068014+0000","last_peered":"2024-02-17T00:36:43.068014+0000","last_clean":"2024-02-17T00:36:43.068014+0000","last_became_active":"2024-02-17T00:36:42.104704+0000","last_became_peered":"2024-02-17T00:36:42.104704+0000","last_unstale":"2024-02-17T00:36:43.068014+0000","last_undegraded":"2024-02-17T00:36:43.068014+0000","last_fullsized":"2024-02-17T00:36:43.068014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831529+0000","last_change":"2024-02-17T00:36:38.047108+0000","last_active":"2024-02-17T00:36:43.831529+0000","last_peered":"2024-02-17T00:36:43.831529+0000","last_clean":"2024-02-17T00:36:43.831529+0000","last_became_active":"2024-02-17T00:36:38.046838+0000","last_became_peered":"2024-02-17T00:36:38.046838+0000","last_unstale":"2024-02-17T00:36:43.831529+0000","last_undegraded":"2024-02-17T00:36:43.831529+0000","last_fullsized":"2024-02-17T00:36:43.831529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832108+0000","last_change":"2024-02-17T00:36:37.029498+0000","last_active":"2024-02-17T00:36:43.832108+0000","last_peered":"2024-02-17T00:36:43.832108+0000","last_clean":"2024-02-17T00:36:43.832108+0000","last_became_active":"2024-02-17T00:36:37.029197+0000","last_became_peered":"2024-02-17T00:36:37.029197+0000","last_unstale":"2024-02-17T00:36:43.832108+0000","last_undegraded":"2024-02-17T00:36:43.832108+0000","last_fullsized":"2024-02-17T00:36:43.832108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831904+0000","last_change":"2024-02-17T00:36:42.107429+0000","last_active":"2024-02-17T00:36:43.831904+0000","last_peered":"2024-02-17T00:36:43.831904+0000","last_clean":"2024-02-17T00:36:43.831904+0000","last_became_active":"2024-02-17T00:36:42.105692+0000","last_became_peered":"2024-02-17T00:36:42.105692+0000","last_unstale":"2024-02-17T00:36:43.831904+0000","last_undegraded":"2024-02-17T00:36:43.831904+0000","last_fullsized":"2024-02-17T00:36:43.831904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:14.318951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832572+0000","last_change":"2024-02-17T00:36:38.049191+0000","last_active":"2024-02-17T00:36:43.832572+0000","last_peered":"2024-02-17T00:36:43.832572+0000","last_clean":"2024-02-17T00:36:43.832572+0000","last_became_active":"2024-02-17T00:36:38.048889+0000","last_became_peered":"2024-02-17T00:36:38.048889+0000","last_unstale":"2024-02-17T00:36:43.832572+0000","last_undegraded":"2024-02-17T00:36:43.832572+0000","last_fullsized":"2024-02-17T00:36:43.832572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832472+0000","last_change":"2024-02-17T00:36:37.034662+0000","last_active":"2024-02-17T00:36:43.832472+0000","last_peered":"2024-02-17T00:36:43.832472+0000","last_clean":"2024-02-17T00:36:43.832472+0000","last_became_active":"2024-02-17T00:36:37.034377+0000","last_became_peered":"2024-02-17T00:36:37.034377+0000","last_unstale":"2024-02-17T00:36:43.832472+0000","last_undegraded":"2024-02-17T00:36:43.832472+0000","last_fullsized":"2024-02-17T00:36:43.832472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:46.302658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832390+0000","last_change":"2024-02-17T00:36:42.102832+0000","last_active":"2024-02-17T00:36:43.832390+0000","last_peered":"2024-02-17T00:36:43.832390+0000","last_clean":"2024-02-17T00:36:43.832390+0000","last_became_active":"2024-02-17T00:36:42.102261+0000","last_became_peered":"2024-02-17T00:36:42.102261+0000","last_unstale":"2024-02-17T00:36:43.832390+0000","last_undegraded":"2024-02-17T00:36:43.832390+0000","last_fullsized":"2024-02-17T00:36:43.832390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068321+0000","last_change":"2024-02-17T00:36:38.040343+0000","last_active":"2024-02-17T00:36:43.068321+0000","last_peered":"2024-02-17T00:36:43.068321+0000","last_clean":"2024-02-17T00:36:43.068321+0000","last_became_active":"2024-02-17T00:36:38.039985+0000","last_became_peered":"2024-02-17T00:36:38.039985+0000","last_unstale":"2024-02-17T00:36:43.068321+0000","last_undegraded":"2024-02-17T00:36:43.068321+0000","last_fullsized":"2024-02-17T00:36:43.068321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096964+0000","last_change":"2024-02-17T00:36:37.031000+0000","last_active":"2024-02-17T00:36:43.096964+0000","last_peered":"2024-02-17T00:36:43.096964+0000","last_clean":"2024-02-17T00:36:43.096964+0000","last_became_active":"2024-02-17T00:36:37.028403+0000","last_became_peered":"2024-02-17T00:36:37.028403+0000","last_unstale":"2024-02-17T00:36:43.096964+0000","last_undegraded":"2024-02-17T00:36:43.096964+0000","last_fullsized":"2024-02-17T00:36:43.096964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831801+0000","last_change":"2024-02-17T00:36:42.106983+0000","last_active":"2024-02-17T00:36:43.831801+0000","last_peered":"2024-02-17T00:36:43.831801+0000","last_clean":"2024-02-17T00:36:43.831801+0000","last_became_active":"2024-02-17T00:36:42.106220+0000","last_became_peered":"2024-02-17T00:36:42.106220+0000","last_unstale":"2024-02-17T00:36:43.831801+0000","last_undegraded":"2024-02-17T00:36:43.831801+0000","last_fullsized":"2024-02-17T00:36:43.831801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831273+0000","last_change":"2024-02-17T00:36:38.064921+0000","last_active":"2024-02-17T00:36:43.831273+0000","last_peered":"2024-02-17T00:36:43.831273+0000","last_clean":"2024-02-17T00:36:43.831273+0000","last_became_active":"2024-02-17T00:36:38.064609+0000","last_became_peered":"2024-02-17T00:36:38.064609+0000","last_unstale":"2024-02-17T00:36:43.831273+0000","last_undegraded":"2024-02-17T00:36:43.831273+0000","last_fullsized":"2024-02-17T00:36:43.831273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831743+0000","last_change":"2024-02-17T00:36:37.027393+0000","last_active":"2024-02-17T00:36:43.831743+0000","last_peered":"2024-02-17T00:36:43.831743+0000","last_clean":"2024-02-17T00:36:43.831743+0000","last_became_active":"2024-02-17T00:36:37.027115+0000","last_became_peered":"2024-02-17T00:36:37.027115+0000","last_unstale":"2024-02-17T00:36:43.831743+0000","last_undegraded":"2024-02-17T00:36:43.831743+0000","last_fullsized":"2024-02-17T00:36:43.831743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:53.731912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832512+0000","last_change":"2024-02-17T00:36:42.104622+0000","last_active":"2024-02-17T00:36:43.832512+0000","last_peered":"2024-02-17T00:36:43.832512+0000","last_clean":"2024-02-17T00:36:43.832512+0000","last_became_active":"2024-02-17T00:36:42.104221+0000","last_became_peered":"2024-02-17T00:36:42.104221+0000","last_unstale":"2024-02-17T00:36:43.832512+0000","last_undegraded":"2024-02-17T00:36:43.832512+0000","last_fullsized":"2024-02-17T00:36:43.832512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096468+0000","last_change":"2024-02-17T00:36:38.059189+0000","last_active":"2024-02-17T00:36:43.096468+0000","last_peered":"2024-02-17T00:36:43.096468+0000","last_clean":"2024-02-17T00:36:43.096468+0000","last_became_active":"2024-02-17T00:36:38.058901+0000","last_became_peered":"2024-02-17T00:36:38.058901+0000","last_unstale":"2024-02-17T00:36:43.096468+0000","last_undegraded":"2024-02-17T00:36:43.096468+0000","last_fullsized":"2024-02-17T00:36:43.096468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068931+0000","last_change":"2024-02-17T00:36:37.030700+0000","last_active":"2024-02-17T00:36:43.068931+0000","last_peered":"2024-02-17T00:36:43.068931+0000","last_clean":"2024-02-17T00:36:43.068931+0000","last_became_active":"2024-02-17T00:36:37.030397+0000","last_became_peered":"2024-02-17T00:36:37.030397+0000","last_unstale":"2024-02-17T00:36:43.068931+0000","last_undegraded":"2024-02-17T00:36:43.068931+0000","last_fullsized":"2024-02-17T00:36:43.068931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:05.382965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832374+0000","last_change":"2024-02-17T00:36:42.107289+0000","last_active":"2024-02-17T00:36:43.832374+0000","last_peered":"2024-02-17T00:36:43.832374+0000","last_clean":"2024-02-17T00:36:43.832374+0000","last_became_active":"2024-02-17T00:36:42.106838+0000","last_became_peered":"2024-02-17T00:36:42.106838+0000","last_unstale":"2024-02-17T00:36:43.832374+0000","last_undegraded":"2024-02-17T00:36:43.832374+0000","last_fullsized":"2024-02-17T00:36:43.832374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831254+0000","last_change":"2024-02-17T00:36:38.040509+0000","last_active":"2024-02-17T00:36:43.831254+0000","last_peered":"2024-02-17T00:36:43.831254+0000","last_clean":"2024-02-17T00:36:43.831254+0000","last_became_active":"2024-02-17T00:36:38.040220+0000","last_became_peered":"2024-02-17T00:36:38.040220+0000","last_unstale":"2024-02-17T00:36:43.831254+0000","last_undegraded":"2024-02-17T00:36:43.831254+0000","last_fullsized":"2024-02-17T00:36:43.831254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831090+0000","last_change":"2024-02-17T00:36:37.029628+0000","last_active":"2024-02-17T00:36:43.831090+0000","last_peered":"2024-02-17T00:36:43.831090+0000","last_clean":"2024-02-17T00:36:43.831090+0000","last_became_active":"2024-02-17T00:36:37.029322+0000","last_became_peered":"2024-02-17T00:36:37.029322+0000","last_unstale":"2024-02-17T00:36:43.831090+0000","last_undegraded":"2024-02-17T00:36:43.831090+0000","last_fullsized":"2024-02-17T00:36:43.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:29.219599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097224+0000","last_change":"2024-02-17T00:36:42.110170+0000","last_active":"2024-02-17T00:36:43.097224+0000","last_peered":"2024-02-17T00:36:43.097224+0000","last_clean":"2024-02-17T00:36:43.097224+0000","last_became_active":"2024-02-17T00:36:42.109713+0000","last_became_peered":"2024-02-17T00:36:42.109713+0000","last_unstale":"2024-02-17T00:36:43.097224+0000","last_undegraded":"2024-02-17T00:36:43.097224+0000","last_fullsized":"2024-02-17T00:36:43.097224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:07.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831262+0000","last_change":"2024-02-17T00:36:38.041003+0000","last_active":"2024-02-17T00:36:43.831262+0000","last_peered":"2024-02-17T00:36:43.831262+0000","last_clean":"2024-02-17T00:36:43.831262+0000","last_became_active":"2024-02-17T00:36:38.040700+0000","last_became_peered":"2024-02-17T00:36:38.040700+0000","last_unstale":"2024-02-17T00:36:43.831262+0000","last_undegraded":"2024-02-17T00:36:43.831262+0000","last_fullsized":"2024-02-17T00:36:43.831262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:15:02.009972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831922+0000","last_change":"2024-02-17T00:36:37.027694+0000","last_active":"2024-02-17T00:36:43.831922+0000","last_peered":"2024-02-17T00:36:43.831922+0000","last_clean":"2024-02-17T00:36:43.831922+0000","last_became_active":"2024-02-17T00:36:37.027061+0000","last_became_peered":"2024-02-17T00:36:37.027061+0000","last_unstale":"2024-02-17T00:36:43.831922+0000","last_undegraded":"2024-02-17T00:36:43.831922+0000","last_fullsized":"2024-02-17T00:36:43.831922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069046+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:36:43.069046+0000","last_peered":"2024-02-17T00:36:43.069046+0000","last_clean":"2024-02-17T00:36:43.069046+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:36:43.069046+0000","last_undegraded":"2024-02-17T00:36:43.069046+0000","last_fullsized":"2024-02-17T00:36:43.069046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832461+0000","last_change":"2024-02-17T00:36:42.105550+0000","last_active":"2024-02-17T00:36:43.832461+0000","last_peered":"2024-02-17T00:36:43.832461+0000","last_clean":"2024-02-17T00:36:43.832461+0000","last_became_active":"2024-02-17T00:36:42.105076+0000","last_became_peered":"2024-02-17T00:36:42.105076+0000","last_unstale":"2024-02-17T00:36:43.832461+0000","last_undegraded":"2024-02-17T00:36:43.832461+0000","last_fullsized":"2024-02-17T00:36:43.832461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:06:27.497749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832306+0000","last_change":"2024-02-17T00:36:38.045045+0000","last_active":"2024-02-17T00:36:43.832306+0000","last_peered":"2024-02-17T00:36:43.832306+0000","last_clean":"2024-02-17T00:36:43.832306+0000","last_became_active":"2024-02-17T00:36:38.044771+0000","last_became_peered":"2024-02-17T00:36:38.044771+0000","last_unstale":"2024-02-17T00:36:43.832306+0000","last_undegraded":"2024-02-17T00:36:43.832306+0000","last_fullsized":"2024-02-17T00:36:43.832306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:37.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832582+0000","last_change":"2024-02-17T00:36:37.032742+0000","last_active":"2024-02-17T00:36:43.832582+0000","last_peered":"2024-02-17T00:36:43.832582+0000","last_clean":"2024-02-17T00:36:43.832582+0000","last_became_active":"2024-02-17T00:36:37.032468+0000","last_became_peered":"2024-02-17T00:36:37.032468+0000","last_unstale":"2024-02-17T00:36:43.832582+0000","last_undegraded":"2024-02-17T00:36:43.832582+0000","last_fullsized":"2024-02-17T00:36:43.832582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068115+0000","last_change":"2024-02-17T00:36:42.103839+0000","last_active":"2024-02-17T00:36:43.068115+0000","last_peered":"2024-02-17T00:36:43.068115+0000","last_clean":"2024-02-17T00:36:43.068115+0000","last_became_active":"2024-02-17T00:36:42.103440+0000","last_became_peered":"2024-02-17T00:36:42.103440+0000","last_unstale":"2024-02-17T00:36:43.068115+0000","last_undegraded":"2024-02-17T00:36:43.068115+0000","last_fullsized":"2024-02-17T00:36:43.068115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831939+0000","last_change":"2024-02-17T00:36:38.062320+0000","last_active":"2024-02-17T00:36:43.831939+0000","last_peered":"2024-02-17T00:36:43.831939+0000","last_clean":"2024-02-17T00:36:43.831939+0000","last_became_active":"2024-02-17T00:36:38.062072+0000","last_became_peered":"2024-02-17T00:36:38.062072+0000","last_unstale":"2024-02-17T00:36:43.831939+0000","last_undegraded":"2024-02-17T00:36:43.831939+0000","last_fullsized":"2024-02-17T00:36:43.831939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097214+0000","last_change":"2024-02-17T00:36:37.027607+0000","last_active":"2024-02-17T00:36:43.097214+0000","last_peered":"2024-02-17T00:36:43.097214+0000","last_clean":"2024-02-17T00:36:43.097214+0000","last_became_active":"2024-02-17T00:36:37.025882+0000","last_became_peered":"2024-02-17T00:36:37.025882+0000","last_unstale":"2024-02-17T00:36:43.097214+0000","last_undegraded":"2024-02-17T00:36:43.097214+0000","last_fullsized":"2024-02-17T00:36:43.097214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096933+0000","last_change":"2024-02-17T00:36:42.108808+0000","last_active":"2024-02-17T00:36:43.096933+0000","last_peered":"2024-02-17T00:36:43.096933+0000","last_clean":"2024-02-17T00:36:43.096933+0000","last_became_active":"2024-02-17T00:36:42.108343+0000","last_became_peered":"2024-02-17T00:36:42.108343+0000","last_unstale":"2024-02-17T00:36:43.096933+0000","last_undegraded":"2024-02-17T00:36:43.096933+0000","last_fullsized":"2024-02-17T00:36:43.096933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:08:01.687705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831483+0000","last_change":"2024-02-17T00:36:38.059195+0000","last_active":"2024-02-17T00:36:43.831483+0000","last_peered":"2024-02-17T00:36:43.831483+0000","last_clean":"2024-02-17T00:36:43.831483+0000","last_became_active":"2024-02-17T00:36:38.058923+0000","last_became_peered":"2024-02-17T00:36:38.058923+0000","last_unstale":"2024-02-17T00:36:43.831483+0000","last_undegraded":"2024-02-17T00:36:43.831483+0000","last_fullsized":"2024-02-17T00:36:43.831483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831998+0000","last_change":"2024-02-17T00:36:37.030669+0000","last_active":"2024-02-17T00:36:43.831998+0000","last_peered":"2024-02-17T00:36:43.831998+0000","last_clean":"2024-02-17T00:36:43.831998+0000","last_became_active":"2024-02-17T00:36:37.029671+0000","last_became_peered":"2024-02-17T00:36:37.029671+0000","last_unstale":"2024-02-17T00:36:43.831998+0000","last_undegraded":"2024-02-17T00:36:43.831998+0000","last_fullsized":"2024-02-17T00:36:43.831998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830669+0000","last_change":"2024-02-17T00:36:42.106377+0000","last_active":"2024-02-17T00:36:43.830669+0000","last_peered":"2024-02-17T00:36:43.830669+0000","last_clean":"2024-02-17T00:36:43.830669+0000","last_became_active":"2024-02-17T00:36:42.105980+0000","last_became_peered":"2024-02-17T00:36:42.105980+0000","last_unstale":"2024-02-17T00:36:43.830669+0000","last_undegraded":"2024-02-17T00:36:43.830669+0000","last_fullsized":"2024-02-17T00:36:43.830669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:14:16.476031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069144+0000","last_change":"2024-02-17T00:36:38.056738+0000","last_active":"2024-02-17T00:36:43.069144+0000","last_peered":"2024-02-17T00:36:43.069144+0000","last_clean":"2024-02-17T00:36:43.069144+0000","last_became_active":"2024-02-17T00:36:38.056342+0000","last_became_peered":"2024-02-17T00:36:38.056342+0000","last_unstale":"2024-02-17T00:36:43.069144+0000","last_undegraded":"2024-02-17T00:36:43.069144+0000","last_fullsized":"2024-02-17T00:36:43.069144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831546+0000","last_change":"2024-02-17T00:36:37.037085+0000","last_active":"2024-02-17T00:36:43.831546+0000","last_peered":"2024-02-17T00:36:43.831546+0000","last_clean":"2024-02-17T00:36:43.831546+0000","last_became_active":"2024-02-17T00:36:37.036719+0000","last_became_peered":"2024-02-17T00:36:37.036719+0000","last_unstale":"2024-02-17T00:36:43.831546+0000","last_undegraded":"2024-02-17T00:36:43.831546+0000","last_fullsized":"2024-02-17T00:36:43.831546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069663+0000","last_change":"2024-02-17T00:36:42.109922+0000","last_active":"2024-02-17T00:36:43.069663+0000","last_peered":"2024-02-17T00:36:43.069663+0000","last_clean":"2024-02-17T00:36:43.069663+0000","last_became_active":"2024-02-17T00:36:42.109554+0000","last_became_peered":"2024-02-17T00:36:42.109554+0000","last_unstale":"2024-02-17T00:36:43.069663+0000","last_undegraded":"2024-02-17T00:36:43.069663+0000","last_fullsized":"2024-02-17T00:36:43.069663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:14.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:38.039174+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:38.038826+0000","last_became_peered":"2024-02-17T00:36:38.038826+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831131+0000","last_change":"2024-02-17T00:36:37.026636+0000","last_active":"2024-02-17T00:36:43.831131+0000","last_peered":"2024-02-17T00:36:43.831131+0000","last_clean":"2024-02-17T00:36:43.831131+0000","last_became_active":"2024-02-17T00:36:37.026356+0000","last_became_peered":"2024-02-17T00:36:37.026356+0000","last_unstale":"2024-02-17T00:36:43.831131+0000","last_undegraded":"2024-02-17T00:36:43.831131+0000","last_fullsized":"2024-02-17T00:36:43.831131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097409+0000","last_change":"2024-02-17T00:36:42.109160+0000","last_active":"2024-02-17T00:36:43.097409+0000","last_peered":"2024-02-17T00:36:43.097409+0000","last_clean":"2024-02-17T00:36:43.097409+0000","last_became_active":"2024-02-17T00:36:42.108726+0000","last_became_peered":"2024-02-17T00:36:42.108726+0000","last_unstale":"2024-02-17T00:36:43.097409+0000","last_undegraded":"2024-02-17T00:36:43.097409+0000","last_fullsized":"2024-02-17T00:36:43.097409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:41.664699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068896+0000","last_change":"2024-02-17T00:36:38.050032+0000","last_active":"2024-02-17T00:36:43.068896+0000","last_peered":"2024-02-17T00:36:43.068896+0000","last_clean":"2024-02-17T00:36:43.068896+0000","last_became_active":"2024-02-17T00:36:38.049764+0000","last_became_peered":"2024-02-17T00:36:38.049764+0000","last_unstale":"2024-02-17T00:36:43.068896+0000","last_undegraded":"2024-02-17T00:36:43.068896+0000","last_fullsized":"2024-02-17T00:36:43.068896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:04.316331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830633+0000","last_change":"2024-02-17T00:36:37.039587+0000","last_active":"2024-02-17T00:36:43.830633+0000","last_peered":"2024-02-17T00:36:43.830633+0000","last_clean":"2024-02-17T00:36:43.830633+0000","last_became_active":"2024-02-17T00:36:37.039306+0000","last_became_peered":"2024-02-17T00:36:37.039306+0000","last_unstale":"2024-02-17T00:36:43.830633+0000","last_undegraded":"2024-02-17T00:36:43.830633+0000","last_fullsized":"2024-02-17T00:36:43.830633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097441+0000","last_change":"2024-02-17T00:36:42.110028+0000","last_active":"2024-02-17T00:36:43.097441+0000","last_peered":"2024-02-17T00:36:43.097441+0000","last_clean":"2024-02-17T00:36:43.097441+0000","last_became_active":"2024-02-17T00:36:42.109169+0000","last_became_peered":"2024-02-17T00:36:42.109169+0000","last_unstale":"2024-02-17T00:36:43.097441+0000","last_undegraded":"2024-02-17T00:36:43.097441+0000","last_fullsized":"2024-02-17T00:36:43.097441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:50.471622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831820+0000","last_change":"2024-02-17T00:36:38.058168+0000","last_active":"2024-02-17T00:36:43.831820+0000","last_peered":"2024-02-17T00:36:43.831820+0000","last_clean":"2024-02-17T00:36:43.831820+0000","last_became_active":"2024-02-17T00:36:38.057867+0000","last_became_peered":"2024-02-17T00:36:38.057867+0000","last_unstale":"2024-02-17T00:36:43.831820+0000","last_undegraded":"2024-02-17T00:36:43.831820+0000","last_fullsized":"2024-02-17T00:36:43.831820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:03:31.843189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831661+0000","last_change":"2024-02-17T00:36:37.033408+0000","last_active":"2024-02-17T00:36:43.831661+0000","last_peered":"2024-02-17T00:36:43.831661+0000","last_clean":"2024-02-17T00:36:43.831661+0000","last_became_active":"2024-02-17T00:36:37.031691+0000","last_became_peered":"2024-02-17T00:36:37.031691+0000","last_unstale":"2024-02-17T00:36:43.831661+0000","last_undegraded":"2024-02-17T00:36:43.831661+0000","last_fullsized":"2024-02-17T00:36:43.831661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:09.449647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832315+0000","last_change":"2024-02-17T00:36:42.105315+0000","last_active":"2024-02-17T00:36:43.832315+0000","last_peered":"2024-02-17T00:36:43.832315+0000","last_clean":"2024-02-17T00:36:43.832315+0000","last_became_active":"2024-02-17T00:36:42.104846+0000","last_became_peered":"2024-02-17T00:36:42.104846+0000","last_unstale":"2024-02-17T00:36:43.832315+0000","last_undegraded":"2024-02-17T00:36:43.832315+0000","last_fullsized":"2024-02-17T00:36:43.832315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831976+0000","last_change":"2024-02-17T00:36:38.038475+0000","last_active":"2024-02-17T00:36:43.831976+0000","last_peered":"2024-02-17T00:36:43.831976+0000","last_clean":"2024-02-17T00:36:43.831976+0000","last_became_active":"2024-02-17T00:36:38.038146+0000","last_became_peered":"2024-02-17T00:36:38.038146+0000","last_unstale":"2024-02-17T00:36:43.831976+0000","last_undegraded":"2024-02-17T00:36:43.831976+0000","last_fullsized":"2024-02-17T00:36:43.831976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069341+0000","last_change":"2024-02-17T00:36:37.035415+0000","last_active":"2024-02-17T00:36:43.069341+0000","last_peered":"2024-02-17T00:36:43.069341+0000","last_clean":"2024-02-17T00:36:43.069341+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.069341+0000","last_undegraded":"2024-02-17T00:36:43.069341+0000","last_fullsized":"2024-02-17T00:36:43.069341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:57:22.735661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832312+0000","last_change":"2024-02-17T00:36:42.102660+0000","last_active":"2024-02-17T00:36:43.832312+0000","last_peered":"2024-02-17T00:36:43.832312+0000","last_clean":"2024-02-17T00:36:43.832312+0000","last_became_active":"2024-02-17T00:36:42.102164+0000","last_became_peered":"2024-02-17T00:36:42.102164+0000","last_unstale":"2024-02-17T00:36:43.832312+0000","last_undegraded":"2024-02-17T00:36:43.832312+0000","last_fullsized":"2024-02-17T00:36:43.832312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:22:56.783330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830955+0000","last_change":"2024-02-17T00:36:38.051782+0000","last_active":"2024-02-17T00:36:43.830955+0000","last_peered":"2024-02-17T00:36:43.830955+0000","last_clean":"2024-02-17T00:36:43.830955+0000","last_became_active":"2024-02-17T00:36:38.051484+0000","last_became_peered":"2024-02-17T00:36:38.051484+0000","last_unstale":"2024-02-17T00:36:43.830955+0000","last_undegraded":"2024-02-17T00:36:43.830955+0000","last_fullsized":"2024-02-17T00:36:43.830955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:47.435702+0000","last_change":"2024-02-17T00:36:37.024838+0000","last_active":"2024-02-17T00:36:47.435702+0000","last_peered":"2024-02-17T00:36:47.435702+0000","last_clean":"2024-02-17T00:36:47.435702+0000","last_became_active":"2024-02-17T00:36:37.024507+0000","last_became_peered":"2024-02-17T00:36:37.024507+0000","last_unstale":"2024-02-17T00:36:47.435702+0000","last_undegraded":"2024-02-17T00:36:47.435702+0000","last_fullsized":"2024-02-17T00:36:47.435702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:42.108161+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:42.107414+0000","last_became_peered":"2024-02-17T00:36:42.107414+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:44.381216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831001+0000","last_change":"2024-02-17T00:36:38.040658+0000","last_active":"2024-02-17T00:36:43.831001+0000","last_peered":"2024-02-17T00:36:43.831001+0000","last_clean":"2024-02-17T00:36:43.831001+0000","last_became_active":"2024-02-17T00:36:38.040361+0000","last_became_peered":"2024-02-17T00:36:38.040361+0000","last_unstale":"2024-02-17T00:36:43.831001+0000","last_undegraded":"2024-02-17T00:36:43.831001+0000","last_fullsized":"2024-02-17T00:36:43.831001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069426+0000","last_change":"2024-02-17T00:36:37.030364+0000","last_active":"2024-02-17T00:36:43.069426+0000","last_peered":"2024-02-17T00:36:43.069426+0000","last_clean":"2024-02-17T00:36:43.069426+0000","last_became_active":"2024-02-17T00:36:37.030047+0000","last_became_peered":"2024-02-17T00:36:37.030047+0000","last_unstale":"2024-02-17T00:36:43.069426+0000","last_undegraded":"2024-02-17T00:36:43.069426+0000","last_fullsized":"2024-02-17T00:36:43.069426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:26:31.440572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068488+0000","last_change":"2024-02-17T00:36:42.109162+0000","last_active":"2024-02-17T00:36:43.068488+0000","last_peered":"2024-02-17T00:36:43.068488+0000","last_clean":"2024-02-17T00:36:43.068488+0000","last_became_active":"2024-02-17T00:36:42.107077+0000","last_became_peered":"2024-02-17T00:36:42.107077+0000","last_unstale":"2024-02-17T00:36:43.068488+0000","last_undegraded":"2024-02-17T00:36:43.068488+0000","last_fullsized":"2024-02-17T00:36:43.068488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097502+0000","last_change":"2024-02-17T00:36:38.044311+0000","last_active":"2024-02-17T00:36:43.097502+0000","last_peered":"2024-02-17T00:36:43.097502+0000","last_clean":"2024-02-17T00:36:43.097502+0000","last_became_active":"2024-02-17T00:36:38.044043+0000","last_became_peered":"2024-02-17T00:36:38.044043+0000","last_unstale":"2024-02-17T00:36:43.097502+0000","last_undegraded":"2024-02-17T00:36:43.097502+0000","last_fullsized":"2024-02-17T00:36:43.097502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831305+0000","last_change":"2024-02-17T00:36:37.035871+0000","last_active":"2024-02-17T00:36:43.831305+0000","last_peered":"2024-02-17T00:36:43.831305+0000","last_clean":"2024-02-17T00:36:43.831305+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.831305+0000","last_undegraded":"2024-02-17T00:36:43.831305+0000","last_fullsized":"2024-02-17T00:36:43.831305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068707+0000","last_change":"2024-02-17T00:36:42.111490+0000","last_active":"2024-02-17T00:36:43.068707+0000","last_peered":"2024-02-17T00:36:43.068707+0000","last_clean":"2024-02-17T00:36:43.068707+0000","last_became_active":"2024-02-17T00:36:42.110829+0000","last_became_peered":"2024-02-17T00:36:42.110829+0000","last_unstale":"2024-02-17T00:36:43.068707+0000","last_undegraded":"2024-02-17T00:36:43.068707+0000","last_fullsized":"2024-02-17T00:36:43.068707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:23:34.160962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068936+0000","last_change":"2024-02-17T00:36:38.035374+0000","last_active":"2024-02-17T00:36:43.068936+0000","last_peered":"2024-02-17T00:36:43.068936+0000","last_clean":"2024-02-17T00:36:43.068936+0000","last_became_active":"2024-02-17T00:36:38.035048+0000","last_became_peered":"2024-02-17T00:36:38.035048+0000","last_unstale":"2024-02-17T00:36:43.068936+0000","last_undegraded":"2024-02-17T00:36:43.068936+0000","last_fullsized":"2024-02-17T00:36:43.068936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070032+0000","last_change":"2024-02-17T00:36:37.028771+0000","last_active":"2024-02-17T00:36:43.070032+0000","last_peered":"2024-02-17T00:36:43.070032+0000","last_clean":"2024-02-17T00:36:43.070032+0000","last_became_active":"2024-02-17T00:36:37.028466+0000","last_became_peered":"2024-02-17T00:36:37.028466+0000","last_unstale":"2024-02-17T00:36:43.070032+0000","last_undegraded":"2024-02-17T00:36:43.070032+0000","last_fullsized":"2024-02-17T00:36:43.070032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831980+0000","last_change":"2024-02-17T00:36:42.102858+0000","last_active":"2024-02-17T00:36:43.831980+0000","last_peered":"2024-02-17T00:36:43.831980+0000","last_clean":"2024-02-17T00:36:43.831980+0000","last_became_active":"2024-02-17T00:36:42.102467+0000","last_became_peered":"2024-02-17T00:36:42.102467+0000","last_unstale":"2024-02-17T00:36:43.831980+0000","last_undegraded":"2024-02-17T00:36:43.831980+0000","last_fullsized":"2024-02-17T00:36:43.831980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:16.339508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831808+0000","last_change":"2024-02-17T00:36:42.107030+0000","last_active":"2024-02-17T00:36:43.831808+0000","last_peered":"2024-02-17T00:36:43.831808+0000","last_clean":"2024-02-17T00:36:43.831808+0000","last_became_active":"2024-02-17T00:36:42.106372+0000","last_became_peered":"2024-02-17T00:36:42.106372+0000","last_unstale":"2024-02-17T00:36:43.831808+0000","last_undegraded":"2024-02-17T00:36:43.831808+0000","last_fullsized":"2024-02-17T00:36:43.831808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831130+0000","last_change":"2024-02-17T00:36:38.044613+0000","last_active":"2024-02-17T00:36:43.831130+0000","last_peered":"2024-02-17T00:36:43.831130+0000","last_clean":"2024-02-17T00:36:43.831130+0000","last_became_active":"2024-02-17T00:36:38.043593+0000","last_became_peered":"2024-02-17T00:36:38.043593+0000","last_unstale":"2024-02-17T00:36:43.831130+0000","last_undegraded":"2024-02-17T00:36:43.831130+0000","last_fullsized":"2024-02-17T00:36:43.831130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830995+0000","last_change":"2024-02-17T00:36:37.022022+0000","last_active":"2024-02-17T00:36:43.830995+0000","last_peered":"2024-02-17T00:36:43.830995+0000","last_clean":"2024-02-17T00:36:43.830995+0000","last_became_active":"2024-02-17T00:36:37.021271+0000","last_became_peered":"2024-02-17T00:36:37.021271+0000","last_unstale":"2024-02-17T00:36:43.830995+0000","last_undegraded":"2024-02-17T00:36:43.830995+0000","last_fullsized":"2024-02-17T00:36:43.830995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:45.683932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832391+0000","last_change":"2024-02-17T00:36:42.105409+0000","last_active":"2024-02-17T00:36:43.832391+0000","last_peered":"2024-02-17T00:36:43.832391+0000","last_clean":"2024-02-17T00:36:43.832391+0000","last_became_active":"2024-02-17T00:36:42.104989+0000","last_became_peered":"2024-02-17T00:36:42.104989+0000","last_unstale":"2024-02-17T00:36:43.832391+0000","last_undegraded":"2024-02-17T00:36:43.832391+0000","last_fullsized":"2024-02-17T00:36:43.832391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:41.477918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096723+0000","last_change":"2024-02-17T00:36:38.052345+0000","last_active":"2024-02-17T00:36:43.096723+0000","last_peered":"2024-02-17T00:36:43.096723+0000","last_clean":"2024-02-17T00:36:43.096723+0000","last_became_active":"2024-02-17T00:36:38.052051+0000","last_became_peered":"2024-02-17T00:36:38.052051+0000","last_unstale":"2024-02-17T00:36:43.096723+0000","last_undegraded":"2024-02-17T00:36:43.096723+0000","last_fullsized":"2024-02-17T00:36:43.096723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831372+0000","last_change":"2024-02-17T00:36:37.032305+0000","last_active":"2024-02-17T00:36:43.831372+0000","last_peered":"2024-02-17T00:36:43.831372+0000","last_clean":"2024-02-17T00:36:43.831372+0000","last_became_active":"2024-02-17T00:36:37.031977+0000","last_became_peered":"2024-02-17T00:36:37.031977+0000","last_unstale":"2024-02-17T00:36:43.831372+0000","last_undegraded":"2024-02-17T00:36:43.831372+0000","last_fullsized":"2024-02-17T00:36:43.831372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:45.670660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831564+0000","last_change":"2024-02-17T00:36:37.037062+0000","last_active":"2024-02-17T00:36:43.831564+0000","last_peered":"2024-02-17T00:36:43.831564+0000","last_clean":"2024-02-17T00:36:43.831564+0000","last_became_active":"2024-02-17T00:36:37.036814+0000","last_became_peered":"2024-02-17T00:36:37.036814+0000","last_unstale":"2024-02-17T00:36:43.831564+0000","last_undegraded":"2024-02-17T00:36:43.831564+0000","last_fullsized":"2024-02-17T00:36:43.831564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831622+0000","last_change":"2024-02-17T00:36:38.055091+0000","last_active":"2024-02-17T00:36:43.831622+0000","last_peered":"2024-02-17T00:36:43.831622+0000","last_clean":"2024-02-17T00:36:43.831622+0000","last_became_active":"2024-02-17T00:36:38.054773+0000","last_became_peered":"2024-02-17T00:36:38.054773+0000","last_unstale":"2024-02-17T00:36:43.831622+0000","last_undegraded":"2024-02-17T00:36:43.831622+0000","last_fullsized":"2024-02-17T00:36:43.831622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831612+0000","last_change":"2024-02-17T00:36:42.103625+0000","last_active":"2024-02-17T00:36:43.831612+0000","last_peered":"2024-02-17T00:36:43.831612+0000","last_clean":"2024-02-17T00:36:43.831612+0000","last_became_active":"2024-02-17T00:36:42.103248+0000","last_became_peered":"2024-02-17T00:36:42.103248+0000","last_unstale":"2024-02-17T00:36:43.831612+0000","last_undegraded":"2024-02-17T00:36:43.831612+0000","last_fullsized":"2024-02-17T00:36:43.831612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096932+0000","last_change":"2024-02-17T00:36:37.030983+0000","last_active":"2024-02-17T00:36:43.096932+0000","last_peered":"2024-02-17T00:36:43.096932+0000","last_clean":"2024-02-17T00:36:43.096932+0000","last_became_active":"2024-02-17T00:36:37.028330+0000","last_became_peered":"2024-02-17T00:36:37.028330+0000","last_unstale":"2024-02-17T00:36:43.096932+0000","last_undegraded":"2024-02-17T00:36:43.096932+0000","last_fullsized":"2024-02-17T00:36:43.096932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069391+0000","last_change":"2024-02-17T00:36:38.049295+0000","last_active":"2024-02-17T00:36:43.069391+0000","last_peered":"2024-02-17T00:36:43.069391+0000","last_clean":"2024-02-17T00:36:43.069391+0000","last_became_active":"2024-02-17T00:36:38.048946+0000","last_became_peered":"2024-02-17T00:36:38.048946+0000","last_unstale":"2024-02-17T00:36:43.069391+0000","last_undegraded":"2024-02-17T00:36:43.069391+0000","last_fullsized":"2024-02-17T00:36:43.069391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069192+0000","last_change":"2024-02-17T00:36:42.105857+0000","last_active":"2024-02-17T00:36:43.069192+0000","last_peered":"2024-02-17T00:36:43.069192+0000","last_clean":"2024-02-17T00:36:43.069192+0000","last_became_active":"2024-02-17T00:36:42.105256+0000","last_became_peered":"2024-02-17T00:36:42.105256+0000","last_unstale":"2024-02-17T00:36:43.069192+0000","last_undegraded":"2024-02-17T00:36:43.069192+0000","last_fullsized":"2024-02-17T00:36:43.069192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:00:11.474820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068081+0000","last_change":"2024-02-17T00:36:38.040290+0000","last_active":"2024-02-17T00:36:43.068081+0000","last_peered":"2024-02-17T00:36:43.068081+0000","last_clean":"2024-02-17T00:36:43.068081+0000","last_became_active":"2024-02-17T00:36:38.039955+0000","last_became_peered":"2024-02-17T00:36:38.039955+0000","last_unstale":"2024-02-17T00:36:43.068081+0000","last_undegraded":"2024-02-17T00:36:43.068081+0000","last_fullsized":"2024-02-17T00:36:43.068081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068817+0000","last_change":"2024-02-17T00:36:38.056307+0000","last_active":"2024-02-17T00:36:43.068817+0000","last_peered":"2024-02-17T00:36:43.068817+0000","last_clean":"2024-02-17T00:36:43.068817+0000","last_became_active":"2024-02-17T00:36:38.055992+0000","last_became_peered":"2024-02-17T00:36:38.055992+0000","last_unstale":"2024-02-17T00:36:43.068817+0000","last_undegraded":"2024-02-17T00:36:43.068817+0000","last_fullsized":"2024-02-17T00:36:43.068817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:56:01.530703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831314+0000","last_change":"2024-02-17T00:36:38.043893+0000","last_active":"2024-02-17T00:36:43.831314+0000","last_peered":"2024-02-17T00:36:43.831314+0000","last_clean":"2024-02-17T00:36:43.831314+0000","last_became_active":"2024-02-17T00:36:38.043507+0000","last_became_peered":"2024-02-17T00:36:38.043507+0000","last_unstale":"2024-02-17T00:36:43.831314+0000","last_undegraded":"2024-02-17T00:36:43.831314+0000","last_fullsized":"2024-02-17T00:36:43.831314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:57:48.954988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096825+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.096825+0000","last_peered":"2024-02-17T00:36:43.096825+0000","last_clean":"2024-02-17T00:36:43.096825+0000","last_became_active":"2024-02-17T00:36:38.057544+0000","last_became_peered":"2024-02-17T00:36:38.057544+0000","last_unstale":"2024-02-17T00:36:43.096825+0000","last_undegraded":"2024-02-17T00:36:43.096825+0000","last_fullsized":"2024-02-17T00:36:43.096825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832520+0000","last_change":"2024-02-17T00:36:38.054267+0000","last_active":"2024-02-17T00:36:43.832520+0000","last_peered":"2024-02-17T00:36:43.832520+0000","last_clean":"2024-02-17T00:36:43.832520+0000","last_became_active":"2024-02-17T00:36:38.053966+0000","last_became_peered":"2024-02-17T00:36:38.053966+0000","last_unstale":"2024-02-17T00:36:43.832520+0000","last_undegraded":"2024-02-17T00:36:43.832520+0000","last_fullsized":"2024-02-17T00:36:43.832520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831587+0000","last_change":"2024-02-17T00:36:38.056442+0000","last_active":"2024-02-17T00:36:43.831587+0000","last_peered":"2024-02-17T00:36:43.831587+0000","last_clean":"2024-02-17T00:36:43.831587+0000","last_became_active":"2024-02-17T00:36:38.056049+0000","last_became_peered":"2024-02-17T00:36:38.056049+0000","last_unstale":"2024-02-17T00:36:43.831587+0000","last_undegraded":"2024-02-17T00:36:43.831587+0000","last_fullsized":"2024-02-17T00:36:43.831587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068812+0000","last_change":"2024-02-17T00:36:38.036181+0000","last_active":"2024-02-17T00:36:43.068812+0000","last_peered":"2024-02-17T00:36:43.068812+0000","last_clean":"2024-02-17T00:36:43.068812+0000","last_became_active":"2024-02-17T00:36:38.035881+0000","last_became_peered":"2024-02-17T00:36:38.035881+0000","last_unstale":"2024-02-17T00:36:43.068812+0000","last_undegraded":"2024-02-17T00:36:43.068812+0000","last_fullsized":"2024-02-17T00:36:43.068812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097279+0000","last_change":"2024-02-17T00:36:38.049793+0000","last_active":"2024-02-17T00:36:43.097279+0000","last_peered":"2024-02-17T00:36:43.097279+0000","last_clean":"2024-02-17T00:36:43.097279+0000","last_became_active":"2024-02-17T00:36:38.049216+0000","last_became_peered":"2024-02-17T00:36:38.049216+0000","last_unstale":"2024-02-17T00:36:43.097279+0000","last_undegraded":"2024-02-17T00:36:43.097279+0000","last_fullsized":"2024-02-17T00:36:43.097279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830904+0000","last_change":"2024-02-17T00:36:38.047085+0000","last_active":"2024-02-17T00:36:43.830904+0000","last_peered":"2024-02-17T00:36:43.830904+0000","last_clean":"2024-02-17T00:36:43.830904+0000","last_became_active":"2024-02-17T00:36:38.046375+0000","last_became_peered":"2024-02-17T00:36:38.046375+0000","last_unstale":"2024-02-17T00:36:43.830904+0000","last_undegraded":"2024-02-17T00:36:43.830904+0000","last_fullsized":"2024-02-17T00:36:43.830904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096697+0000","last_change":"2024-02-17T00:36:38.054777+0000","last_active":"2024-02-17T00:36:43.096697+0000","last_peered":"2024-02-17T00:36:43.096697+0000","last_clean":"2024-02-17T00:36:43.096697+0000","last_became_active":"2024-02-17T00:36:38.054520+0000","last_became_peered":"2024-02-17T00:36:38.054520+0000","last_unstale":"2024-02-17T00:36:43.096697+0000","last_undegraded":"2024-02-17T00:36:43.096697+0000","last_fullsized":"2024-02-17T00:36:43.096697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069328+0000","last_change":"2024-02-17T00:36:38.054174+0000","last_active":"2024-02-17T00:36:43.069328+0000","last_peered":"2024-02-17T00:36:43.069328+0000","last_clean":"2024-02-17T00:36:43.069328+0000","last_became_active":"2024-02-17T00:36:38.053849+0000","last_became_peered":"2024-02-17T00:36:38.053849+0000","last_unstale":"2024-02-17T00:36:43.069328+0000","last_undegraded":"2024-02-17T00:36:43.069328+0000","last_fullsized":"2024-02-17T00:36:43.069328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831711+0000","last_change":"2024-02-17T00:36:38.040949+0000","last_active":"2024-02-17T00:36:43.831711+0000","last_peered":"2024-02-17T00:36:43.831711+0000","last_clean":"2024-02-17T00:36:43.831711+0000","last_became_active":"2024-02-17T00:36:38.040638+0000","last_became_peered":"2024-02-17T00:36:38.040638+0000","last_unstale":"2024-02-17T00:36:43.831711+0000","last_undegraded":"2024-02-17T00:36:43.831711+0000","last_fullsized":"2024-02-17T00:36:43.831711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831857+0000","last_change":"2024-02-17T00:36:38.059813+0000","last_active":"2024-02-17T00:36:43.831857+0000","last_peered":"2024-02-17T00:36:43.831857+0000","last_clean":"2024-02-17T00:36:43.831857+0000","last_became_active":"2024-02-17T00:36:38.059568+0000","last_became_peered":"2024-02-17T00:36:38.059568+0000","last_unstale":"2024-02-17T00:36:43.831857+0000","last_undegraded":"2024-02-17T00:36:43.831857+0000","last_fullsized":"2024-02-17T00:36:43.831857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832389+0000","last_change":"2024-02-17T00:36:38.054049+0000","last_active":"2024-02-17T00:36:43.832389+0000","last_peered":"2024-02-17T00:36:43.832389+0000","last_clean":"2024-02-17T00:36:43.832389+0000","last_became_active":"2024-02-17T00:36:38.053785+0000","last_became_peered":"2024-02-17T00:36:38.053785+0000","last_unstale":"2024-02-17T00:36:43.832389+0000","last_undegraded":"2024-02-17T00:36:43.832389+0000","last_fullsized":"2024-02-17T00:36:43.832389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:46.428346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069734+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.069734+0000","last_peered":"2024-02-17T00:36:43.069734+0000","last_clean":"2024-02-17T00:36:43.069734+0000","last_became_active":"2024-02-17T00:36:38.057512+0000","last_became_peered":"2024-02-17T00:36:38.057512+0000","last_unstale":"2024-02-17T00:36:43.069734+0000","last_undegraded":"2024-02-17T00:36:43.069734+0000","last_fullsized":"2024-02-17T00:36:43.069734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:06:22.484806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832454+0000","last_change":"2024-02-17T00:36:38.055783+0000","last_active":"2024-02-17T00:36:43.832454+0000","last_peered":"2024-02-17T00:36:43.832454+0000","last_clean":"2024-02-17T00:36:43.832454+0000","last_became_active":"2024-02-17T00:36:38.055520+0000","last_became_peered":"2024-02-17T00:36:38.055520+0000","last_unstale":"2024-02-17T00:36:43.832454+0000","last_undegraded":"2024-02-17T00:36:43.832454+0000","last_fullsized":"2024-02-17T00:36:43.832454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:36.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830805+0000","last_change":"2024-02-17T00:36:38.041377+0000","last_active":"2024-02-17T00:36:43.830805+0000","last_peered":"2024-02-17T00:36:43.830805+0000","last_clean":"2024-02-17T00:36:43.830805+0000","last_became_active":"2024-02-17T00:36:38.041081+0000","last_became_peered":"2024-02-17T00:36:38.041081+0000","last_unstale":"2024-02-17T00:36:43.830805+0000","last_undegraded":"2024-02-17T00:36:43.830805+0000","last_fullsized":"2024-02-17T00:36:43.830805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096497+0000","last_change":"2024-02-17T00:36:38.054101+0000","last_active":"2024-02-17T00:36:43.096497+0000","last_peered":"2024-02-17T00:36:43.096497+0000","last_clean":"2024-02-17T00:36:43.096497+0000","last_became_active":"2024-02-17T00:36:38.053820+0000","last_became_peered":"2024-02-17T00:36:38.053820+0000","last_unstale":"2024-02-17T00:36:43.096497+0000","last_undegraded":"2024-02-17T00:36:43.096497+0000","last_fullsized":"2024-02-17T00:36:43.096497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831862+0000","last_change":"2024-02-17T00:36:38.051075+0000","last_active":"2024-02-17T00:36:43.831862+0000","last_peered":"2024-02-17T00:36:43.831862+0000","last_clean":"2024-02-17T00:36:43.831862+0000","last_became_active":"2024-02-17T00:36:38.050786+0000","last_became_peered":"2024-02-17T00:36:38.050786+0000","last_unstale":"2024-02-17T00:36:43.831862+0000","last_undegraded":"2024-02-17T00:36:43.831862+0000","last_fullsized":"2024-02-17T00:36:43.831862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832457+0000","last_change":"2024-02-17T00:36:38.053472+0000","last_active":"2024-02-17T00:36:43.832457+0000","last_peered":"2024-02-17T00:36:43.832457+0000","last_clean":"2024-02-17T00:36:43.832457+0000","last_became_active":"2024-02-17T00:36:38.053183+0000","last_became_peered":"2024-02-17T00:36:38.053183+0000","last_unstale":"2024-02-17T00:36:43.832457+0000","last_undegraded":"2024-02-17T00:36:43.832457+0000","last_fullsized":"2024-02-17T00:36:43.832457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831779+0000","last_change":"2024-02-17T00:36:38.061499+0000","last_active":"2024-02-17T00:36:43.831779+0000","last_peered":"2024-02-17T00:36:43.831779+0000","last_clean":"2024-02-17T00:36:43.831779+0000","last_became_active":"2024-02-17T00:36:38.061179+0000","last_became_peered":"2024-02-17T00:36:38.061179+0000","last_unstale":"2024-02-17T00:36:43.831779+0000","last_undegraded":"2024-02-17T00:36:43.831779+0000","last_fullsized":"2024-02-17T00:36:43.831779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830928+0000","last_change":"2024-02-17T00:36:38.060993+0000","last_active":"2024-02-17T00:36:43.830928+0000","last_peered":"2024-02-17T00:36:43.830928+0000","last_clean":"2024-02-17T00:36:43.830928+0000","last_became_active":"2024-02-17T00:36:38.060363+0000","last_became_peered":"2024-02-17T00:36:38.060363+0000","last_unstale":"2024-02-17T00:36:43.830928+0000","last_undegraded":"2024-02-17T00:36:43.830928+0000","last_fullsized":"2024-02-17T00:36:43.830928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830894+0000","last_change":"2024-02-17T00:36:38.064745+0000","last_active":"2024-02-17T00:36:43.830894+0000","last_peered":"2024-02-17T00:36:43.830894+0000","last_clean":"2024-02-17T00:36:43.830894+0000","last_became_active":"2024-02-17T00:36:38.064474+0000","last_became_peered":"2024-02-17T00:36:38.064474+0000","last_unstale":"2024-02-17T00:36:43.830894+0000","last_undegraded":"2024-02-17T00:36:43.830894+0000","last_fullsized":"2024-02-17T00:36:43.830894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070025+0000","last_change":"2024-02-17T00:36:38.045388+0000","last_active":"2024-02-17T00:36:43.070025+0000","last_peered":"2024-02-17T00:36:43.070025+0000","last_clean":"2024-02-17T00:36:43.070025+0000","last_became_active":"2024-02-17T00:36:38.045025+0000","last_became_peered":"2024-02-17T00:36:38.045025+0000","last_unstale":"2024-02-17T00:36:43.070025+0000","last_undegraded":"2024-02-17T00:36:43.070025+0000","last_fullsized":"2024-02-17T00:36:43.070025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:27.545648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096470+0000","last_change":"2024-02-17T00:36:38.060065+0000","last_active":"2024-02-17T00:36:43.096470+0000","last_peered":"2024-02-17T00:36:43.096470+0000","last_clean":"2024-02-17T00:36:43.096470+0000","last_became_active":"2024-02-17T00:36:38.058856+0000","last_became_peered":"2024-02-17T00:36:38.058856+0000","last_unstale":"2024-02-17T00:36:43.096470+0000","last_undegraded":"2024-02-17T00:36:43.096470+0000","last_fullsized":"2024-02-17T00:36:43.096470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830615+0000","last_change":"2024-02-17T00:36:38.049156+0000","last_active":"2024-02-17T00:36:43.830615+0000","last_peered":"2024-02-17T00:36:43.830615+0000","last_clean":"2024-02-17T00:36:43.830615+0000","last_became_active":"2024-02-17T00:36:38.048871+0000","last_became_peered":"2024-02-17T00:36:38.048871+0000","last_unstale":"2024-02-17T00:36:43.830615+0000","last_undegraded":"2024-02-17T00:36:43.830615+0000","last_fullsized":"2024-02-17T00:36:43.830615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068418+0000","last_change":"2024-02-17T00:36:38.043709+0000","last_active":"2024-02-17T00:36:43.068418+0000","last_peered":"2024-02-17T00:36:43.068418+0000","last_clean":"2024-02-17T00:36:43.068418+0000","last_became_active":"2024-02-17T00:36:38.043021+0000","last_became_peered":"2024-02-17T00:36:38.043021+0000","last_unstale":"2024-02-17T00:36:43.068418+0000","last_undegraded":"2024-02-17T00:36:43.068418+0000","last_fullsized":"2024-02-17T00:36:43.068418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831338+0000","last_change":"2024-02-17T00:36:38.051762+0000","last_active":"2024-02-17T00:36:43.831338+0000","last_peered":"2024-02-17T00:36:43.831338+0000","last_clean":"2024-02-17T00:36:43.831338+0000","last_became_active":"2024-02-17T00:36:38.050858+0000","last_became_peered":"2024-02-17T00:36:38.050858+0000","last_unstale":"2024-02-17T00:36:43.831338+0000","last_undegraded":"2024-02-17T00:36:43.831338+0000","last_fullsized":"2024-02-17T00:36:43.831338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068278+0000","last_change":"2024-02-17T00:36:38.052747+0000","last_active":"2024-02-17T00:36:43.068278+0000","last_peered":"2024-02-17T00:36:43.068278+0000","last_clean":"2024-02-17T00:36:43.068278+0000","last_became_active":"2024-02-17T00:36:38.052427+0000","last_became_peered":"2024-02-17T00:36:38.052427+0000","last_unstale":"2024-02-17T00:36:43.068278+0000","last_undegraded":"2024-02-17T00:36:43.068278+0000","last_fullsized":"2024-02-17T00:36:43.068278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097083+0000","last_change":"2024-02-17T00:36:38.050783+0000","last_active":"2024-02-17T00:36:43.097083+0000","last_peered":"2024-02-17T00:36:43.097083+0000","last_clean":"2024-02-17T00:36:43.097083+0000","last_became_active":"2024-02-17T00:36:38.050517+0000","last_became_peered":"2024-02-17T00:36:38.050517+0000","last_unstale":"2024-02-17T00:36:43.097083+0000","last_undegraded":"2024-02-17T00:36:43.097083+0000","last_fullsized":"2024-02-17T00:36:43.097083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097293+0000","last_change":"2024-02-17T00:36:38.052397+0000","last_active":"2024-02-17T00:36:43.097293+0000","last_peered":"2024-02-17T00:36:43.097293+0000","last_clean":"2024-02-17T00:36:43.097293+0000","last_became_active":"2024-02-17T00:36:38.052096+0000","last_became_peered":"2024-02-17T00:36:38.052096+0000","last_unstale":"2024-02-17T00:36:43.097293+0000","last_undegraded":"2024-02-17T00:36:43.097293+0000","last_fullsized":"2024-02-17T00:36:43.097293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831341+0000","last_change":"2024-02-17T00:36:38.054432+0000","last_active":"2024-02-17T00:36:43.831341+0000","last_peered":"2024-02-17T00:36:43.831341+0000","last_clean":"2024-02-17T00:36:43.831341+0000","last_became_active":"2024-02-17T00:36:38.054152+0000","last_became_peered":"2024-02-17T00:36:38.054152+0000","last_unstale":"2024-02-17T00:36:43.831341+0000","last_undegraded":"2024-02-17T00:36:43.831341+0000","last_fullsized":"2024-02-17T00:36:43.831341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:05.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:05.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.646+0000 7fedb39e9640 1 Processor -- start 2024-02-17T00:37:05.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.646+0000 7fedb39e9640 1 -- start start 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.647+0000 7fedb39e9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fedac15b8e0 0x7fedac0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.647+0000 7fedb39e9640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0cd7d0 con 0x7fedac0cc300 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.647+0000 7fedb39e9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0ccbc0 con 0x7fedac09a100 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.647+0000 7fedb39e9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac0ccea0 con 0x7fedac15b8e0 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.647+0000 7fedb0f84640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fedac0cc300 0x7fedac0999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57612/0 (socket says 172.21.15.32:57612) 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.647+0000 7fedb0f84640 1 -- 172.21.15.32:0/6669598 learned_addr learned my addr 172.21.15.32:0/6669598 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:05.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 --2- 172.21.15.32:0/6669598 >> v2:172.21.15.39:3300/0 conn(0x7fedac15b8e0 0x7fedac0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306543901 0 0) 0x7fedac0cd7d0 con 0x7fedac0cc300 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed94003520 con 0x7fedac0cc300 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335542657 0 0) 0x7fedac0ccbc0 con 0x7fedac09a100 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedac0cd7d0 con 0x7fedac09a100 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236581462 0 0) 0x7fed94003520 con 0x7fedac0cc300 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 >> v2:172.21.15.39:3300/0 conn(0x7fedac15b8e0 msgr2=0x7fedac0d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 --2- 172.21.15.32:0/6669598 >> v2:172.21.15.39:3300/0 conn(0x7fedac15b8e0 0x7fedac0d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 >> v1:172.21.15.39:6789/0 conn(0x7fedac09a100 legacy=0x7fedac0b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0cd180 con 0x7fedac0cc300 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7feda0001670 con 0x7fedac0cc300 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 >> v1:172.21.15.32:6789/0 conn(0x7fedac0cc300 legacy=0x7fedac0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed94003b00 0x7fed94003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed940047c0 0x7fed94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94005180 0x7fed9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0ccea0 con 0x7fed94003b00 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9400c000 con 0x7fed940047c0 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9400c1c0 con 0x7fed94005180 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed94003b00 0x7fed94003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb0f84640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed940047c0 0x7fed94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1f86640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94005180 0x7fed9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 -- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94005180 msgr2=0x7fed9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94005180 0x7fed9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 -- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed940047c0 msgr2=0x7fed94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed940047c0 0x7fed94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1785640 1 -- 172.21.15.32:0/6669598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94003520 con 0x7fed94003b00 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.648+0000 7fedb1f86640 1 -- 172.21.15.32:0/6669598 reap_dead start 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.649+0000 7fedb1785640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed94003b00 0x7fed94003f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feda4009ac0 tx=0x7fed940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eef2d17d53accc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.649+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda402c6d0 con 0x7fed94003b00 2024-02-17T00:37:05.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.649+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda402c830 con 0x7fed94003b00 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.649+0000 7fedabfff640 1 -- 172.21.15.32:0/6669598 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda402cbc0 con 0x7fed94003b00 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 -- 172.21.15.32:0/6669598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed94003b00 msgr2=0x7fed94003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed94003b00 0x7fed94003f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feda4009ac0 tx=0x7fed940057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 -- 172.21.15.32:0/6669598 shutdown_connections 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 --2- 172.21.15.32:0/6669598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed94003b00 0x7fed94003f00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 -- 172.21.15.32:0/6669598 >> 172.21.15.32:0/6669598 conn(0x7fedac0b3130 msgr2=0x7fedac0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 -- 172.21.15.32:0/6669598 shutdown_connections 2024-02-17T00:37:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.650+0000 7fedb39e9640 1 -- 172.21.15.32:0/6669598 wait complete. 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.651+0000 7fedb39e9640 1 Processor -- start 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.651+0000 7fedb39e9640 1 -- start start 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb39e9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94003b00 0x7fedac1f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb39e9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedac0ce9d0 0x7fedac1f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb39e9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 0x7fedac14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb39e9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0ca460 con 0x7fedac0cee50 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb39e9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1f4fa0 con 0x7fedac0ce9d0 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb39e9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1f5240 con 0x7fed94003b00 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 0x7fedac14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 0x7fedac14a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43796/0 (socket says 172.21.15.32:43796) 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 -- 172.21.15.32:0/1981766984 learned_addr learned my addr 172.21.15.32:0/1981766984 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb0f84640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedac0ce9d0 0x7fedac1f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1785640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94003b00 0x7fedac1f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 -- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94003b00 msgr2=0x7fedac1f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94003b00 0x7fedac1f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 -- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedac0ce9d0 msgr2=0x7fedac1f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedac0ce9d0 0x7fedac1f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 -- 172.21.15.32:0/1981766984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac1f5520 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7fedb1f86640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 0x7fedac14a6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fedac06f050 tx=0x7fed9c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c006e20 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.652+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c003970 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.653+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c003d20 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.653+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac1f5800 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.653+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac1f24c0 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.654+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac0ca1c0 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.654+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fed9c00d740 con 0x7fedac0cee50 2024-02-17T00:37:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.654+0000 7feda9ffb640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fed9806b840 0x7fed9806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.654+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fed9c089870 con 0x7fedac0cee50 2024-02-17T00:37:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.655+0000 7fedb1785640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fed9806b840 0x7fed9806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.655+0000 7fedb1785640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fed9806b840 0x7fed9806dd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feda4036000 tx=0x7feda4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:05.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.660+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedac0ca1c0 con 0x7fedac0cee50 2024-02-17T00:37:05.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.835+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedac0ca5a0 con 0x7fed9806b840 2024-02-17T00:37:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.844+0000 7feda9ffb640 1 -- 172.21.15.32:0/1981766984 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345228 (secure 0 0 0) 0x7fedac0ca5a0 con 0x7fed9806b840 2024-02-17T00:37:05.850 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:05.852 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fed9806b840 msgr2=0x7fed9806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fed9806b840 0x7fed9806dd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feda4036000 tx=0x7feda4030000 comp rx=0 tx=0).stop 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 msgr2=0x7fedac14a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 0x7fedac14a6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fedac06f050 tx=0x7fed9c00ff70 comp rx=0 tx=0).stop 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 shutdown_connections 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedac0cee50 0x7fedac14a6d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedac0ce9d0 0x7fedac1f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fed9806b840 0x7fed9806dd00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 --2- 172.21.15.32:0/1981766984 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fed94003b00 0x7fedac1f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 >> 172.21.15.32:0/1981766984 conn(0x7fedac0b3130 msgr2=0x7fedac0b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 shutdown_connections 2024-02-17T00:37:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.847+0000 7fedb39e9640 1 -- 172.21.15.32:0/1981766984 wait complete. 2024-02-17T00:37:05.861 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-02-17T00:37:03.951948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248732,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725988,"statfs":{"total":773094113280,"available":772839411712,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831592+0000","last_change":"2024-02-17T00:36:37.030662+0000","last_active":"2024-02-17T00:36:43.831592+0000","last_peered":"2024-02-17T00:36:43.831592+0000","last_clean":"2024-02-17T00:36:43.831592+0000","last_became_active":"2024-02-17T00:36:37.030370+0000","last_became_peered":"2024-02-17T00:36:37.030370+0000","last_unstale":"2024-02-17T00:36:43.831592+0000","last_undegraded":"2024-02-17T00:36:43.831592+0000","last_fullsized":"2024-02-17T00:36:43.831592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097375+0000","last_change":"2024-02-17T00:36:38.055521+0000","last_active":"2024-02-17T00:36:43.097375+0000","last_peered":"2024-02-17T00:36:43.097375+0000","last_clean":"2024-02-17T00:36:43.097375+0000","last_became_active":"2024-02-17T00:36:38.054923+0000","last_became_peered":"2024-02-17T00:36:38.054923+0000","last_unstale":"2024-02-17T00:36:43.097375+0000","last_undegraded":"2024-02-17T00:36:43.097375+0000","last_fullsized":"2024-02-17T00:36:43.097375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068785+0000","last_change":"2024-02-17T00:36:42.106155+0000","last_active":"2024-02-17T00:36:43.068785+0000","last_peered":"2024-02-17T00:36:43.068785+0000","last_clean":"2024-02-17T00:36:43.068785+0000","last_became_active":"2024-02-17T00:36:42.105538+0000","last_became_peered":"2024-02-17T00:36:42.105538+0000","last_unstale":"2024-02-17T00:36:43.068785+0000","last_undegraded":"2024-02-17T00:36:43.068785+0000","last_fullsized":"2024-02-17T00:36:43.068785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:31:04.425166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097461+0000","last_change":"2024-02-17T00:36:37.028529+0000","last_active":"2024-02-17T00:36:43.097461+0000","last_peered":"2024-02-17T00:36:43.097461+0000","last_clean":"2024-02-17T00:36:43.097461+0000","last_became_active":"2024-02-17T00:36:37.027869+0000","last_became_peered":"2024-02-17T00:36:37.027869+0000","last_unstale":"2024-02-17T00:36:43.097461+0000","last_undegraded":"2024-02-17T00:36:43.097461+0000","last_fullsized":"2024-02-17T00:36:43.097461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097406+0000","last_change":"2024-02-17T00:36:38.049523+0000","last_active":"2024-02-17T00:36:43.097406+0000","last_peered":"2024-02-17T00:36:43.097406+0000","last_clean":"2024-02-17T00:36:43.097406+0000","last_became_active":"2024-02-17T00:36:38.048836+0000","last_became_peered":"2024-02-17T00:36:38.048836+0000","last_unstale":"2024-02-17T00:36:43.097406+0000","last_undegraded":"2024-02-17T00:36:43.097406+0000","last_fullsized":"2024-02-17T00:36:43.097406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068282+0000","last_change":"2024-02-17T00:36:42.106437+0000","last_active":"2024-02-17T00:36:43.068282+0000","last_peered":"2024-02-17T00:36:43.068282+0000","last_clean":"2024-02-17T00:36:43.068282+0000","last_became_active":"2024-02-17T00:36:42.105260+0000","last_became_peered":"2024-02-17T00:36:42.105260+0000","last_unstale":"2024-02-17T00:36:43.068282+0000","last_undegraded":"2024-02-17T00:36:43.068282+0000","last_fullsized":"2024-02-17T00:36:43.068282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:43.059445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831042+0000","last_change":"2024-02-17T00:36:37.031714+0000","last_active":"2024-02-17T00:36:43.831042+0000","last_peered":"2024-02-17T00:36:43.831042+0000","last_clean":"2024-02-17T00:36:43.831042+0000","last_became_active":"2024-02-17T00:36:37.031420+0000","last_became_peered":"2024-02-17T00:36:37.031420+0000","last_unstale":"2024-02-17T00:36:43.831042+0000","last_undegraded":"2024-02-17T00:36:43.831042+0000","last_fullsized":"2024-02-17T00:36:43.831042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069643+0000","last_change":"2024-02-17T00:36:38.056370+0000","last_active":"2024-02-17T00:36:43.069643+0000","last_peered":"2024-02-17T00:36:43.069643+0000","last_clean":"2024-02-17T00:36:43.069643+0000","last_became_active":"2024-02-17T00:36:38.056088+0000","last_became_peered":"2024-02-17T00:36:38.056088+0000","last_unstale":"2024-02-17T00:36:43.069643+0000","last_undegraded":"2024-02-17T00:36:43.069643+0000","last_fullsized":"2024-02-17T00:36:43.069643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068302+0000","last_change":"2024-02-17T00:36:42.102716+0000","last_active":"2024-02-17T00:36:43.068302+0000","last_peered":"2024-02-17T00:36:43.068302+0000","last_clean":"2024-02-17T00:36:43.068302+0000","last_became_active":"2024-02-17T00:36:42.102320+0000","last_became_peered":"2024-02-17T00:36:42.102320+0000","last_unstale":"2024-02-17T00:36:43.068302+0000","last_undegraded":"2024-02-17T00:36:43.068302+0000","last_fullsized":"2024-02-17T00:36:43.068302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832076+0000","last_change":"2024-02-17T00:36:37.030968+0000","last_active":"2024-02-17T00:36:43.832076+0000","last_peered":"2024-02-17T00:36:43.832076+0000","last_clean":"2024-02-17T00:36:43.832076+0000","last_became_active":"2024-02-17T00:36:37.030633+0000","last_became_peered":"2024-02-17T00:36:37.030633+0000","last_unstale":"2024-02-17T00:36:43.832076+0000","last_undegraded":"2024-02-17T00:36:43.832076+0000","last_fullsized":"2024-02-17T00:36:43.832076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832222+0000","last_change":"2024-02-17T00:36:38.059509+0000","last_active":"2024-02-17T00:36:43.832222+0000","last_peered":"2024-02-17T00:36:43.832222+0000","last_clean":"2024-02-17T00:36:43.832222+0000","last_became_active":"2024-02-17T00:36:38.059254+0000","last_became_peered":"2024-02-17T00:36:38.059254+0000","last_unstale":"2024-02-17T00:36:43.832222+0000","last_undegraded":"2024-02-17T00:36:43.832222+0000","last_fullsized":"2024-02-17T00:36:43.832222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:03.666531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068026+0000","last_change":"2024-02-17T00:36:42.104635+0000","last_active":"2024-02-17T00:36:43.068026+0000","last_peered":"2024-02-17T00:36:43.068026+0000","last_clean":"2024-02-17T00:36:43.068026+0000","last_became_active":"2024-02-17T00:36:42.104078+0000","last_became_peered":"2024-02-17T00:36:42.104078+0000","last_unstale":"2024-02-17T00:36:43.068026+0000","last_undegraded":"2024-02-17T00:36:43.068026+0000","last_fullsized":"2024-02-17T00:36:43.068026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831402+0000","last_change":"2024-02-17T00:36:38.044922+0000","last_active":"2024-02-17T00:36:43.831402+0000","last_peered":"2024-02-17T00:36:43.831402+0000","last_clean":"2024-02-17T00:36:43.831402+0000","last_became_active":"2024-02-17T00:36:38.044635+0000","last_became_peered":"2024-02-17T00:36:38.044635+0000","last_unstale":"2024-02-17T00:36:43.831402+0000","last_undegraded":"2024-02-17T00:36:43.831402+0000","last_fullsized":"2024-02-17T00:36:43.831402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:07:57.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831908+0000","last_change":"2024-02-17T00:36:37.027914+0000","last_active":"2024-02-17T00:36:43.831908+0000","last_peered":"2024-02-17T00:36:43.831908+0000","last_clean":"2024-02-17T00:36:43.831908+0000","last_became_active":"2024-02-17T00:36:37.027428+0000","last_became_peered":"2024-02-17T00:36:37.027428+0000","last_unstale":"2024-02-17T00:36:43.831908+0000","last_undegraded":"2024-02-17T00:36:43.831908+0000","last_fullsized":"2024-02-17T00:36:43.831908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:41.254351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832120+0000","last_change":"2024-02-17T00:36:42.112759+0000","last_active":"2024-02-17T00:36:43.832120+0000","last_peered":"2024-02-17T00:36:43.832120+0000","last_clean":"2024-02-17T00:36:43.832120+0000","last_became_active":"2024-02-17T00:36:42.112040+0000","last_became_peered":"2024-02-17T00:36:42.112040+0000","last_unstale":"2024-02-17T00:36:43.832120+0000","last_undegraded":"2024-02-17T00:36:43.832120+0000","last_fullsized":"2024-02-17T00:36:43.832120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:15.987819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069089+0000","last_change":"2024-02-17T00:36:38.057079+0000","last_active":"2024-02-17T00:36:43.069089+0000","last_peered":"2024-02-17T00:36:43.069089+0000","last_clean":"2024-02-17T00:36:43.069089+0000","last_became_active":"2024-02-17T00:36:38.056788+0000","last_became_peered":"2024-02-17T00:36:38.056788+0000","last_unstale":"2024-02-17T00:36:43.069089+0000","last_undegraded":"2024-02-17T00:36:43.069089+0000","last_fullsized":"2024-02-17T00:36:43.069089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:56:11.007052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832223+0000","last_change":"2024-02-17T00:36:37.032242+0000","last_active":"2024-02-17T00:36:43.832223+0000","last_peered":"2024-02-17T00:36:43.832223+0000","last_clean":"2024-02-17T00:36:43.832223+0000","last_became_active":"2024-02-17T00:36:37.031951+0000","last_became_peered":"2024-02-17T00:36:37.031951+0000","last_unstale":"2024-02-17T00:36:43.832223+0000","last_undegraded":"2024-02-17T00:36:43.832223+0000","last_fullsized":"2024-02-17T00:36:43.832223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831617+0000","last_change":"2024-02-17T00:36:42.105780+0000","last_active":"2024-02-17T00:36:43.831617+0000","last_peered":"2024-02-17T00:36:43.831617+0000","last_clean":"2024-02-17T00:36:43.831617+0000","last_became_active":"2024-02-17T00:36:42.105405+0000","last_became_peered":"2024-02-17T00:36:42.105405+0000","last_unstale":"2024-02-17T00:36:43.831617+0000","last_undegraded":"2024-02-17T00:36:43.831617+0000","last_fullsized":"2024-02-17T00:36:43.831617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:40.401581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831013+0000","last_change":"2024-02-17T00:36:38.053301+0000","last_active":"2024-02-17T00:36:43.831013+0000","last_peered":"2024-02-17T00:36:43.831013+0000","last_clean":"2024-02-17T00:36:43.831013+0000","last_became_active":"2024-02-17T00:36:38.052981+0000","last_became_peered":"2024-02-17T00:36:38.052981+0000","last_unstale":"2024-02-17T00:36:43.831013+0000","last_undegraded":"2024-02-17T00:36:43.831013+0000","last_fullsized":"2024-02-17T00:36:43.831013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831734+0000","last_change":"2024-02-17T00:36:37.032841+0000","last_active":"2024-02-17T00:36:43.831734+0000","last_peered":"2024-02-17T00:36:43.831734+0000","last_clean":"2024-02-17T00:36:43.831734+0000","last_became_active":"2024-02-17T00:36:37.032569+0000","last_became_peered":"2024-02-17T00:36:37.032569+0000","last_unstale":"2024-02-17T00:36:43.831734+0000","last_undegraded":"2024-02-17T00:36:43.831734+0000","last_fullsized":"2024-02-17T00:36:43.831734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069627+0000","last_change":"2024-02-17T00:36:42.110199+0000","last_active":"2024-02-17T00:36:43.069627+0000","last_peered":"2024-02-17T00:36:43.069627+0000","last_clean":"2024-02-17T00:36:43.069627+0000","last_became_active":"2024-02-17T00:36:42.109821+0000","last_became_peered":"2024-02-17T00:36:42.109821+0000","last_unstale":"2024-02-17T00:36:43.069627+0000","last_undegraded":"2024-02-17T00:36:43.069627+0000","last_fullsized":"2024-02-17T00:36:43.069627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:09:09.535328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830918+0000","last_change":"2024-02-17T00:36:38.054753+0000","last_active":"2024-02-17T00:36:43.830918+0000","last_peered":"2024-02-17T00:36:43.830918+0000","last_clean":"2024-02-17T00:36:43.830918+0000","last_became_active":"2024-02-17T00:36:38.054461+0000","last_became_peered":"2024-02-17T00:36:38.054461+0000","last_unstale":"2024-02-17T00:36:43.830918+0000","last_undegraded":"2024-02-17T00:36:43.830918+0000","last_fullsized":"2024-02-17T00:36:43.830918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:40.337939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830476+0000","last_change":"2024-02-17T00:36:37.036152+0000","last_active":"2024-02-17T00:36:43.830476+0000","last_peered":"2024-02-17T00:36:43.830476+0000","last_clean":"2024-02-17T00:36:43.830476+0000","last_became_active":"2024-02-17T00:36:37.035247+0000","last_became_peered":"2024-02-17T00:36:37.035247+0000","last_unstale":"2024-02-17T00:36:43.830476+0000","last_undegraded":"2024-02-17T00:36:43.830476+0000","last_fullsized":"2024-02-17T00:36:43.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068880+0000","last_change":"2024-02-17T00:36:42.107390+0000","last_active":"2024-02-17T00:36:43.068880+0000","last_peered":"2024-02-17T00:36:43.068880+0000","last_clean":"2024-02-17T00:36:43.068880+0000","last_became_active":"2024-02-17T00:36:42.106991+0000","last_became_peered":"2024-02-17T00:36:42.106991+0000","last_unstale":"2024-02-17T00:36:43.068880+0000","last_undegraded":"2024-02-17T00:36:43.068880+0000","last_fullsized":"2024-02-17T00:36:43.068880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831870+0000","last_change":"2024-02-17T00:36:38.056121+0000","last_active":"2024-02-17T00:36:43.831870+0000","last_peered":"2024-02-17T00:36:43.831870+0000","last_clean":"2024-02-17T00:36:43.831870+0000","last_became_active":"2024-02-17T00:36:38.055860+0000","last_became_peered":"2024-02-17T00:36:38.055860+0000","last_unstale":"2024-02-17T00:36:43.831870+0000","last_undegraded":"2024-02-17T00:36:43.831870+0000","last_fullsized":"2024-02-17T00:36:43.831870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832500+0000","last_change":"2024-02-17T00:36:37.038395+0000","last_active":"2024-02-17T00:36:43.832500+0000","last_peered":"2024-02-17T00:36:43.832500+0000","last_clean":"2024-02-17T00:36:43.832500+0000","last_became_active":"2024-02-17T00:36:37.038139+0000","last_became_peered":"2024-02-17T00:36:37.038139+0000","last_unstale":"2024-02-17T00:36:43.832500+0000","last_undegraded":"2024-02-17T00:36:43.832500+0000","last_fullsized":"2024-02-17T00:36:43.832500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:24.787386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068014+0000","last_change":"2024-02-17T00:36:42.106502+0000","last_active":"2024-02-17T00:36:43.068014+0000","last_peered":"2024-02-17T00:36:43.068014+0000","last_clean":"2024-02-17T00:36:43.068014+0000","last_became_active":"2024-02-17T00:36:42.104704+0000","last_became_peered":"2024-02-17T00:36:42.104704+0000","last_unstale":"2024-02-17T00:36:43.068014+0000","last_undegraded":"2024-02-17T00:36:43.068014+0000","last_fullsized":"2024-02-17T00:36:43.068014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831529+0000","last_change":"2024-02-17T00:36:38.047108+0000","last_active":"2024-02-17T00:36:43.831529+0000","last_peered":"2024-02-17T00:36:43.831529+0000","last_clean":"2024-02-17T00:36:43.831529+0000","last_became_active":"2024-02-17T00:36:38.046838+0000","last_became_peered":"2024-02-17T00:36:38.046838+0000","last_unstale":"2024-02-17T00:36:43.831529+0000","last_undegraded":"2024-02-17T00:36:43.831529+0000","last_fullsized":"2024-02-17T00:36:43.831529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832108+0000","last_change":"2024-02-17T00:36:37.029498+0000","last_active":"2024-02-17T00:36:43.832108+0000","last_peered":"2024-02-17T00:36:43.832108+0000","last_clean":"2024-02-17T00:36:43.832108+0000","last_became_active":"2024-02-17T00:36:37.029197+0000","last_became_peered":"2024-02-17T00:36:37.029197+0000","last_unstale":"2024-02-17T00:36:43.832108+0000","last_undegraded":"2024-02-17T00:36:43.832108+0000","last_fullsized":"2024-02-17T00:36:43.832108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831904+0000","last_change":"2024-02-17T00:36:42.107429+0000","last_active":"2024-02-17T00:36:43.831904+0000","last_peered":"2024-02-17T00:36:43.831904+0000","last_clean":"2024-02-17T00:36:43.831904+0000","last_became_active":"2024-02-17T00:36:42.105692+0000","last_became_peered":"2024-02-17T00:36:42.105692+0000","last_unstale":"2024-02-17T00:36:43.831904+0000","last_undegraded":"2024-02-17T00:36:43.831904+0000","last_fullsized":"2024-02-17T00:36:43.831904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:14.318951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832572+0000","last_change":"2024-02-17T00:36:38.049191+0000","last_active":"2024-02-17T00:36:43.832572+0000","last_peered":"2024-02-17T00:36:43.832572+0000","last_clean":"2024-02-17T00:36:43.832572+0000","last_became_active":"2024-02-17T00:36:38.048889+0000","last_became_peered":"2024-02-17T00:36:38.048889+0000","last_unstale":"2024-02-17T00:36:43.832572+0000","last_undegraded":"2024-02-17T00:36:43.832572+0000","last_fullsized":"2024-02-17T00:36:43.832572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:15.910845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832472+0000","last_change":"2024-02-17T00:36:37.034662+0000","last_active":"2024-02-17T00:36:43.832472+0000","last_peered":"2024-02-17T00:36:43.832472+0000","last_clean":"2024-02-17T00:36:43.832472+0000","last_became_active":"2024-02-17T00:36:37.034377+0000","last_became_peered":"2024-02-17T00:36:37.034377+0000","last_unstale":"2024-02-17T00:36:43.832472+0000","last_undegraded":"2024-02-17T00:36:43.832472+0000","last_fullsized":"2024-02-17T00:36:43.832472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:46.302658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832390+0000","last_change":"2024-02-17T00:36:42.102832+0000","last_active":"2024-02-17T00:36:43.832390+0000","last_peered":"2024-02-17T00:36:43.832390+0000","last_clean":"2024-02-17T00:36:43.832390+0000","last_became_active":"2024-02-17T00:36:42.102261+0000","last_became_peered":"2024-02-17T00:36:42.102261+0000","last_unstale":"2024-02-17T00:36:43.832390+0000","last_undegraded":"2024-02-17T00:36:43.832390+0000","last_fullsized":"2024-02-17T00:36:43.832390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:43.792084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068321+0000","last_change":"2024-02-17T00:36:38.040343+0000","last_active":"2024-02-17T00:36:43.068321+0000","last_peered":"2024-02-17T00:36:43.068321+0000","last_clean":"2024-02-17T00:36:43.068321+0000","last_became_active":"2024-02-17T00:36:38.039985+0000","last_became_peered":"2024-02-17T00:36:38.039985+0000","last_unstale":"2024-02-17T00:36:43.068321+0000","last_undegraded":"2024-02-17T00:36:43.068321+0000","last_fullsized":"2024-02-17T00:36:43.068321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096964+0000","last_change":"2024-02-17T00:36:37.031000+0000","last_active":"2024-02-17T00:36:43.096964+0000","last_peered":"2024-02-17T00:36:43.096964+0000","last_clean":"2024-02-17T00:36:43.096964+0000","last_became_active":"2024-02-17T00:36:37.028403+0000","last_became_peered":"2024-02-17T00:36:37.028403+0000","last_unstale":"2024-02-17T00:36:43.096964+0000","last_undegraded":"2024-02-17T00:36:43.096964+0000","last_fullsized":"2024-02-17T00:36:43.096964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831801+0000","last_change":"2024-02-17T00:36:42.106983+0000","last_active":"2024-02-17T00:36:43.831801+0000","last_peered":"2024-02-17T00:36:43.831801+0000","last_clean":"2024-02-17T00:36:43.831801+0000","last_became_active":"2024-02-17T00:36:42.106220+0000","last_became_peered":"2024-02-17T00:36:42.106220+0000","last_unstale":"2024-02-17T00:36:43.831801+0000","last_undegraded":"2024-02-17T00:36:43.831801+0000","last_fullsized":"2024-02-17T00:36:43.831801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:48.672826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831273+0000","last_change":"2024-02-17T00:36:38.064921+0000","last_active":"2024-02-17T00:36:43.831273+0000","last_peered":"2024-02-17T00:36:43.831273+0000","last_clean":"2024-02-17T00:36:43.831273+0000","last_became_active":"2024-02-17T00:36:38.064609+0000","last_became_peered":"2024-02-17T00:36:38.064609+0000","last_unstale":"2024-02-17T00:36:43.831273+0000","last_undegraded":"2024-02-17T00:36:43.831273+0000","last_fullsized":"2024-02-17T00:36:43.831273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831743+0000","last_change":"2024-02-17T00:36:37.027393+0000","last_active":"2024-02-17T00:36:43.831743+0000","last_peered":"2024-02-17T00:36:43.831743+0000","last_clean":"2024-02-17T00:36:43.831743+0000","last_became_active":"2024-02-17T00:36:37.027115+0000","last_became_peered":"2024-02-17T00:36:37.027115+0000","last_unstale":"2024-02-17T00:36:43.831743+0000","last_undegraded":"2024-02-17T00:36:43.831743+0000","last_fullsized":"2024-02-17T00:36:43.831743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:53.731912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832512+0000","last_change":"2024-02-17T00:36:42.104622+0000","last_active":"2024-02-17T00:36:43.832512+0000","last_peered":"2024-02-17T00:36:43.832512+0000","last_clean":"2024-02-17T00:36:43.832512+0000","last_became_active":"2024-02-17T00:36:42.104221+0000","last_became_peered":"2024-02-17T00:36:42.104221+0000","last_unstale":"2024-02-17T00:36:43.832512+0000","last_undegraded":"2024-02-17T00:36:43.832512+0000","last_fullsized":"2024-02-17T00:36:43.832512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096468+0000","last_change":"2024-02-17T00:36:38.059189+0000","last_active":"2024-02-17T00:36:43.096468+0000","last_peered":"2024-02-17T00:36:43.096468+0000","last_clean":"2024-02-17T00:36:43.096468+0000","last_became_active":"2024-02-17T00:36:38.058901+0000","last_became_peered":"2024-02-17T00:36:38.058901+0000","last_unstale":"2024-02-17T00:36:43.096468+0000","last_undegraded":"2024-02-17T00:36:43.096468+0000","last_fullsized":"2024-02-17T00:36:43.096468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068931+0000","last_change":"2024-02-17T00:36:37.030700+0000","last_active":"2024-02-17T00:36:43.068931+0000","last_peered":"2024-02-17T00:36:43.068931+0000","last_clean":"2024-02-17T00:36:43.068931+0000","last_became_active":"2024-02-17T00:36:37.030397+0000","last_became_peered":"2024-02-17T00:36:37.030397+0000","last_unstale":"2024-02-17T00:36:43.068931+0000","last_undegraded":"2024-02-17T00:36:43.068931+0000","last_fullsized":"2024-02-17T00:36:43.068931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:43:05.382965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832374+0000","last_change":"2024-02-17T00:36:42.107289+0000","last_active":"2024-02-17T00:36:43.832374+0000","last_peered":"2024-02-17T00:36:43.832374+0000","last_clean":"2024-02-17T00:36:43.832374+0000","last_became_active":"2024-02-17T00:36:42.106838+0000","last_became_peered":"2024-02-17T00:36:42.106838+0000","last_unstale":"2024-02-17T00:36:43.832374+0000","last_undegraded":"2024-02-17T00:36:43.832374+0000","last_fullsized":"2024-02-17T00:36:43.832374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831254+0000","last_change":"2024-02-17T00:36:38.040509+0000","last_active":"2024-02-17T00:36:43.831254+0000","last_peered":"2024-02-17T00:36:43.831254+0000","last_clean":"2024-02-17T00:36:43.831254+0000","last_became_active":"2024-02-17T00:36:38.040220+0000","last_became_peered":"2024-02-17T00:36:38.040220+0000","last_unstale":"2024-02-17T00:36:43.831254+0000","last_undegraded":"2024-02-17T00:36:43.831254+0000","last_fullsized":"2024-02-17T00:36:43.831254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:46.688568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831090+0000","last_change":"2024-02-17T00:36:37.029628+0000","last_active":"2024-02-17T00:36:43.831090+0000","last_peered":"2024-02-17T00:36:43.831090+0000","last_clean":"2024-02-17T00:36:43.831090+0000","last_became_active":"2024-02-17T00:36:37.029322+0000","last_became_peered":"2024-02-17T00:36:37.029322+0000","last_unstale":"2024-02-17T00:36:43.831090+0000","last_undegraded":"2024-02-17T00:36:43.831090+0000","last_fullsized":"2024-02-17T00:36:43.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:29.219599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097224+0000","last_change":"2024-02-17T00:36:42.110170+0000","last_active":"2024-02-17T00:36:43.097224+0000","last_peered":"2024-02-17T00:36:43.097224+0000","last_clean":"2024-02-17T00:36:43.097224+0000","last_became_active":"2024-02-17T00:36:42.109713+0000","last_became_peered":"2024-02-17T00:36:42.109713+0000","last_unstale":"2024-02-17T00:36:43.097224+0000","last_undegraded":"2024-02-17T00:36:43.097224+0000","last_fullsized":"2024-02-17T00:36:43.097224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:57:07.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831262+0000","last_change":"2024-02-17T00:36:38.041003+0000","last_active":"2024-02-17T00:36:43.831262+0000","last_peered":"2024-02-17T00:36:43.831262+0000","last_clean":"2024-02-17T00:36:43.831262+0000","last_became_active":"2024-02-17T00:36:38.040700+0000","last_became_peered":"2024-02-17T00:36:38.040700+0000","last_unstale":"2024-02-17T00:36:43.831262+0000","last_undegraded":"2024-02-17T00:36:43.831262+0000","last_fullsized":"2024-02-17T00:36:43.831262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:15:02.009972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831922+0000","last_change":"2024-02-17T00:36:37.027694+0000","last_active":"2024-02-17T00:36:43.831922+0000","last_peered":"2024-02-17T00:36:43.831922+0000","last_clean":"2024-02-17T00:36:43.831922+0000","last_became_active":"2024-02-17T00:36:37.027061+0000","last_became_peered":"2024-02-17T00:36:37.027061+0000","last_unstale":"2024-02-17T00:36:43.831922+0000","last_undegraded":"2024-02-17T00:36:43.831922+0000","last_fullsized":"2024-02-17T00:36:43.831922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:26.541012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069046+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:36:43.069046+0000","last_peered":"2024-02-17T00:36:43.069046+0000","last_clean":"2024-02-17T00:36:43.069046+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:36:43.069046+0000","last_undegraded":"2024-02-17T00:36:43.069046+0000","last_fullsized":"2024-02-17T00:36:43.069046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832461+0000","last_change":"2024-02-17T00:36:42.105550+0000","last_active":"2024-02-17T00:36:43.832461+0000","last_peered":"2024-02-17T00:36:43.832461+0000","last_clean":"2024-02-17T00:36:43.832461+0000","last_became_active":"2024-02-17T00:36:42.105076+0000","last_became_peered":"2024-02-17T00:36:42.105076+0000","last_unstale":"2024-02-17T00:36:43.832461+0000","last_undegraded":"2024-02-17T00:36:43.832461+0000","last_fullsized":"2024-02-17T00:36:43.832461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:06:27.497749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832306+0000","last_change":"2024-02-17T00:36:38.045045+0000","last_active":"2024-02-17T00:36:43.832306+0000","last_peered":"2024-02-17T00:36:43.832306+0000","last_clean":"2024-02-17T00:36:43.832306+0000","last_became_active":"2024-02-17T00:36:38.044771+0000","last_became_peered":"2024-02-17T00:36:38.044771+0000","last_unstale":"2024-02-17T00:36:43.832306+0000","last_undegraded":"2024-02-17T00:36:43.832306+0000","last_fullsized":"2024-02-17T00:36:43.832306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:37.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832582+0000","last_change":"2024-02-17T00:36:37.032742+0000","last_active":"2024-02-17T00:36:43.832582+0000","last_peered":"2024-02-17T00:36:43.832582+0000","last_clean":"2024-02-17T00:36:43.832582+0000","last_became_active":"2024-02-17T00:36:37.032468+0000","last_became_peered":"2024-02-17T00:36:37.032468+0000","last_unstale":"2024-02-17T00:36:43.832582+0000","last_undegraded":"2024-02-17T00:36:43.832582+0000","last_fullsized":"2024-02-17T00:36:43.832582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:57.570983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068115+0000","last_change":"2024-02-17T00:36:42.103839+0000","last_active":"2024-02-17T00:36:43.068115+0000","last_peered":"2024-02-17T00:36:43.068115+0000","last_clean":"2024-02-17T00:36:43.068115+0000","last_became_active":"2024-02-17T00:36:42.103440+0000","last_became_peered":"2024-02-17T00:36:42.103440+0000","last_unstale":"2024-02-17T00:36:43.068115+0000","last_undegraded":"2024-02-17T00:36:43.068115+0000","last_fullsized":"2024-02-17T00:36:43.068115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:39.617957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831939+0000","last_change":"2024-02-17T00:36:38.062320+0000","last_active":"2024-02-17T00:36:43.831939+0000","last_peered":"2024-02-17T00:36:43.831939+0000","last_clean":"2024-02-17T00:36:43.831939+0000","last_became_active":"2024-02-17T00:36:38.062072+0000","last_became_peered":"2024-02-17T00:36:38.062072+0000","last_unstale":"2024-02-17T00:36:43.831939+0000","last_undegraded":"2024-02-17T00:36:43.831939+0000","last_fullsized":"2024-02-17T00:36:43.831939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097214+0000","last_change":"2024-02-17T00:36:37.027607+0000","last_active":"2024-02-17T00:36:43.097214+0000","last_peered":"2024-02-17T00:36:43.097214+0000","last_clean":"2024-02-17T00:36:43.097214+0000","last_became_active":"2024-02-17T00:36:37.025882+0000","last_became_peered":"2024-02-17T00:36:37.025882+0000","last_unstale":"2024-02-17T00:36:43.097214+0000","last_undegraded":"2024-02-17T00:36:43.097214+0000","last_fullsized":"2024-02-17T00:36:43.097214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096933+0000","last_change":"2024-02-17T00:36:42.108808+0000","last_active":"2024-02-17T00:36:43.096933+0000","last_peered":"2024-02-17T00:36:43.096933+0000","last_clean":"2024-02-17T00:36:43.096933+0000","last_became_active":"2024-02-17T00:36:42.108343+0000","last_became_peered":"2024-02-17T00:36:42.108343+0000","last_unstale":"2024-02-17T00:36:43.096933+0000","last_undegraded":"2024-02-17T00:36:43.096933+0000","last_fullsized":"2024-02-17T00:36:43.096933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:08:01.687705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831483+0000","last_change":"2024-02-17T00:36:38.059195+0000","last_active":"2024-02-17T00:36:43.831483+0000","last_peered":"2024-02-17T00:36:43.831483+0000","last_clean":"2024-02-17T00:36:43.831483+0000","last_became_active":"2024-02-17T00:36:38.058923+0000","last_became_peered":"2024-02-17T00:36:38.058923+0000","last_unstale":"2024-02-17T00:36:43.831483+0000","last_undegraded":"2024-02-17T00:36:43.831483+0000","last_fullsized":"2024-02-17T00:36:43.831483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831998+0000","last_change":"2024-02-17T00:36:37.030669+0000","last_active":"2024-02-17T00:36:43.831998+0000","last_peered":"2024-02-17T00:36:43.831998+0000","last_clean":"2024-02-17T00:36:43.831998+0000","last_became_active":"2024-02-17T00:36:37.029671+0000","last_became_peered":"2024-02-17T00:36:37.029671+0000","last_unstale":"2024-02-17T00:36:43.831998+0000","last_undegraded":"2024-02-17T00:36:43.831998+0000","last_fullsized":"2024-02-17T00:36:43.831998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830669+0000","last_change":"2024-02-17T00:36:42.106377+0000","last_active":"2024-02-17T00:36:43.830669+0000","last_peered":"2024-02-17T00:36:43.830669+0000","last_clean":"2024-02-17T00:36:43.830669+0000","last_became_active":"2024-02-17T00:36:42.105980+0000","last_became_peered":"2024-02-17T00:36:42.105980+0000","last_unstale":"2024-02-17T00:36:43.830669+0000","last_undegraded":"2024-02-17T00:36:43.830669+0000","last_fullsized":"2024-02-17T00:36:43.830669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:14:16.476031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069144+0000","last_change":"2024-02-17T00:36:38.056738+0000","last_active":"2024-02-17T00:36:43.069144+0000","last_peered":"2024-02-17T00:36:43.069144+0000","last_clean":"2024-02-17T00:36:43.069144+0000","last_became_active":"2024-02-17T00:36:38.056342+0000","last_became_peered":"2024-02-17T00:36:38.056342+0000","last_unstale":"2024-02-17T00:36:43.069144+0000","last_undegraded":"2024-02-17T00:36:43.069144+0000","last_fullsized":"2024-02-17T00:36:43.069144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831546+0000","last_change":"2024-02-17T00:36:37.037085+0000","last_active":"2024-02-17T00:36:43.831546+0000","last_peered":"2024-02-17T00:36:43.831546+0000","last_clean":"2024-02-17T00:36:43.831546+0000","last_became_active":"2024-02-17T00:36:37.036719+0000","last_became_peered":"2024-02-17T00:36:37.036719+0000","last_unstale":"2024-02-17T00:36:43.831546+0000","last_undegraded":"2024-02-17T00:36:43.831546+0000","last_fullsized":"2024-02-17T00:36:43.831546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069663+0000","last_change":"2024-02-17T00:36:42.109922+0000","last_active":"2024-02-17T00:36:43.069663+0000","last_peered":"2024-02-17T00:36:43.069663+0000","last_clean":"2024-02-17T00:36:43.069663+0000","last_became_active":"2024-02-17T00:36:42.109554+0000","last_became_peered":"2024-02-17T00:36:42.109554+0000","last_unstale":"2024-02-17T00:36:43.069663+0000","last_undegraded":"2024-02-17T00:36:43.069663+0000","last_fullsized":"2024-02-17T00:36:43.069663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:14.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:38.039174+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:38.038826+0000","last_became_peered":"2024-02-17T00:36:38.038826+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831131+0000","last_change":"2024-02-17T00:36:37.026636+0000","last_active":"2024-02-17T00:36:43.831131+0000","last_peered":"2024-02-17T00:36:43.831131+0000","last_clean":"2024-02-17T00:36:43.831131+0000","last_became_active":"2024-02-17T00:36:37.026356+0000","last_became_peered":"2024-02-17T00:36:37.026356+0000","last_unstale":"2024-02-17T00:36:43.831131+0000","last_undegraded":"2024-02-17T00:36:43.831131+0000","last_fullsized":"2024-02-17T00:36:43.831131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:21:00.065522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097409+0000","last_change":"2024-02-17T00:36:42.109160+0000","last_active":"2024-02-17T00:36:43.097409+0000","last_peered":"2024-02-17T00:36:43.097409+0000","last_clean":"2024-02-17T00:36:43.097409+0000","last_became_active":"2024-02-17T00:36:42.108726+0000","last_became_peered":"2024-02-17T00:36:42.108726+0000","last_unstale":"2024-02-17T00:36:43.097409+0000","last_undegraded":"2024-02-17T00:36:43.097409+0000","last_fullsized":"2024-02-17T00:36:43.097409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:09:41.664699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068896+0000","last_change":"2024-02-17T00:36:38.050032+0000","last_active":"2024-02-17T00:36:43.068896+0000","last_peered":"2024-02-17T00:36:43.068896+0000","last_clean":"2024-02-17T00:36:43.068896+0000","last_became_active":"2024-02-17T00:36:38.049764+0000","last_became_peered":"2024-02-17T00:36:38.049764+0000","last_unstale":"2024-02-17T00:36:43.068896+0000","last_undegraded":"2024-02-17T00:36:43.068896+0000","last_fullsized":"2024-02-17T00:36:43.068896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:04.316331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830633+0000","last_change":"2024-02-17T00:36:37.039587+0000","last_active":"2024-02-17T00:36:43.830633+0000","last_peered":"2024-02-17T00:36:43.830633+0000","last_clean":"2024-02-17T00:36:43.830633+0000","last_became_active":"2024-02-17T00:36:37.039306+0000","last_became_peered":"2024-02-17T00:36:37.039306+0000","last_unstale":"2024-02-17T00:36:43.830633+0000","last_undegraded":"2024-02-17T00:36:43.830633+0000","last_fullsized":"2024-02-17T00:36:43.830633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:03.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097441+0000","last_change":"2024-02-17T00:36:42.110028+0000","last_active":"2024-02-17T00:36:43.097441+0000","last_peered":"2024-02-17T00:36:43.097441+0000","last_clean":"2024-02-17T00:36:43.097441+0000","last_became_active":"2024-02-17T00:36:42.109169+0000","last_became_peered":"2024-02-17T00:36:42.109169+0000","last_unstale":"2024-02-17T00:36:43.097441+0000","last_undegraded":"2024-02-17T00:36:43.097441+0000","last_fullsized":"2024-02-17T00:36:43.097441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:50.471622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831820+0000","last_change":"2024-02-17T00:36:38.058168+0000","last_active":"2024-02-17T00:36:43.831820+0000","last_peered":"2024-02-17T00:36:43.831820+0000","last_clean":"2024-02-17T00:36:43.831820+0000","last_became_active":"2024-02-17T00:36:38.057867+0000","last_became_peered":"2024-02-17T00:36:38.057867+0000","last_unstale":"2024-02-17T00:36:43.831820+0000","last_undegraded":"2024-02-17T00:36:43.831820+0000","last_fullsized":"2024-02-17T00:36:43.831820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:03:31.843189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831661+0000","last_change":"2024-02-17T00:36:37.033408+0000","last_active":"2024-02-17T00:36:43.831661+0000","last_peered":"2024-02-17T00:36:43.831661+0000","last_clean":"2024-02-17T00:36:43.831661+0000","last_became_active":"2024-02-17T00:36:37.031691+0000","last_became_peered":"2024-02-17T00:36:37.031691+0000","last_unstale":"2024-02-17T00:36:43.831661+0000","last_undegraded":"2024-02-17T00:36:43.831661+0000","last_fullsized":"2024-02-17T00:36:43.831661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:09.449647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832315+0000","last_change":"2024-02-17T00:36:42.105315+0000","last_active":"2024-02-17T00:36:43.832315+0000","last_peered":"2024-02-17T00:36:43.832315+0000","last_clean":"2024-02-17T00:36:43.832315+0000","last_became_active":"2024-02-17T00:36:42.104846+0000","last_became_peered":"2024-02-17T00:36:42.104846+0000","last_unstale":"2024-02-17T00:36:43.832315+0000","last_undegraded":"2024-02-17T00:36:43.832315+0000","last_fullsized":"2024-02-17T00:36:43.832315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:57.249859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831976+0000","last_change":"2024-02-17T00:36:38.038475+0000","last_active":"2024-02-17T00:36:43.831976+0000","last_peered":"2024-02-17T00:36:43.831976+0000","last_clean":"2024-02-17T00:36:43.831976+0000","last_became_active":"2024-02-17T00:36:38.038146+0000","last_became_peered":"2024-02-17T00:36:38.038146+0000","last_unstale":"2024-02-17T00:36:43.831976+0000","last_undegraded":"2024-02-17T00:36:43.831976+0000","last_fullsized":"2024-02-17T00:36:43.831976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069341+0000","last_change":"2024-02-17T00:36:37.035415+0000","last_active":"2024-02-17T00:36:43.069341+0000","last_peered":"2024-02-17T00:36:43.069341+0000","last_clean":"2024-02-17T00:36:43.069341+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.069341+0000","last_undegraded":"2024-02-17T00:36:43.069341+0000","last_fullsized":"2024-02-17T00:36:43.069341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:57:22.735661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832312+0000","last_change":"2024-02-17T00:36:42.102660+0000","last_active":"2024-02-17T00:36:43.832312+0000","last_peered":"2024-02-17T00:36:43.832312+0000","last_clean":"2024-02-17T00:36:43.832312+0000","last_became_active":"2024-02-17T00:36:42.102164+0000","last_became_peered":"2024-02-17T00:36:42.102164+0000","last_unstale":"2024-02-17T00:36:43.832312+0000","last_undegraded":"2024-02-17T00:36:43.832312+0000","last_fullsized":"2024-02-17T00:36:43.832312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:22:56.783330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830955+0000","last_change":"2024-02-17T00:36:38.051782+0000","last_active":"2024-02-17T00:36:43.830955+0000","last_peered":"2024-02-17T00:36:43.830955+0000","last_clean":"2024-02-17T00:36:43.830955+0000","last_became_active":"2024-02-17T00:36:38.051484+0000","last_became_peered":"2024-02-17T00:36:38.051484+0000","last_unstale":"2024-02-17T00:36:43.830955+0000","last_undegraded":"2024-02-17T00:36:43.830955+0000","last_fullsized":"2024-02-17T00:36:43.830955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:47.435702+0000","last_change":"2024-02-17T00:36:37.024838+0000","last_active":"2024-02-17T00:36:47.435702+0000","last_peered":"2024-02-17T00:36:47.435702+0000","last_clean":"2024-02-17T00:36:47.435702+0000","last_became_active":"2024-02-17T00:36:37.024507+0000","last_became_peered":"2024-02-17T00:36:37.024507+0000","last_unstale":"2024-02-17T00:36:47.435702+0000","last_undegraded":"2024-02-17T00:36:47.435702+0000","last_fullsized":"2024-02-17T00:36:47.435702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832019+0000","last_change":"2024-02-17T00:36:42.108161+0000","last_active":"2024-02-17T00:36:43.832019+0000","last_peered":"2024-02-17T00:36:43.832019+0000","last_clean":"2024-02-17T00:36:43.832019+0000","last_became_active":"2024-02-17T00:36:42.107414+0000","last_became_peered":"2024-02-17T00:36:42.107414+0000","last_unstale":"2024-02-17T00:36:43.832019+0000","last_undegraded":"2024-02-17T00:36:43.832019+0000","last_fullsized":"2024-02-17T00:36:43.832019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:47:44.381216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831001+0000","last_change":"2024-02-17T00:36:38.040658+0000","last_active":"2024-02-17T00:36:43.831001+0000","last_peered":"2024-02-17T00:36:43.831001+0000","last_clean":"2024-02-17T00:36:43.831001+0000","last_became_active":"2024-02-17T00:36:38.040361+0000","last_became_peered":"2024-02-17T00:36:38.040361+0000","last_unstale":"2024-02-17T00:36:43.831001+0000","last_undegraded":"2024-02-17T00:36:43.831001+0000","last_fullsized":"2024-02-17T00:36:43.831001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069426+0000","last_change":"2024-02-17T00:36:37.030364+0000","last_active":"2024-02-17T00:36:43.069426+0000","last_peered":"2024-02-17T00:36:43.069426+0000","last_clean":"2024-02-17T00:36:43.069426+0000","last_became_active":"2024-02-17T00:36:37.030047+0000","last_became_peered":"2024-02-17T00:36:37.030047+0000","last_unstale":"2024-02-17T00:36:43.069426+0000","last_undegraded":"2024-02-17T00:36:43.069426+0000","last_fullsized":"2024-02-17T00:36:43.069426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:26:31.440572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068488+0000","last_change":"2024-02-17T00:36:42.109162+0000","last_active":"2024-02-17T00:36:43.068488+0000","last_peered":"2024-02-17T00:36:43.068488+0000","last_clean":"2024-02-17T00:36:43.068488+0000","last_became_active":"2024-02-17T00:36:42.107077+0000","last_became_peered":"2024-02-17T00:36:42.107077+0000","last_unstale":"2024-02-17T00:36:43.068488+0000","last_undegraded":"2024-02-17T00:36:43.068488+0000","last_fullsized":"2024-02-17T00:36:43.068488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097502+0000","last_change":"2024-02-17T00:36:38.044311+0000","last_active":"2024-02-17T00:36:43.097502+0000","last_peered":"2024-02-17T00:36:43.097502+0000","last_clean":"2024-02-17T00:36:43.097502+0000","last_became_active":"2024-02-17T00:36:38.044043+0000","last_became_peered":"2024-02-17T00:36:38.044043+0000","last_unstale":"2024-02-17T00:36:43.097502+0000","last_undegraded":"2024-02-17T00:36:43.097502+0000","last_fullsized":"2024-02-17T00:36:43.097502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831305+0000","last_change":"2024-02-17T00:36:37.035871+0000","last_active":"2024-02-17T00:36:43.831305+0000","last_peered":"2024-02-17T00:36:43.831305+0000","last_clean":"2024-02-17T00:36:43.831305+0000","last_became_active":"2024-02-17T00:36:37.035171+0000","last_became_peered":"2024-02-17T00:36:37.035171+0000","last_unstale":"2024-02-17T00:36:43.831305+0000","last_undegraded":"2024-02-17T00:36:43.831305+0000","last_fullsized":"2024-02-17T00:36:43.831305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:41:01.804667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068707+0000","last_change":"2024-02-17T00:36:42.111490+0000","last_active":"2024-02-17T00:36:43.068707+0000","last_peered":"2024-02-17T00:36:43.068707+0000","last_clean":"2024-02-17T00:36:43.068707+0000","last_became_active":"2024-02-17T00:36:42.110829+0000","last_became_peered":"2024-02-17T00:36:42.110829+0000","last_unstale":"2024-02-17T00:36:43.068707+0000","last_undegraded":"2024-02-17T00:36:43.068707+0000","last_fullsized":"2024-02-17T00:36:43.068707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:23:34.160962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068936+0000","last_change":"2024-02-17T00:36:38.035374+0000","last_active":"2024-02-17T00:36:43.068936+0000","last_peered":"2024-02-17T00:36:43.068936+0000","last_clean":"2024-02-17T00:36:43.068936+0000","last_became_active":"2024-02-17T00:36:38.035048+0000","last_became_peered":"2024-02-17T00:36:38.035048+0000","last_unstale":"2024-02-17T00:36:43.068936+0000","last_undegraded":"2024-02-17T00:36:43.068936+0000","last_fullsized":"2024-02-17T00:36:43.068936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:10.454283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070032+0000","last_change":"2024-02-17T00:36:37.028771+0000","last_active":"2024-02-17T00:36:43.070032+0000","last_peered":"2024-02-17T00:36:43.070032+0000","last_clean":"2024-02-17T00:36:43.070032+0000","last_became_active":"2024-02-17T00:36:37.028466+0000","last_became_peered":"2024-02-17T00:36:37.028466+0000","last_unstale":"2024-02-17T00:36:43.070032+0000","last_undegraded":"2024-02-17T00:36:43.070032+0000","last_fullsized":"2024-02-17T00:36:43.070032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:53:06.530335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831980+0000","last_change":"2024-02-17T00:36:42.102858+0000","last_active":"2024-02-17T00:36:43.831980+0000","last_peered":"2024-02-17T00:36:43.831980+0000","last_clean":"2024-02-17T00:36:43.831980+0000","last_became_active":"2024-02-17T00:36:42.102467+0000","last_became_peered":"2024-02-17T00:36:42.102467+0000","last_unstale":"2024-02-17T00:36:43.831980+0000","last_undegraded":"2024-02-17T00:36:43.831980+0000","last_fullsized":"2024-02-17T00:36:43.831980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:16.339508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831808+0000","last_change":"2024-02-17T00:36:42.107030+0000","last_active":"2024-02-17T00:36:43.831808+0000","last_peered":"2024-02-17T00:36:43.831808+0000","last_clean":"2024-02-17T00:36:43.831808+0000","last_became_active":"2024-02-17T00:36:42.106372+0000","last_became_peered":"2024-02-17T00:36:42.106372+0000","last_unstale":"2024-02-17T00:36:43.831808+0000","last_undegraded":"2024-02-17T00:36:43.831808+0000","last_fullsized":"2024-02-17T00:36:43.831808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:34.714004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831130+0000","last_change":"2024-02-17T00:36:38.044613+0000","last_active":"2024-02-17T00:36:43.831130+0000","last_peered":"2024-02-17T00:36:43.831130+0000","last_clean":"2024-02-17T00:36:43.831130+0000","last_became_active":"2024-02-17T00:36:38.043593+0000","last_became_peered":"2024-02-17T00:36:38.043593+0000","last_unstale":"2024-02-17T00:36:43.831130+0000","last_undegraded":"2024-02-17T00:36:43.831130+0000","last_fullsized":"2024-02-17T00:36:43.831130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830995+0000","last_change":"2024-02-17T00:36:37.022022+0000","last_active":"2024-02-17T00:36:43.830995+0000","last_peered":"2024-02-17T00:36:43.830995+0000","last_clean":"2024-02-17T00:36:43.830995+0000","last_became_active":"2024-02-17T00:36:37.021271+0000","last_became_peered":"2024-02-17T00:36:37.021271+0000","last_unstale":"2024-02-17T00:36:43.830995+0000","last_undegraded":"2024-02-17T00:36:43.830995+0000","last_fullsized":"2024-02-17T00:36:43.830995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:25:45.683932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832391+0000","last_change":"2024-02-17T00:36:42.105409+0000","last_active":"2024-02-17T00:36:43.832391+0000","last_peered":"2024-02-17T00:36:43.832391+0000","last_clean":"2024-02-17T00:36:43.832391+0000","last_became_active":"2024-02-17T00:36:42.104989+0000","last_became_peered":"2024-02-17T00:36:42.104989+0000","last_unstale":"2024-02-17T00:36:43.832391+0000","last_undegraded":"2024-02-17T00:36:43.832391+0000","last_fullsized":"2024-02-17T00:36:43.832391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:41.477918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096723+0000","last_change":"2024-02-17T00:36:38.052345+0000","last_active":"2024-02-17T00:36:43.096723+0000","last_peered":"2024-02-17T00:36:43.096723+0000","last_clean":"2024-02-17T00:36:43.096723+0000","last_became_active":"2024-02-17T00:36:38.052051+0000","last_became_peered":"2024-02-17T00:36:38.052051+0000","last_unstale":"2024-02-17T00:36:43.096723+0000","last_undegraded":"2024-02-17T00:36:43.096723+0000","last_fullsized":"2024-02-17T00:36:43.096723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:18:10.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831372+0000","last_change":"2024-02-17T00:36:37.032305+0000","last_active":"2024-02-17T00:36:43.831372+0000","last_peered":"2024-02-17T00:36:43.831372+0000","last_clean":"2024-02-17T00:36:43.831372+0000","last_became_active":"2024-02-17T00:36:37.031977+0000","last_became_peered":"2024-02-17T00:36:37.031977+0000","last_unstale":"2024-02-17T00:36:43.831372+0000","last_undegraded":"2024-02-17T00:36:43.831372+0000","last_fullsized":"2024-02-17T00:36:43.831372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:45.670660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831564+0000","last_change":"2024-02-17T00:36:37.037062+0000","last_active":"2024-02-17T00:36:43.831564+0000","last_peered":"2024-02-17T00:36:43.831564+0000","last_clean":"2024-02-17T00:36:43.831564+0000","last_became_active":"2024-02-17T00:36:37.036814+0000","last_became_peered":"2024-02-17T00:36:37.036814+0000","last_unstale":"2024-02-17T00:36:43.831564+0000","last_undegraded":"2024-02-17T00:36:43.831564+0000","last_fullsized":"2024-02-17T00:36:43.831564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:24.669903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831622+0000","last_change":"2024-02-17T00:36:38.055091+0000","last_active":"2024-02-17T00:36:43.831622+0000","last_peered":"2024-02-17T00:36:43.831622+0000","last_clean":"2024-02-17T00:36:43.831622+0000","last_became_active":"2024-02-17T00:36:38.054773+0000","last_became_peered":"2024-02-17T00:36:38.054773+0000","last_unstale":"2024-02-17T00:36:43.831622+0000","last_undegraded":"2024-02-17T00:36:43.831622+0000","last_fullsized":"2024-02-17T00:36:43.831622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831612+0000","last_change":"2024-02-17T00:36:42.103625+0000","last_active":"2024-02-17T00:36:43.831612+0000","last_peered":"2024-02-17T00:36:43.831612+0000","last_clean":"2024-02-17T00:36:43.831612+0000","last_became_active":"2024-02-17T00:36:42.103248+0000","last_became_peered":"2024-02-17T00:36:42.103248+0000","last_unstale":"2024-02-17T00:36:43.831612+0000","last_undegraded":"2024-02-17T00:36:43.831612+0000","last_fullsized":"2024-02-17T00:36:43.831612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:12.189883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096932+0000","last_change":"2024-02-17T00:36:37.030983+0000","last_active":"2024-02-17T00:36:43.096932+0000","last_peered":"2024-02-17T00:36:43.096932+0000","last_clean":"2024-02-17T00:36:43.096932+0000","last_became_active":"2024-02-17T00:36:37.028330+0000","last_became_peered":"2024-02-17T00:36:37.028330+0000","last_unstale":"2024-02-17T00:36:43.096932+0000","last_undegraded":"2024-02-17T00:36:43.096932+0000","last_fullsized":"2024-02-17T00:36:43.096932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:36.003448+0000","last_clean_scrub_stamp":"2024-02-17T00:36:36.003448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:46:44.620517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069391+0000","last_change":"2024-02-17T00:36:38.049295+0000","last_active":"2024-02-17T00:36:43.069391+0000","last_peered":"2024-02-17T00:36:43.069391+0000","last_clean":"2024-02-17T00:36:43.069391+0000","last_became_active":"2024-02-17T00:36:38.048946+0000","last_became_peered":"2024-02-17T00:36:38.048946+0000","last_unstale":"2024-02-17T00:36:43.069391+0000","last_undegraded":"2024-02-17T00:36:43.069391+0000","last_fullsized":"2024-02-17T00:36:43.069391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069192+0000","last_change":"2024-02-17T00:36:42.105857+0000","last_active":"2024-02-17T00:36:43.069192+0000","last_peered":"2024-02-17T00:36:43.069192+0000","last_clean":"2024-02-17T00:36:43.069192+0000","last_became_active":"2024-02-17T00:36:42.105256+0000","last_became_peered":"2024-02-17T00:36:42.105256+0000","last_unstale":"2024-02-17T00:36:43.069192+0000","last_undegraded":"2024-02-17T00:36:43.069192+0000","last_fullsized":"2024-02-17T00:36:43.069192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:41.051361+0000","last_clean_scrub_stamp":"2024-02-17T00:36:41.051361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:00:11.474820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068081+0000","last_change":"2024-02-17T00:36:38.040290+0000","last_active":"2024-02-17T00:36:43.068081+0000","last_peered":"2024-02-17T00:36:43.068081+0000","last_clean":"2024-02-17T00:36:43.068081+0000","last_became_active":"2024-02-17T00:36:38.039955+0000","last_became_peered":"2024-02-17T00:36:38.039955+0000","last_unstale":"2024-02-17T00:36:43.068081+0000","last_undegraded":"2024-02-17T00:36:43.068081+0000","last_fullsized":"2024-02-17T00:36:43.068081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:18:25.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068817+0000","last_change":"2024-02-17T00:36:38.056307+0000","last_active":"2024-02-17T00:36:43.068817+0000","last_peered":"2024-02-17T00:36:43.068817+0000","last_clean":"2024-02-17T00:36:43.068817+0000","last_became_active":"2024-02-17T00:36:38.055992+0000","last_became_peered":"2024-02-17T00:36:38.055992+0000","last_unstale":"2024-02-17T00:36:43.068817+0000","last_undegraded":"2024-02-17T00:36:43.068817+0000","last_fullsized":"2024-02-17T00:36:43.068817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:56:01.530703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831314+0000","last_change":"2024-02-17T00:36:38.043893+0000","last_active":"2024-02-17T00:36:43.831314+0000","last_peered":"2024-02-17T00:36:43.831314+0000","last_clean":"2024-02-17T00:36:43.831314+0000","last_became_active":"2024-02-17T00:36:38.043507+0000","last_became_peered":"2024-02-17T00:36:38.043507+0000","last_unstale":"2024-02-17T00:36:43.831314+0000","last_undegraded":"2024-02-17T00:36:43.831314+0000","last_fullsized":"2024-02-17T00:36:43.831314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:57:48.954988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096825+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.096825+0000","last_peered":"2024-02-17T00:36:43.096825+0000","last_clean":"2024-02-17T00:36:43.096825+0000","last_became_active":"2024-02-17T00:36:38.057544+0000","last_became_peered":"2024-02-17T00:36:38.057544+0000","last_unstale":"2024-02-17T00:36:43.096825+0000","last_undegraded":"2024-02-17T00:36:43.096825+0000","last_fullsized":"2024-02-17T00:36:43.096825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832520+0000","last_change":"2024-02-17T00:36:38.054267+0000","last_active":"2024-02-17T00:36:43.832520+0000","last_peered":"2024-02-17T00:36:43.832520+0000","last_clean":"2024-02-17T00:36:43.832520+0000","last_became_active":"2024-02-17T00:36:38.053966+0000","last_became_peered":"2024-02-17T00:36:38.053966+0000","last_unstale":"2024-02-17T00:36:43.832520+0000","last_undegraded":"2024-02-17T00:36:43.832520+0000","last_fullsized":"2024-02-17T00:36:43.832520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:38:47.347423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831587+0000","last_change":"2024-02-17T00:36:38.056442+0000","last_active":"2024-02-17T00:36:43.831587+0000","last_peered":"2024-02-17T00:36:43.831587+0000","last_clean":"2024-02-17T00:36:43.831587+0000","last_became_active":"2024-02-17T00:36:38.056049+0000","last_became_peered":"2024-02-17T00:36:38.056049+0000","last_unstale":"2024-02-17T00:36:43.831587+0000","last_undegraded":"2024-02-17T00:36:43.831587+0000","last_fullsized":"2024-02-17T00:36:43.831587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:15:30.224236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068812+0000","last_change":"2024-02-17T00:36:38.036181+0000","last_active":"2024-02-17T00:36:43.068812+0000","last_peered":"2024-02-17T00:36:43.068812+0000","last_clean":"2024-02-17T00:36:43.068812+0000","last_became_active":"2024-02-17T00:36:38.035881+0000","last_became_peered":"2024-02-17T00:36:38.035881+0000","last_unstale":"2024-02-17T00:36:43.068812+0000","last_undegraded":"2024-02-17T00:36:43.068812+0000","last_fullsized":"2024-02-17T00:36:43.068812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097279+0000","last_change":"2024-02-17T00:36:38.049793+0000","last_active":"2024-02-17T00:36:43.097279+0000","last_peered":"2024-02-17T00:36:43.097279+0000","last_clean":"2024-02-17T00:36:43.097279+0000","last_became_active":"2024-02-17T00:36:38.049216+0000","last_became_peered":"2024-02-17T00:36:38.049216+0000","last_unstale":"2024-02-17T00:36:43.097279+0000","last_undegraded":"2024-02-17T00:36:43.097279+0000","last_fullsized":"2024-02-17T00:36:43.097279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830904+0000","last_change":"2024-02-17T00:36:38.047085+0000","last_active":"2024-02-17T00:36:43.830904+0000","last_peered":"2024-02-17T00:36:43.830904+0000","last_clean":"2024-02-17T00:36:43.830904+0000","last_became_active":"2024-02-17T00:36:38.046375+0000","last_became_peered":"2024-02-17T00:36:38.046375+0000","last_unstale":"2024-02-17T00:36:43.830904+0000","last_undegraded":"2024-02-17T00:36:43.830904+0000","last_fullsized":"2024-02-17T00:36:43.830904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096697+0000","last_change":"2024-02-17T00:36:38.054777+0000","last_active":"2024-02-17T00:36:43.096697+0000","last_peered":"2024-02-17T00:36:43.096697+0000","last_clean":"2024-02-17T00:36:43.096697+0000","last_became_active":"2024-02-17T00:36:38.054520+0000","last_became_peered":"2024-02-17T00:36:38.054520+0000","last_unstale":"2024-02-17T00:36:43.096697+0000","last_undegraded":"2024-02-17T00:36:43.096697+0000","last_fullsized":"2024-02-17T00:36:43.096697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069328+0000","last_change":"2024-02-17T00:36:38.054174+0000","last_active":"2024-02-17T00:36:43.069328+0000","last_peered":"2024-02-17T00:36:43.069328+0000","last_clean":"2024-02-17T00:36:43.069328+0000","last_became_active":"2024-02-17T00:36:38.053849+0000","last_became_peered":"2024-02-17T00:36:38.053849+0000","last_unstale":"2024-02-17T00:36:43.069328+0000","last_undegraded":"2024-02-17T00:36:43.069328+0000","last_fullsized":"2024-02-17T00:36:43.069328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831711+0000","last_change":"2024-02-17T00:36:38.040949+0000","last_active":"2024-02-17T00:36:43.831711+0000","last_peered":"2024-02-17T00:36:43.831711+0000","last_clean":"2024-02-17T00:36:43.831711+0000","last_became_active":"2024-02-17T00:36:38.040638+0000","last_became_peered":"2024-02-17T00:36:38.040638+0000","last_unstale":"2024-02-17T00:36:43.831711+0000","last_undegraded":"2024-02-17T00:36:43.831711+0000","last_fullsized":"2024-02-17T00:36:43.831711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:06:19.787031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831857+0000","last_change":"2024-02-17T00:36:38.059813+0000","last_active":"2024-02-17T00:36:43.831857+0000","last_peered":"2024-02-17T00:36:43.831857+0000","last_clean":"2024-02-17T00:36:43.831857+0000","last_became_active":"2024-02-17T00:36:38.059568+0000","last_became_peered":"2024-02-17T00:36:38.059568+0000","last_unstale":"2024-02-17T00:36:43.831857+0000","last_undegraded":"2024-02-17T00:36:43.831857+0000","last_fullsized":"2024-02-17T00:36:43.831857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:52:30.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832389+0000","last_change":"2024-02-17T00:36:38.054049+0000","last_active":"2024-02-17T00:36:43.832389+0000","last_peered":"2024-02-17T00:36:43.832389+0000","last_clean":"2024-02-17T00:36:43.832389+0000","last_became_active":"2024-02-17T00:36:38.053785+0000","last_became_peered":"2024-02-17T00:36:38.053785+0000","last_unstale":"2024-02-17T00:36:43.832389+0000","last_undegraded":"2024-02-17T00:36:43.832389+0000","last_fullsized":"2024-02-17T00:36:43.832389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:49:46.428346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.069734+0000","last_change":"2024-02-17T00:36:38.057799+0000","last_active":"2024-02-17T00:36:43.069734+0000","last_peered":"2024-02-17T00:36:43.069734+0000","last_clean":"2024-02-17T00:36:43.069734+0000","last_became_active":"2024-02-17T00:36:38.057512+0000","last_became_peered":"2024-02-17T00:36:38.057512+0000","last_unstale":"2024-02-17T00:36:43.069734+0000","last_undegraded":"2024-02-17T00:36:43.069734+0000","last_fullsized":"2024-02-17T00:36:43.069734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:06:22.484806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832454+0000","last_change":"2024-02-17T00:36:38.055783+0000","last_active":"2024-02-17T00:36:43.832454+0000","last_peered":"2024-02-17T00:36:43.832454+0000","last_clean":"2024-02-17T00:36:43.832454+0000","last_became_active":"2024-02-17T00:36:38.055520+0000","last_became_peered":"2024-02-17T00:36:38.055520+0000","last_unstale":"2024-02-17T00:36:43.832454+0000","last_undegraded":"2024-02-17T00:36:43.832454+0000","last_fullsized":"2024-02-17T00:36:43.832454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:09:36.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830805+0000","last_change":"2024-02-17T00:36:38.041377+0000","last_active":"2024-02-17T00:36:43.830805+0000","last_peered":"2024-02-17T00:36:43.830805+0000","last_clean":"2024-02-17T00:36:43.830805+0000","last_became_active":"2024-02-17T00:36:38.041081+0000","last_became_peered":"2024-02-17T00:36:38.041081+0000","last_unstale":"2024-02-17T00:36:43.830805+0000","last_undegraded":"2024-02-17T00:36:43.830805+0000","last_fullsized":"2024-02-17T00:36:43.830805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:49:08.146606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096497+0000","last_change":"2024-02-17T00:36:38.054101+0000","last_active":"2024-02-17T00:36:43.096497+0000","last_peered":"2024-02-17T00:36:43.096497+0000","last_clean":"2024-02-17T00:36:43.096497+0000","last_became_active":"2024-02-17T00:36:38.053820+0000","last_became_peered":"2024-02-17T00:36:38.053820+0000","last_unstale":"2024-02-17T00:36:43.096497+0000","last_undegraded":"2024-02-17T00:36:43.096497+0000","last_fullsized":"2024-02-17T00:36:43.096497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:48.518015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831862+0000","last_change":"2024-02-17T00:36:38.051075+0000","last_active":"2024-02-17T00:36:43.831862+0000","last_peered":"2024-02-17T00:36:43.831862+0000","last_clean":"2024-02-17T00:36:43.831862+0000","last_became_active":"2024-02-17T00:36:38.050786+0000","last_became_peered":"2024-02-17T00:36:38.050786+0000","last_unstale":"2024-02-17T00:36:43.831862+0000","last_undegraded":"2024-02-17T00:36:43.831862+0000","last_fullsized":"2024-02-17T00:36:43.831862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:22:42.258988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.832457+0000","last_change":"2024-02-17T00:36:38.053472+0000","last_active":"2024-02-17T00:36:43.832457+0000","last_peered":"2024-02-17T00:36:43.832457+0000","last_clean":"2024-02-17T00:36:43.832457+0000","last_became_active":"2024-02-17T00:36:38.053183+0000","last_became_peered":"2024-02-17T00:36:38.053183+0000","last_unstale":"2024-02-17T00:36:43.832457+0000","last_undegraded":"2024-02-17T00:36:43.832457+0000","last_fullsized":"2024-02-17T00:36:43.832457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:13:54.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831779+0000","last_change":"2024-02-17T00:36:38.061499+0000","last_active":"2024-02-17T00:36:43.831779+0000","last_peered":"2024-02-17T00:36:43.831779+0000","last_clean":"2024-02-17T00:36:43.831779+0000","last_became_active":"2024-02-17T00:36:38.061179+0000","last_became_peered":"2024-02-17T00:36:38.061179+0000","last_unstale":"2024-02-17T00:36:43.831779+0000","last_undegraded":"2024-02-17T00:36:43.831779+0000","last_fullsized":"2024-02-17T00:36:43.831779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:46:35.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830928+0000","last_change":"2024-02-17T00:36:38.060993+0000","last_active":"2024-02-17T00:36:43.830928+0000","last_peered":"2024-02-17T00:36:43.830928+0000","last_clean":"2024-02-17T00:36:43.830928+0000","last_became_active":"2024-02-17T00:36:38.060363+0000","last_became_peered":"2024-02-17T00:36:38.060363+0000","last_unstale":"2024-02-17T00:36:43.830928+0000","last_undegraded":"2024-02-17T00:36:43.830928+0000","last_fullsized":"2024-02-17T00:36:43.830928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:24:37.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830894+0000","last_change":"2024-02-17T00:36:38.064745+0000","last_active":"2024-02-17T00:36:43.830894+0000","last_peered":"2024-02-17T00:36:43.830894+0000","last_clean":"2024-02-17T00:36:43.830894+0000","last_became_active":"2024-02-17T00:36:38.064474+0000","last_became_peered":"2024-02-17T00:36:38.064474+0000","last_unstale":"2024-02-17T00:36:43.830894+0000","last_undegraded":"2024-02-17T00:36:43.830894+0000","last_fullsized":"2024-02-17T00:36:43.830894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:39:39.016169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.070025+0000","last_change":"2024-02-17T00:36:38.045388+0000","last_active":"2024-02-17T00:36:43.070025+0000","last_peered":"2024-02-17T00:36:43.070025+0000","last_clean":"2024-02-17T00:36:43.070025+0000","last_became_active":"2024-02-17T00:36:38.045025+0000","last_became_peered":"2024-02-17T00:36:38.045025+0000","last_unstale":"2024-02-17T00:36:43.070025+0000","last_undegraded":"2024-02-17T00:36:43.070025+0000","last_fullsized":"2024-02-17T00:36:43.070025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:39:27.545648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.096470+0000","last_change":"2024-02-17T00:36:38.060065+0000","last_active":"2024-02-17T00:36:43.096470+0000","last_peered":"2024-02-17T00:36:43.096470+0000","last_clean":"2024-02-17T00:36:43.096470+0000","last_became_active":"2024-02-17T00:36:38.058856+0000","last_became_peered":"2024-02-17T00:36:38.058856+0000","last_unstale":"2024-02-17T00:36:43.096470+0000","last_undegraded":"2024-02-17T00:36:43.096470+0000","last_fullsized":"2024-02-17T00:36:43.096470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.830615+0000","last_change":"2024-02-17T00:36:38.049156+0000","last_active":"2024-02-17T00:36:43.830615+0000","last_peered":"2024-02-17T00:36:43.830615+0000","last_clean":"2024-02-17T00:36:43.830615+0000","last_became_active":"2024-02-17T00:36:38.048871+0000","last_became_peered":"2024-02-17T00:36:38.048871+0000","last_unstale":"2024-02-17T00:36:43.830615+0000","last_undegraded":"2024-02-17T00:36:43.830615+0000","last_fullsized":"2024-02-17T00:36:43.830615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:25:08.471765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068418+0000","last_change":"2024-02-17T00:36:38.043709+0000","last_active":"2024-02-17T00:36:43.068418+0000","last_peered":"2024-02-17T00:36:43.068418+0000","last_clean":"2024-02-17T00:36:43.068418+0000","last_became_active":"2024-02-17T00:36:38.043021+0000","last_became_peered":"2024-02-17T00:36:38.043021+0000","last_unstale":"2024-02-17T00:36:43.068418+0000","last_undegraded":"2024-02-17T00:36:43.068418+0000","last_fullsized":"2024-02-17T00:36:43.068418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:28:47.307294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831338+0000","last_change":"2024-02-17T00:36:38.051762+0000","last_active":"2024-02-17T00:36:43.831338+0000","last_peered":"2024-02-17T00:36:43.831338+0000","last_clean":"2024-02-17T00:36:43.831338+0000","last_became_active":"2024-02-17T00:36:38.050858+0000","last_became_peered":"2024-02-17T00:36:38.050858+0000","last_unstale":"2024-02-17T00:36:43.831338+0000","last_undegraded":"2024-02-17T00:36:43.831338+0000","last_fullsized":"2024-02-17T00:36:43.831338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:12.296231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.068278+0000","last_change":"2024-02-17T00:36:38.052747+0000","last_active":"2024-02-17T00:36:43.068278+0000","last_peered":"2024-02-17T00:36:43.068278+0000","last_clean":"2024-02-17T00:36:43.068278+0000","last_became_active":"2024-02-17T00:36:38.052427+0000","last_became_peered":"2024-02-17T00:36:38.052427+0000","last_unstale":"2024-02-17T00:36:43.068278+0000","last_undegraded":"2024-02-17T00:36:43.068278+0000","last_fullsized":"2024-02-17T00:36:43.068278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:48:25.674539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097083+0000","last_change":"2024-02-17T00:36:38.050783+0000","last_active":"2024-02-17T00:36:43.097083+0000","last_peered":"2024-02-17T00:36:43.097083+0000","last_clean":"2024-02-17T00:36:43.097083+0000","last_became_active":"2024-02-17T00:36:38.050517+0000","last_became_peered":"2024-02-17T00:36:38.050517+0000","last_unstale":"2024-02-17T00:36:43.097083+0000","last_undegraded":"2024-02-17T00:36:43.097083+0000","last_fullsized":"2024-02-17T00:36:43.097083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:44.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.097293+0000","last_change":"2024-02-17T00:36:38.052397+0000","last_active":"2024-02-17T00:36:43.097293+0000","last_peered":"2024-02-17T00:36:43.097293+0000","last_clean":"2024-02-17T00:36:43.097293+0000","last_became_active":"2024-02-17T00:36:38.052096+0000","last_became_peered":"2024-02-17T00:36:38.052096+0000","last_unstale":"2024-02-17T00:36:43.097293+0000","last_undegraded":"2024-02-17T00:36:43.097293+0000","last_fullsized":"2024-02-17T00:36:43.097293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:01:39.748808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T00:36:43.831341+0000","last_change":"2024-02-17T00:36:38.054432+0000","last_active":"2024-02-17T00:36:43.831341+0000","last_peered":"2024-02-17T00:36:43.831341+0000","last_clean":"2024-02-17T00:36:43.831341+0000","last_became_active":"2024-02-17T00:36:38.054152+0000","last_became_peered":"2024-02-17T00:36:38.054152+0000","last_unstale":"2024-02-17T00:36:43.831341+0000","last_undegraded":"2024-02-17T00:36:43.831341+0000","last_fullsized":"2024-02-17T00:36:43.831341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:37.008085+0000","last_clean_scrub_stamp":"2024-02-17T00:36:37.008085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:53.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:05.865 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T00:37:05.865 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-17T00:37:05.866 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-17T00:37:05.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-17T00:37:05.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:37:05.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:37:06.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:05.999+0000 7f7f5c657640 1 Processor -- start 2024-02-17T00:37:06.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.000+0000 7f7f5c657640 1 -- start start 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.000+0000 7f7f5c657640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f5415da90 0x7f7f540ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.000+0000 7f7f5c657640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f540b5b30 0x7f7f540d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.000+0000 7f7f5c657640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5406ca60 con 0x7f7f540cef20 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.000+0000 7f7f5c657640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f540d1ac0 con 0x7f7f5415da90 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.000+0000 7f7f5c657640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540b6b40 con 0x7f7f540b5b30 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5a3f3640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f5415da90 0x7f7f540ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f59bf2640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7f540cef20 0x7f7f540b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57622/0 (socket says 172.21.15.32:57622) 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f59bf2640 1 -- 172.21.15.32:0/4120024732 learned_addr learned my addr 172.21.15.32:0/4120024732 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5abf4640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f540b5b30 0x7f7f540d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/4120024732 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f540b5b30 msgr2=0x7f7f540d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5a3f3640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f540b5b30 0x7f7f540d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/4120024732 >> v1:172.21.15.32:6789/0 conn(0x7f7f540cef20 legacy=0x7f7f540b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f593f1640 1 -- 172.21.15.32:0/4120024732 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457574420 0 0) 0x7f7f5406ca60 con 0x7f7f540cef20 2024-02-17T00:37:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/4120024732 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540b2da0 con 0x7f7f5415da90 2024-02-17T00:37:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.001+0000 7f7f5abf4640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f540b5b30 0x7f7f540d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.002+0000 7f7f5a3f3640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f5415da90 0x7f7f540ce9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f500097a0 tx=0x7f7f5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ab0d6ee953731b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.002+0000 7f7f593f1640 1 -- 172.21.15.32:0/4120024732 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50031830 con 0x7f7f5415da90 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.002+0000 7f7f593f1640 1 -- 172.21.15.32:0/4120024732 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f50031990 con 0x7f7f5415da90 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.002+0000 7f7f593f1640 1 -- 172.21.15.32:0/4120024732 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50031d20 con 0x7f7f5415da90 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.002+0000 7f7f5c657640 1 -- 172.21.15.32:0/4120024732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f5415da90 msgr2=0x7f7f540ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f5415da90 0x7f7f540ce9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f500097a0 tx=0x7f7f5002b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 -- 172.21.15.32:0/4120024732 shutdown_connections 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f540b5b30 0x7f7f540d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 --2- 172.21.15.32:0/4120024732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f5415da90 0x7f7f540ce9e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 -- 172.21.15.32:0/4120024732 >> 172.21.15.32:0/4120024732 conn(0x7f7f540d0600 msgr2=0x7f7f540d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 -- 172.21.15.32:0/4120024732 shutdown_connections 2024-02-17T00:37:06.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.003+0000 7f7f5c657640 1 -- 172.21.15.32:0/4120024732 wait complete. 2024-02-17T00:37:06.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.004+0000 7f7f5c657640 1 Processor -- start 2024-02-17T00:37:06.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.004+0000 7f7f5c657640 1 -- start start 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 0x7f7f540cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f540cef20 0x7f7f541f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f5415da90 0x7f7f541f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540ca380 con 0x7f7f540b5b30 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540ccf00 con 0x7f7f540cef20 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540cc2f0 con 0x7f7f5415da90 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 0x7f7f540cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 0x7f7f540cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43804/0 (socket says 172.21.15.32:43804) 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/2259032829 learned_addr learned my addr 172.21.15.32:0/2259032829 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f59bf2640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f540cef20 0x7f7f541f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5abf4640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f5415da90 0x7f7f541f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f5415da90 msgr2=0x7f7f541f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f5415da90 0x7f7f541f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f540cef20 msgr2=0x7f7f541f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f540cef20 0x7f7f541f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 -- 172.21.15.32:0/2259032829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50009400 con 0x7f7f540b5b30 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5a3f3640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 0x7f7f540cbac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f50000c00 tx=0x7f7f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5003aa60 con 0x7f7f540b5b30 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5003abc0 con 0x7f7f540b5b30 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500443f0 con 0x7f7f540b5b30 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f540cc5d0 con 0x7f7f540b5b30 2024-02-17T00:37:06.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.005+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f540ccb90 con 0x7f7f540b5b30 2024-02-17T00:37:06.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.006+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f540690e0 con 0x7f7f540b5b30 2024-02-17T00:37:06.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.007+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7f5004d450 con 0x7f7f540b5b30 2024-02-17T00:37:06.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.007+0000 7f7f4affd640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7f3806b810 0x7f7f3806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.007+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7f500ac560 con 0x7f7f540b5b30 2024-02-17T00:37:06.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.007+0000 7f7f59bf2640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7f3806b810 0x7f7f3806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.008+0000 7f7f59bf2640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7f3806b810 0x7f7f3806dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f540b2870 tx=0x7f7f44007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.011+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f50076cf0 con 0x7f7f540b5b30 2024-02-17T00:37:06.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.234+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7f540677f0 con 0x7f7f540b5b30 2024-02-17T00:37:06.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.234+0000 7f7f4affd640 1 -- 172.21.15.32:0/2259032829 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7f5007a3b0 con 0x7f7f540b5b30 2024-02-17T00:37:06.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:06.236 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-17T00:37:06.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7f3806b810 msgr2=0x7f7f3806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7f3806b810 0x7f7f3806dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f540b2870 tx=0x7f7f44007d50 comp rx=0 tx=0).stop 2024-02-17T00:37:06.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 msgr2=0x7f7f540cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 0x7f7f540cbac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f50000c00 tx=0x7f7f500046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 shutdown_connections 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7f3806b810 0x7f7f3806dcd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7f5415da90 0x7f7f541f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f540cef20 0x7f7f541f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 --2- 172.21.15.32:0/2259032829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f540b5b30 0x7f7f540cbac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 >> 172.21.15.32:0/2259032829 conn(0x7f7f540d0600 msgr2=0x7f7f540b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 shutdown_connections 2024-02-17T00:37:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.236+0000 7f7f5c657640 1 -- 172.21.15.32:0/2259032829 wait complete. 2024-02-17T00:37:06.249 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-17T00:37:06.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.348+0000 7f331be57640 1 Processor -- start 2024-02-17T00:37:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.348+0000 7f331be57640 1 -- start start 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331be57640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f331415db00 0x7f33140d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331be57640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33140d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331be57640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140d1e80 con 0x7f33140ce2b0 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331be57640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140b5930 con 0x7f331415db00 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331be57640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140b5c10 con 0x7f33140b53b0 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331a3f4640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f33140ce2b0 0x7f3314161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57636/0 (socket says 172.21.15.32:57636) 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f331a3f4640 1 -- 172.21.15.32:0/1121320928 learned_addr learned my addr 172.21.15.32:0/1121320928 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.349+0000 7f33193f2640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33140d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1121320928 >> v2:172.21.15.39:3300/0 conn(0x7f331415db00 0x7f33140d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263233168 0 0) 0x7f33140d1e80 con 0x7f33140ce2b0 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3300003520 con 0x7f33140ce2b0 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 177046256 0 0) 0x7f3300003520 con 0x7f33140ce2b0 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 msgr2=0x7f33140d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33140d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 >> v2:172.21.15.39:3300/0 conn(0x7f331415db00 msgr2=0x7f33140d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 --2- 172.21.15.32:0/1121320928 >> v2:172.21.15.39:3300/0 conn(0x7f331415db00 0x7f33140d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140b5ef0 con 0x7f33140ce2b0 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f330c0019f0 con 0x7f33140ce2b0 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 >> v1:172.21.15.32:6789/0 conn(0x7f33140ce2b0 legacy=0x7f3314161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3300003970 0x7f3300003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300004d00 0x7f3300005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140b5930 con 0x7f3300003970 2024-02-17T00:37:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140b5c10 con 0x7f3300004d00 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330000b980 con 0x7f33140b53b0 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3300003970 0x7f3300003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f331a3f4640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300004d00 0x7f3300005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f33193f2640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 -- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 msgr2=0x7f33000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 -- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300004d00 msgr2=0x7f3300005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300004d00 0x7f3300005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f3319bf3640 1 -- 172.21.15.32:0/1121320928 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300003520 con 0x7f3300003970 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.350+0000 7f33193f2640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33140b53b0 0x7f33000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.351+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3300003970 0x7f3300003d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3310009ac0 tx=0x7f33000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38d1492f852a57 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.351+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331002c710 con 0x7f3300003970 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.351+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331002c870 con 0x7f3300003970 2024-02-17T00:37:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.351+0000 7f3318bf1640 1 -- 172.21.15.32:0/1121320928 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331002cc00 con 0x7f3300003970 2024-02-17T00:37:06.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331be57640 1 -- 172.21.15.32:0/1121320928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3300003970 msgr2=0x7f3300003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331be57640 1 --2- 172.21.15.32:0/1121320928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3300003970 0x7f3300003d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3310009ac0 tx=0x7f33000057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331a3f4640 1 -- 172.21.15.32:0/1121320928 reap_dead start 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331be57640 1 -- 172.21.15.32:0/1121320928 shutdown_connections 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331be57640 1 -- 172.21.15.32:0/1121320928 >> 172.21.15.32:0/1121320928 conn(0x7f3314072290 msgr2=0x7f33140726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331be57640 1 -- 172.21.15.32:0/1121320928 shutdown_connections 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.352+0000 7f331be57640 1 -- 172.21.15.32:0/1121320928 wait complete. 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.353+0000 7f331be57640 1 Processor -- start 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.353+0000 7f331be57640 1 -- start start 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300003970 0x7f3314153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 0x7f33141f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33141602a0 0x7f3314160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140cd980 con 0x7f33140caa00 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33141563b0 con 0x7f3300003970 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140cae80 con 0x7f33141602a0 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 0x7f33141f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 0x7f33141f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43822/0 (socket says 172.21.15.32:43822) 2024-02-17T00:37:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 -- 172.21.15.32:0/1233220430 learned_addr learned my addr 172.21.15.32:0/1233220430 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300003970 0x7f3314153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331a3f4640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33141602a0 0x7f3314160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 -- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33141602a0 msgr2=0x7f3314160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33141602a0 0x7f3314160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 -- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300003970 msgr2=0x7f3314153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300003970 0x7f3314153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 -- 172.21.15.32:0/1233220430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140cd6a0 con 0x7f33140caa00 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300003970 0x7f3314153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331a3f4640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33141602a0 0x7f3314160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f33193f2640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 0x7f33141f29d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33040116d0 tx=0x7f3304011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400f9c0 con 0x7f33140caa00 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400fb20 con 0x7f33140caa00 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3314156040 con 0x7f33140caa00 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.354+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400fed0 con 0x7f33140caa00 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.355+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33141f2f10 con 0x7f33140caa00 2024-02-17T00:37:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.356+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3314155ea0 con 0x7f33140caa00 2024-02-17T00:37:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.356+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3304015460 con 0x7f33140caa00 2024-02-17T00:37:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.356+0000 7f330a7fc640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f32f806b810 0x7f32f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.356+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f330408ad80 con 0x7f33140caa00 2024-02-17T00:37:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.357+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f32f806b810 0x7f32f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.357+0000 7f3319bf3640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f32f806b810 0x7f32f806dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3310036000 tx=0x7f3310030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.361+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3314155ea0 con 0x7f33140caa00 2024-02-17T00:37:06.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.545+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3314155ea0 con 0x7f33140caa00 2024-02-17T00:37:06.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.546+0000 7f330a7fc640 1 -- 172.21.15.32:0/1233220430 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f3314155ea0 con 0x7f33140caa00 2024-02-17T00:37:06.549 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:06.549 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f32f806b810 msgr2=0x7f32f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f32f806b810 0x7f32f806dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3310036000 tx=0x7f3310030000 comp rx=0 tx=0).stop 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 msgr2=0x7f33141f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 0x7f33141f29d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33040116d0 tx=0x7f3304011b90 comp rx=0 tx=0).stop 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 shutdown_connections 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f32f806b810 0x7f32f806dcd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f33141602a0 0x7f3314160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33140caa00 0x7f33141f29d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 --2- 172.21.15.32:0/1233220430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3300003970 0x7f3314153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 >> 172.21.15.32:0/1233220430 conn(0x7f3314072290 msgr2=0x7f33140ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 shutdown_connections 2024-02-17T00:37:06.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.549+0000 7f331be57640 1 -- 172.21.15.32:0/1233220430 wait complete. 2024-02-17T00:37:06.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:06.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.664+0000 7f539f439640 1 Processor -- start 2024-02-17T00:37:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.664+0000 7f539f439640 1 -- start start 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539f439640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53980d3760 0x7f539815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539f439640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f53980b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539f439640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53980ce380 con 0x7f539815f1c0 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539f439640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53980ceff0 con 0x7f53980d3760 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539f439640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539815f000 con 0x7f53980ce830 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53980d3760 0x7f539815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53980d3760 0x7f539815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43828/0 (socket says 172.21.15.32:43828) 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 -- 172.21.15.32:0/1238405359 learned_addr learned my addr 172.21.15.32:0/1238405359 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d9d6640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f53980b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 -- 172.21.15.32:0/1238405359 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 msgr2=0x7f53980b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f53980b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 -- 172.21.15.32:0/1238405359 >> v1:172.21.15.39:6789/0 conn(0x7f539815f1c0 legacy=0x7f53980d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d1d5640 1 -- 172.21.15.32:0/1238405359 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980d2190 con 0x7f53980d3760 2024-02-17T00:37:06.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.665+0000 7f539d9d6640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f53980b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.666+0000 7f539d1d5640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f539815eac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5394009e50 tx=0x7f539402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3946bbbb4083f4c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.666+0000 7f538ffff640 1 -- 172.21.15.32:0/1238405359 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539402ca70 con 0x7f53980d3760 2024-02-17T00:37:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.666+0000 7f538ffff640 1 -- 172.21.15.32:0/1238405359 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539402cbd0 con 0x7f53980d3760 2024-02-17T00:37:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.666+0000 7f538ffff640 1 -- 172.21.15.32:0/1238405359 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940343f0 con 0x7f53980d3760 2024-02-17T00:37:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 -- 172.21.15.32:0/1238405359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 msgr2=0x7f539815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f539815eac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5394009e50 tx=0x7f539402bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 -- 172.21.15.32:0/1238405359 shutdown_connections 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f53980b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 --2- 172.21.15.32:0/1238405359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f539815eac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 -- 172.21.15.32:0/1238405359 >> 172.21.15.32:0/1238405359 conn(0x7f5398072680 msgr2=0x7f5398072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 -- 172.21.15.32:0/1238405359 shutdown_connections 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.667+0000 7f539f439640 1 -- 172.21.15.32:0/1238405359 wait complete. 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.668+0000 7f539f439640 1 Processor -- start 2024-02-17T00:37:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.668+0000 7f539f439640 1 -- start start 2024-02-17T00:37:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539f439640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f5398155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539f439640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f53981f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539f439640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539815f1c0 0x7f5398158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539f439640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53980c8920 con 0x7f53980d3760 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539f439640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5398152ae0 con 0x7f539815f1c0 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539f439640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53981530d0 con 0x7f53980ce830 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f53981f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f53981f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43836/0 (socket says 172.21.15.32:43836) 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 -- 172.21.15.32:0/3686748996 learned_addr learned my addr 172.21.15.32:0/3686748996 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539d1d5640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f5398155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539d9d6640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539815f1c0 0x7f5398158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 -- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 msgr2=0x7f5398155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f5398155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 -- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539815f1c0 msgr2=0x7f5398158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539815f1c0 0x7f5398158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 -- 172.21.15.32:0/3686748996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394009b30 con 0x7f53980d3760 2024-02-17T00:37:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539d9d6640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539815f1c0 0x7f5398158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.669+0000 7f539c9d4640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f53981f3120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f538800b3f0 tx=0x7f538800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.670+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388011830 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.670+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388011990 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.670+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388011d40 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.670+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53981532e0 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.670+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53980c8540 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.671+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53980c8a60 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.671+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f538801a400 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.671+0000 7f538dffb640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f537c06b810 0x7f537c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.672+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f538808a3b0 con 0x7f53980d3760 2024-02-17T00:37:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.672+0000 7f539d1d5640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f537c06b810 0x7f537c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.672+0000 7f539d1d5640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f537c06b810 0x7f537c06dcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5394035000 tx=0x7f5394030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.676+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53980c8a60 con 0x7f53980d3760 2024-02-17T00:37:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.854+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53980c8a60 con 0x7f53980d3760 2024-02-17T00:37:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.855+0000 7f538dffb640 1 -- 172.21.15.32:0/3686748996 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53980c8a60 con 0x7f53980d3760 2024-02-17T00:37:06.857 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f537c06b810 msgr2=0x7f537c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f537c06b810 0x7f537c06dcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5394035000 tx=0x7f5394030000 comp rx=0 tx=0).stop 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 msgr2=0x7f53981f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f53981f3120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f538800b3f0 tx=0x7f538800b8b0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 shutdown_connections 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539815f1c0 0x7f5398158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53980d3760 0x7f53981f3120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f537c06b810 0x7f537c06dcd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.856+0000 7f539f439640 1 --2- 172.21.15.32:0/3686748996 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f53980ce830 0x7f5398155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.857+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 >> 172.21.15.32:0/3686748996 conn(0x7f5398072680 msgr2=0x7f53980b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.857+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 shutdown_connections 2024-02-17T00:37:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.857+0000 7f539f439640 1 -- 172.21.15.32:0/3686748996 wait complete. 2024-02-17T00:37:06.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:06.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.971+0000 7f9956ca3640 1 Processor -- start 2024-02-17T00:37:06.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.971+0000 7f9956ca3640 1 -- start start 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9956ca3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f995015f1c0 0x7f995015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9956ca3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 0x7f99500b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9956ca3640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500ce380 con 0x7f99500d3760 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9956ca3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500ceff0 con 0x7f995015f1c0 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9956ca3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995015f000 con 0x7f99500ce830 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9954a3f640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f99500d3760 0x7f99500d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57644/0 (socket says 172.21.15.32:57644) 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9954a3f640 1 -- 172.21.15.32:0/294167071 learned_addr learned my addr 172.21.15.32:0/294167071 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f9955240640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 0x7f99500b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f994ffff640 1 --2- 172.21.15.32:0/294167071 >> v2:172.21.15.39:3300/0 conn(0x7f995015f1c0 0x7f995015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218202177 0 0) 0x7f99500ce380 con 0x7f99500d3760 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.972+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f993c003520 con 0x7f99500d3760 2024-02-17T00:37:06.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3081905911 0 0) 0x7f993c003520 con 0x7f99500d3760 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 msgr2=0x7f99500b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 0x7f99500b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 >> v2:172.21.15.39:3300/0 conn(0x7f995015f1c0 msgr2=0x7f995015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 --2- 172.21.15.32:0/294167071 >> v2:172.21.15.39:3300/0 conn(0x7f995015f1c0 0x7f995015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99500d2190 con 0x7f99500d3760 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f9948001670 con 0x7f99500d3760 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 >> v1:172.21.15.32:6789/0 conn(0x7f99500d3760 legacy=0x7f99500d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 0x7f993c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f993c003ef0 0x7f993c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c004d00 0x7f993c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500ceff0 con 0x7f993c003ef0 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995015f000 con 0x7f993c004d00 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c00b980 con 0x7f99500ce830 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994ffff640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f993c003ef0 0x7f993c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f9954a3f640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 0x7f993c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f9955240640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c004d00 0x7f993c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994ffff640 1 -- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 msgr2=0x7f993c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994ffff640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99500ce830 0x7f993c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994ffff640 1 -- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c004d00 msgr2=0x7f993c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994ffff640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c004d00 0x7f993c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f994ffff640 1 -- 172.21.15.32:0/294167071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c003520 con 0x7f993c003ef0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.973+0000 7f9955240640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c004d00 0x7f993c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f994ffff640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f993c003ef0 0x7f993c0047c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9940009f90 tx=0x7f993c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7f3690b3b25ae0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994002cc00 con 0x7f993c003ef0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000f040 con 0x7f993c003ef0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f994f7fe640 1 -- 172.21.15.32:0/294167071 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940034440 con 0x7f993c003ef0 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f9956ca3640 1 -- 172.21.15.32:0/294167071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f993c003ef0 msgr2=0x7f993c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f9956ca3640 1 --2- 172.21.15.32:0/294167071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f993c003ef0 0x7f993c0047c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9940009f90 tx=0x7f993c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.974+0000 7f9955240640 1 -- 172.21.15.32:0/294167071 reap_dead start 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.975+0000 7f9956ca3640 1 -- 172.21.15.32:0/294167071 shutdown_connections 2024-02-17T00:37:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.975+0000 7f9956ca3640 1 -- 172.21.15.32:0/294167071 >> 172.21.15.32:0/294167071 conn(0x7f9950072680 msgr2=0x7f9950072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:06.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.975+0000 7f9956ca3640 1 -- 172.21.15.32:0/294167071 shutdown_connections 2024-02-17T00:37:06.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.975+0000 7f9956ca3640 1 -- 172.21.15.32:0/294167071 wait complete. 2024-02-17T00:37:06.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.976+0000 7f9956ca3640 1 Processor -- start 2024-02-17T00:37:06.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.976+0000 7f9956ca3640 1 -- start start 2024-02-17T00:37:06.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c003ef0 0x7f99500b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 0x7f995014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99501482d0 0x7f99500c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995014f160 con 0x7f995014c060 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995014c4e0 con 0x7f993c003ef0 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995014bb50 con 0x7f99501482d0 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 0x7f995014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 0x7f995014b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43864/0 (socket says 172.21.15.32:43864) 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 -- 172.21.15.32:0/2790676199 learned_addr learned my addr 172.21.15.32:0/2790676199 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9955240640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99501482d0 0x7f99500c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9954a3f640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c003ef0 0x7f99500b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 -- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99501482d0 msgr2=0x7f99500c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99501482d0 0x7f99500c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 -- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c003ef0 msgr2=0x7f99500b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c003ef0 0x7f99500b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 -- 172.21.15.32:0/2790676199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950148c80 con 0x7f995014c060 2024-02-17T00:37:06.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9954a3f640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c003ef0 0x7f99500b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994ffff640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 0x7f995014b610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9940037040 tx=0x7f9940009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940034d80 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940040450 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9950148f60 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940040800 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.977+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9950149520 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.978+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950068f60 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.979+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9940040960 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.979+0000 7f994d7fa640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f993006b840 0x7f993006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.979+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f99400ace00 con 0x7f995014c060 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.979+0000 7f9954a3f640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f993006b840 0x7f993006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:06.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.980+0000 7f9954a3f640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f993006b840 0x7f993006dd00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f995015d7d0 tx=0x7f9948009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:06.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:06.983+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99400774e0 con 0x7f995014c060 2024-02-17T00:37:07.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.162+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99500ce610 con 0x7f995014c060 2024-02-17T00:37:07.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.163+0000 7f994d7fa640 1 -- 172.21.15.32:0/2790676199 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9940044020 con 0x7f995014c060 2024-02-17T00:37:07.165 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:07.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f993006b840 msgr2=0x7f993006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f993006b840 0x7f993006dd00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f995015d7d0 tx=0x7f9948009040 comp rx=0 tx=0).stop 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 msgr2=0x7f995014b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 0x7f995014b610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9940037040 tx=0x7f9940009750 comp rx=0 tx=0).stop 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 shutdown_connections 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f993006b840 0x7f993006dd00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f99501482d0 0x7f99500c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995014c060 0x7f995014b610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 --2- 172.21.15.32:0/2790676199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f993c003ef0 0x7f99500b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 >> 172.21.15.32:0/2790676199 conn(0x7f9950072680 msgr2=0x7f99500cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 shutdown_connections 2024-02-17T00:37:07.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.165+0000 7f9956ca3640 1 -- 172.21.15.32:0/2790676199 wait complete. 2024-02-17T00:37:07.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:07.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.280+0000 7fd75dd9f640 1 Processor -- start 2024-02-17T00:37:07.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.280+0000 7fd75dd9f640 1 -- start start 2024-02-17T00:37:07.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75dd9f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd75815da60 0x7fd7580cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75dd9f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7580ce560 0x7fd7580b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75dd9f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580cfd50 con 0x7fd75806bc70 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75dd9f640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7580d0030 con 0x7fd7580ce560 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75dd9f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7580d0310 con 0x7fd75815da60 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75d59e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7580ce560 0x7fd7580b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75d59e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7580ce560 0x7fd7580b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43874/0 (socket says 172.21.15.32:43874) 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75d59e640 1 -- 172.21.15.32:0/2898313356 learned_addr learned my addr 172.21.15.32:0/2898313356 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.281+0000 7fd75cd9d640 1 --2- 172.21.15.32:0/2898313356 >> v2:172.21.15.39:3300/0 conn(0x7fd75815da60 0x7fd7580cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.282+0000 7fd75d59e640 1 -- 172.21.15.32:0/2898313356 >> v2:172.21.15.39:3300/0 conn(0x7fd75815da60 msgr2=0x7fd7580cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.282+0000 7fd75d59e640 1 --2- 172.21.15.32:0/2898313356 >> v2:172.21.15.39:3300/0 conn(0x7fd75815da60 0x7fd7580cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.282+0000 7fd75d59e640 1 -- 172.21.15.32:0/2898313356 >> v1:172.21.15.39:6789/0 conn(0x7fd75806bc70 legacy=0x7fd7580cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.282+0000 7fd75d59e640 1 -- 172.21.15.32:0/2898313356 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580d05f0 con 0x7fd7580ce560 2024-02-17T00:37:07.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.282+0000 7fd75d59e640 1 --2- 172.21.15.32:0/2898313356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7580ce560 0x7fd7580b1470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7580d2190 tx=0x7fd74802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a5ba0cb21f95ac server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd7577fe640 1 -- 172.21.15.32:0/2898313356 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748031870 con 0x7fd7580ce560 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd7577fe640 1 -- 172.21.15.32:0/2898313356 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7480319d0 con 0x7fd7580ce560 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd7577fe640 1 -- 172.21.15.32:0/2898313356 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748031d60 con 0x7fd7580ce560 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 -- 172.21.15.32:0/2898313356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7580ce560 msgr2=0x7fd7580b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/2898313356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7580ce560 0x7fd7580b1470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7580d2190 tx=0x7fd74802b910 comp rx=0 tx=0).stop 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 -- 172.21.15.32:0/2898313356 shutdown_connections 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/2898313356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7580ce560 0x7fd7580b1470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/2898313356 >> v2:172.21.15.39:3300/0 conn(0x7fd75815da60 0x7fd7580cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 -- 172.21.15.32:0/2898313356 >> 172.21.15.32:0/2898313356 conn(0x7fd7580d1470 msgr2=0x7fd7580d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 -- 172.21.15.32:0/2898313356 shutdown_connections 2024-02-17T00:37:07.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.283+0000 7fd75dd9f640 1 -- 172.21.15.32:0/2898313356 wait complete. 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.284+0000 7fd75dd9f640 1 Processor -- start 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.284+0000 7fd75dd9f640 1 -- start start 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75dd9f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd75806bc70 0x7fd7580b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75dd9f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7580ce560 0x7fd7580c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75dd9f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 0x7fd758151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75dd9f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580c6c50 con 0x7fd75815da60 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75dd9f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd758151e50 con 0x7fd7580ce560 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75dd9f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580b4350 con 0x7fd75806bc70 2024-02-17T00:37:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75d59e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 0x7fd758151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75d59e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 0x7fd758151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43882/0 (socket says 172.21.15.32:43882) 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75d59e640 1 -- 172.21.15.32:0/1870220955 learned_addr learned my addr 172.21.15.32:0/1870220955 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd75cd9d640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd75806bc70 0x7fd7580b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.285+0000 7fd757fff640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7580ce560 0x7fd7580c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75d59e640 1 -- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd75806bc70 msgr2=0x7fd7580b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75d59e640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd75806bc70 0x7fd7580b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75d59e640 1 -- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7580ce560 msgr2=0x7fd7580c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75d59e640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7580ce560 0x7fd7580c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75d59e640 1 -- 172.21.15.32:0/1870220955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480094d0 con 0x7fd75815da60 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75d59e640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 0x7fd758151910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd74802b950 tx=0x7fd7480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74803ac60 con 0x7fd75815da60 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74803adc0 con 0x7fd75815da60 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7580c6040 con 0x7fd75815da60 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748045690 con 0x7fd75815da60 2024-02-17T00:37:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.286+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7580c6600 con 0x7fd75815da60 2024-02-17T00:37:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.287+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7580c6e00 con 0x7fd75815da60 2024-02-17T00:37:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.288+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd7480457f0 con 0x7fd75815da60 2024-02-17T00:37:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.288+0000 7fd7557fa640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd74406b810 0x7fd74406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.288+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd74802d040 con 0x7fd75815da60 2024-02-17T00:37:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.288+0000 7fd75cd9d640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd74406b810 0x7fd74406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.289+0000 7fd75cd9d640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd74406b810 0x7fd74406dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd750009fd0 tx=0x7fd750009800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.292+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7580c6e00 con 0x7fd75815da60 2024-02-17T00:37:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.471+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7580c6e00 con 0x7fd75815da60 2024-02-17T00:37:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.471+0000 7fd7557fa640 1 -- 172.21.15.32:0/1870220955 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7480ace60 con 0x7fd75815da60 2024-02-17T00:37:07.474 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd74406b810 msgr2=0x7fd74406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd74406b810 0x7fd74406dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd750009fd0 tx=0x7fd750009800 comp rx=0 tx=0).stop 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 msgr2=0x7fd758151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 0x7fd758151910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd74802b950 tx=0x7fd7480046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 shutdown_connections 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75815da60 0x7fd758151910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7580ce560 0x7fd7580c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd74406b810 0x7fd74406dcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 --2- 172.21.15.32:0/1870220955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd75806bc70 0x7fd7580b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 >> 172.21.15.32:0/1870220955 conn(0x7fd7580d1470 msgr2=0x7fd75806c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 shutdown_connections 2024-02-17T00:37:07.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.473+0000 7fd75dd9f640 1 -- 172.21.15.32:0/1870220955 wait complete. 2024-02-17T00:37:07.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:07.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.588+0000 7fa0e2f79640 1 Processor -- start 2024-02-17T00:37:07.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.588+0000 7fa0e2f79640 1 -- start start 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e2f79640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa0dc15db30 0x7fa0dc0d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e2f79640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa0dc0d0980 0x7fa0dc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e2f79640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e2f79640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0d2400 con 0x7fa0dc0d0980 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e2f79640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0cf050 con 0x7fa0dc15db30 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e2f79640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc15df10 con 0x7fa0dc0cebc0 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa0dc0d0980 0x7fa0dc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa0dc0d0980 0x7fa0dc0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43892/0 (socket says 172.21.15.32:43892) 2024-02-17T00:37:07.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 -- 172.21.15.32:0/3610060438 learned_addr learned my addr 172.21.15.32:0/3610060438 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e0d15640 1 --2- 172.21.15.32:0/3610060438 >> v2:172.21.15.39:3300/0 conn(0x7fa0dc15db30 0x7fa0dc0d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e1516640 1 --2- 172.21.15.32:0/3610060438 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 -- 172.21.15.32:0/3610060438 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 msgr2=0x7fa0dc0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 --2- 172.21.15.32:0/3610060438 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 -- 172.21.15.32:0/3610060438 >> v2:172.21.15.39:3300/0 conn(0x7fa0dc15db30 msgr2=0x7fa0dc0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 --2- 172.21.15.32:0/3610060438 >> v2:172.21.15.39:3300/0 conn(0x7fa0dc15db30 0x7fa0dc0d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0dbfff640 1 -- 172.21.15.32:0/3610060438 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0d1780 con 0x7fa0dc0d0980 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.589+0000 7fa0e0d15640 1 --2- 172.21.15.32:0/3610060438 >> v2:172.21.15.39:3300/0 conn(0x7fa0dc15db30 0x7fa0dc0d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0dbfff640 1 --2- 172.21.15.32:0/3610060438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc0ce680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0d0fa0 tx=0x7fa0c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6187f252c28bfe9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0db7fe640 1 -- 172.21.15.32:0/3610060438 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8031870 con 0x7fa0dc0d0980 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0db7fe640 1 -- 172.21.15.32:0/3610060438 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80319d0 con 0x7fa0dc0d0980 2024-02-17T00:37:07.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0db7fe640 1 -- 172.21.15.32:0/3610060438 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8031d60 con 0x7fa0dc0d0980 2024-02-17T00:37:07.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 -- 172.21.15.32:0/3610060438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 msgr2=0x7fa0dc0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/3610060438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc0ce680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0d0fa0 tx=0x7fa0c802b910 comp rx=0 tx=0).stop 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 -- 172.21.15.32:0/3610060438 shutdown_connections 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/3610060438 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/3610060438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc0ce680 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/3610060438 >> v2:172.21.15.39:3300/0 conn(0x7fa0dc15db30 0x7fa0dc0d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.590+0000 7fa0e2f79640 1 -- 172.21.15.32:0/3610060438 >> 172.21.15.32:0/3610060438 conn(0x7fa0dc0728c0 msgr2=0x7fa0dc06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.591+0000 7fa0e2f79640 1 -- 172.21.15.32:0/3610060438 shutdown_connections 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.591+0000 7fa0e2f79640 1 -- 172.21.15.32:0/3610060438 wait complete. 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 Processor -- start 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 -- start start 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc15db30 0x7fa0dc0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc15e120 con 0x7fa0dc0d0980 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0cd350 con 0x7fa0dc15db30 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.592+0000 7fa0e2f79640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc15e330 con 0x7fa0dc0cebc0 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43896/0 (socket says 172.21.15.32:43896) 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 -- 172.21.15.32:0/2907027561 learned_addr learned my addr 172.21.15.32:0/2907027561 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0e0d15640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0e1516640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc15db30 0x7fa0dc0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 -- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 msgr2=0x7fa0dc1f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc1f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 -- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc15db30 msgr2=0x7fa0dc0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc15db30 0x7fa0dc0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 -- 172.21.15.32:0/2907027561 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c80094d0 con 0x7fa0dc0d0980 2024-02-17T00:37:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0dbfff640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc15f0f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa0c802b950 tx=0x7fa0c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8031860 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80443f0 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc15e610 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80447a0 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.593+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc15ebd0 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.594+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc15e470 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.595+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa0c804d450 con 0x7fa0dc0d0980 2024-02-17T00:37:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.595+0000 7fa0d97fa640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa0c006b810 0x7fa0c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.595+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa0c802d040 con 0x7fa0dc0d0980 2024-02-17T00:37:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.595+0000 7fa0e0d15640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa0c006b810 0x7fa0c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.596+0000 7fa0e0d15640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa0c006b810 0x7fa0c006dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0b7720 tx=0x7fa0d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.599+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0dc15e470 con 0x7fa0dc0d0980 2024-02-17T00:37:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.780+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa0dc15e470 con 0x7fa0dc0d0980 2024-02-17T00:37:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.780+0000 7fa0d97fa640 1 -- 172.21.15.32:0/2907027561 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa0dc15e470 con 0x7fa0dc0d0980 2024-02-17T00:37:07.782 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa0c006b810 msgr2=0x7fa0c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa0c006b810 0x7fa0c006dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0b7720 tx=0x7fa0d0008040 comp rx=0 tx=0).stop 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 msgr2=0x7fa0dc15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc15f0f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa0c802b950 tx=0x7fa0c80046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 shutdown_connections 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc15db30 0x7fa0dc0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0dc0d0980 0x7fa0dc15f0f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa0c006b810 0x7fa0c006dcd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 --2- 172.21.15.32:0/2907027561 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0dc0cebc0 0x7fa0dc1f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 >> 172.21.15.32:0/2907027561 conn(0x7fa0dc0728c0 msgr2=0x7fa0dc0736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:07.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 shutdown_connections 2024-02-17T00:37:07.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.782+0000 7fa0e2f79640 1 -- 172.21.15.32:0/2907027561 wait complete. 2024-02-17T00:37:07.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.895+0000 7f51d5977640 1 Processor -- start 2024-02-17T00:37:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.895+0000 7f51d5977640 1 -- start start 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51d5977640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d015dc10 0x7f51d01615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51d5977640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f51d0161b30 0x7f51d00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51d5977640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d00d1d90 con 0x7f51d00b6b90 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51d5977640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d00d23c0 con 0x7f51d0161b30 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51d5977640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d0162040 con 0x7f51d015dc10 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51cf7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f51d00b6b90 0x7f51d00b5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57650/0 (socket says 172.21.15.32:57650) 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51cf7fe640 1 -- 172.21.15.32:0/3349277336 learned_addr learned my addr 172.21.15.32:0/3349277336 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51ceffd640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d015dc10 0x7f51d01615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51ce7fc640 1 --2- 172.21.15.32:0/3349277336 >> v2:172.21.15.39:3300/0 conn(0x7f51d0161b30 0x7f51d00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51cdffb640 1 -- 172.21.15.32:0/3349277336 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087521041 0 0) 0x7f51d00d1d90 con 0x7f51d00b6b90 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51cdffb640 1 -- 172.21.15.32:0/3349277336 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51bc003520 con 0x7f51d00b6b90 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51ce7fc640 1 -- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d015dc10 msgr2=0x7f51d01615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.896+0000 7f51ce7fc640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d015dc10 0x7f51d01615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.897+0000 7f51ce7fc640 1 -- 172.21.15.32:0/3349277336 >> v1:172.21.15.32:6789/0 conn(0x7f51d00b6b90 legacy=0x7f51d00b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.897+0000 7f51ce7fc640 1 -- 172.21.15.32:0/3349277336 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0162320 con 0x7f51d0161b30 2024-02-17T00:37:07.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.897+0000 7f51ceffd640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d015dc10 0x7f51d01615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.897+0000 7f51ce7fc640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d00d0240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51b80097a0 tx=0x7f51b802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9059e36db95f25c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.897+0000 7f51cdffb640 1 -- 172.21.15.32:0/3349277336 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b802f050 con 0x7f51d0161b30 2024-02-17T00:37:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51cdffb640 1 -- 172.21.15.32:0/3349277336 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8031700 con 0x7f51d0161b30 2024-02-17T00:37:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51cdffb640 1 -- 172.21.15.32:0/3349277336 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8031a70 con 0x7f51d0161b30 2024-02-17T00:37:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 -- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 msgr2=0x7f51d00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d00d0240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51b80097a0 tx=0x7f51b802b7a0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 -- 172.21.15.32:0/3349277336 shutdown_connections 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d00d0240 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 --2- 172.21.15.32:0/3349277336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d015dc10 0x7f51d01615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 -- 172.21.15.32:0/3349277336 >> 172.21.15.32:0/3349277336 conn(0x7f51d0072290 msgr2=0x7f51d00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 -- 172.21.15.32:0/3349277336 shutdown_connections 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.898+0000 7f51d5977640 1 -- 172.21.15.32:0/3349277336 wait complete. 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.899+0000 7f51d5977640 1 Processor -- start 2024-02-17T00:37:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.899+0000 7f51d5977640 1 -- start start 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51d5977640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d00b6b90 0x7f51d00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51d5977640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 0x7f51d0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51d5977640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d0151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51d5977640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01592a0 con 0x7f51d015dc10 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51d5977640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01581c0 con 0x7f51d0161b30 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51d5977640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d0158460 con 0x7f51d00b6b90 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51ce7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 0x7f51d0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51ce7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 0x7f51d0157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43908/0 (socket says 172.21.15.32:43908) 2024-02-17T00:37:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51ce7fc640 1 -- 172.21.15.32:0/118478028 learned_addr learned my addr 172.21.15.32:0/118478028 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51ceffd640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d00b6b90 0x7f51d00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.900+0000 7f51cf7fe640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ce7fc640 1 -- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d00b6b90 msgr2=0x7f51d00c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ce7fc640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d00b6b90 0x7f51d00c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ce7fc640 1 -- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 msgr2=0x7f51d0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ce7fc640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d0151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ce7fc640 1 -- 172.21.15.32:0/118478028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8009400 con 0x7f51d015dc10 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ceffd640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d00b6b90 0x7f51d00c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51ce7fc640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 0x7f51d0157c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f51b8036040 tx=0x7f51b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8006e10 con 0x7f51d015dc10 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b80044c0 con 0x7f51d015dc10 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8009400 con 0x7f51d015dc10 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8003820 con 0x7f51d015dc10 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.901+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d0158a20 con 0x7f51d015dc10 2024-02-17T00:37:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.902+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d0068fd0 con 0x7f51d015dc10 2024-02-17T00:37:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.902+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f51b8003980 con 0x7f51d015dc10 2024-02-17T00:37:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.903+0000 7f51c7fff640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f51b006b840 0x7f51b006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.903+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f51b80abed0 con 0x7f51d015dc10 2024-02-17T00:37:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.903+0000 7f51ceffd640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f51b006b840 0x7f51b006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.903+0000 7f51ceffd640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f51b006b840 0x7f51b006dd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009d20 tx=0x7f51c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:07.907+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51b80765a0 con 0x7f51d015dc10 2024-02-17T00:37:08.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.123+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51d0160e90 con 0x7f51d015dc10 2024-02-17T00:37:08.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.123+0000 7f51c7fff640 1 -- 172.21.15.32:0/118478028 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f51b8079c60 con 0x7f51d015dc10 2024-02-17T00:37:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:08.126 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:08.126 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:08.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f51b006b840 msgr2=0x7f51b006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f51b006b840 0x7f51b006dd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009d20 tx=0x7f51c8008040 comp rx=0 tx=0).stop 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 msgr2=0x7f51d0157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 0x7f51d0157c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f51b8036040 tx=0x7f51b80046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 shutdown_connections 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d0161b30 0x7f51d0151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51d015dc10 0x7f51d0157c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f51b006b840 0x7f51b006dd00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 --2- 172.21.15.32:0/118478028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f51d00b6b90 0x7f51d00c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 >> 172.21.15.32:0/118478028 conn(0x7f51d0072290 msgr2=0x7f51d0153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 shutdown_connections 2024-02-17T00:37:08.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.125+0000 7f51d5977640 1 -- 172.21.15.32:0/118478028 wait complete. 2024-02-17T00:37:08.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:08.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.238+0000 7fe76b481640 1 Processor -- start 2024-02-17T00:37:08.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.238+0000 7fe76b481640 1 -- start start 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76b481640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 0x7fe764161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76b481640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe7641622b0 0x7fe7640ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76b481640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76415e8a0 con 0x7fe76415da60 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76b481640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe764161640 con 0x7fe7641622b0 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76b481640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415eb80 con 0x7fe7640d0aa0 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76921d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe76415da60 0x7fe76415de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57664/0 (socket says 172.21.15.32:57664) 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe76921d640 1 -- 172.21.15.32:0/1794215305 learned_addr learned my addr 172.21.15.32:0/1794215305 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe768a1c640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 0x7fe764161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe769a1e640 1 --2- 172.21.15.32:0/1794215305 >> v2:172.21.15.39:3300/0 conn(0x7fe7641622b0 0x7fe7640ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367675673 0 0) 0x7fe76415e8a0 con 0x7fe76415da60 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c003520 con 0x7fe76415da60 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1082896252 0 0) 0x7fe74c003520 con 0x7fe76415da60 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 msgr2=0x7fe764161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 0x7fe764161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 >> v2:172.21.15.39:3300/0 conn(0x7fe7641622b0 msgr2=0x7fe7640ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 --2- 172.21.15.32:0/1794215305 >> v2:172.21.15.39:3300/0 conn(0x7fe7641622b0 0x7fe7640ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76415ee60 con 0x7fe76415da60 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.239+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fe75c001670 con 0x7fe76415da60 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 >> v1:172.21.15.32:6789/0 conn(0x7fe76415da60 legacy=0x7fe76415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe74c003970 0x7fe74c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 0x7fe74c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c004d00 0x7fe74c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe764161640 con 0x7fe74c003970 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415eb80 con 0x7fe74c004d00 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c00b9b0 con 0x7fe7640d0aa0 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe769a1e640 1 --2- 172.21.15.32:0/1794215305 >> v2:172.21.15.39:3300/0 conn(0x7fe7641622b0 0x7fe7640ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe76921d640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe74c003970 0x7fe74c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe768a1c640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 0x7fe74c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe769a1e640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c004d00 0x7fe74c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe76921d640 1 -- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 msgr2=0x7fe74c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe76921d640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe7640d0aa0 0x7fe74c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe76921d640 1 -- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c004d00 msgr2=0x7fe74c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe76921d640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c004d00 0x7fe74c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.240+0000 7fe76921d640 1 -- 172.21.15.32:0/1794215305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c003520 con 0x7fe74c003970 2024-02-17T00:37:08.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe76921d640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe74c003970 0x7fe74c003d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c210 tx=0x7fe74c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf981808d65d842 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c02cb00 con 0x7fe74c003970 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c02cc80 con 0x7fe74c003970 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe763fff640 1 -- 172.21.15.32:0/1794215305 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0058d0 con 0x7fe74c003970 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe76b481640 1 -- 172.21.15.32:0/1794215305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe74c003970 msgr2=0x7fe74c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe76b481640 1 --2- 172.21.15.32:0/1794215305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe74c003970 0x7fe74c003d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c210 tx=0x7fe74c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe769a1e640 1 -- 172.21.15.32:0/1794215305 reap_dead start 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe76b481640 1 -- 172.21.15.32:0/1794215305 shutdown_connections 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.241+0000 7fe76b481640 1 -- 172.21.15.32:0/1794215305 >> 172.21.15.32:0/1794215305 conn(0x7fe76406bfe0 msgr2=0x7fe76406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.242+0000 7fe76b481640 1 -- 172.21.15.32:0/1794215305 shutdown_connections 2024-02-17T00:37:08.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.242+0000 7fe76b481640 1 -- 172.21.15.32:0/1794215305 wait complete. 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.243+0000 7fe76b481640 1 Processor -- start 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.243+0000 7fe76b481640 1 -- start start 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.243+0000 7fe76b481640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe74c003970 0x7fe7640b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.243+0000 7fe76b481640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 0x7fe7640ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.243+0000 7fe76b481640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7640ac5a0 0x7fe7640aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe76b481640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640acf60 con 0x7fe7640b3ed0 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe76b481640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640b4fa0 con 0x7fe7640ac5a0 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe76b481640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641f3c30 con 0x7fe74c003970 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 0x7fe7640ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 0x7fe7640ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43930/0 (socket says 172.21.15.32:43930) 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 -- 172.21.15.32:0/2765325387 learned_addr learned my addr 172.21.15.32:0/2765325387 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe76921d640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe74c003970 0x7fe7640b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe769a1e640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7640ac5a0 0x7fe7640aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 -- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe74c003970 msgr2=0x7fe7640b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe74c003970 0x7fe7640b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 -- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7640ac5a0 msgr2=0x7fe7640aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7640ac5a0 0x7fe7640aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 -- 172.21.15.32:0/2765325387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640b4420 con 0x7fe7640b3ed0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe768a1c640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 0x7fe7640ab430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe758011910 tx=0x7fe758011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800fa90 con 0x7fe7640b3ed0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800fbf0 con 0x7fe7640b3ed0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.244+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7640b4700 con 0x7fe7640b3ed0 2024-02-17T00:37:08.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.245+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758014440 con 0x7fe7640b3ed0 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.245+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7640b4cc0 con 0x7fe7640b3ed0 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.246+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe764068fd0 con 0x7fe7640b3ed0 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.246+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe7580145a0 con 0x7fe7640b3ed0 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.246+0000 7fe761ffb640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe75006b840 0x7fe75006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.247+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe75808ace0 con 0x7fe7640b3ed0 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.247+0000 7fe76921d640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe75006b840 0x7fe75006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.247+0000 7fe76921d640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe75006b840 0x7fe75006dd00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe75c034000 tx=0x7fe75c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.251+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7580553c0 con 0x7fe7640b3ed0 2024-02-17T00:37:08.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.432+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe764161360 con 0x7fe7640b3ed0 2024-02-17T00:37:08.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.434+0000 7fe761ffb640 1 -- 172.21.15.32:0/2765325387 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7fe758058a80 con 0x7fe7640b3ed0 2024-02-17T00:37:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:08.436 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe75006b840 msgr2=0x7fe75006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe75006b840 0x7fe75006dd00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe75c034000 tx=0x7fe75c009030 comp rx=0 tx=0).stop 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 msgr2=0x7fe7640ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 0x7fe7640ab430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe758011910 tx=0x7fe758011dd0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 shutdown_connections 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7640ac5a0 0x7fe7640aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7640b3ed0 0x7fe7640ab430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe75006b840 0x7fe75006dd00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 --2- 172.21.15.32:0/2765325387 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe74c003970 0x7fe7640b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 >> 172.21.15.32:0/2765325387 conn(0x7fe76406bfe0 msgr2=0x7fe764160870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:08.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 shutdown_connections 2024-02-17T00:37:08.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.436+0000 7fe76b481640 1 -- 172.21.15.32:0/2765325387 wait complete. 2024-02-17T00:37:08.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:08.449 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.550+0000 7f44fb0b5640 1 Processor -- start 2024-02-17T00:37:08.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.550+0000 7f44fb0b5640 1 -- start start 2024-02-17T00:37:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44fb0b5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44f415dc40 0x7f44f40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44fb0b5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44f40b2800 0x7f44f40cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44fb0b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44fb0b5640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f415e020 con 0x7f44f40b2800 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44fb0b5640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f40d0250 con 0x7f44f415dc40 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44fb0b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40ccac0 con 0x7f44f40af710 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44f3fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44f40b2800 0x7f44f40cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44f3fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44f40b2800 0x7f44f40cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43932/0 (socket says 172.21.15.32:43932) 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.551+0000 7f44f3fff640 1 -- 172.21.15.32:0/3242003215 learned_addr learned my addr 172.21.15.32:0/3242003215 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f9652640 1 --2- 172.21.15.32:0/3242003215 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f8e51640 1 --2- 172.21.15.32:0/3242003215 >> v2:172.21.15.39:3300/0 conn(0x7f44f415dc40 0x7f44f40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f3fff640 1 -- 172.21.15.32:0/3242003215 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 msgr2=0x7f44f406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f3fff640 1 --2- 172.21.15.32:0/3242003215 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f3fff640 1 -- 172.21.15.32:0/3242003215 >> v2:172.21.15.39:3300/0 conn(0x7f44f415dc40 msgr2=0x7f44f40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f3fff640 1 --2- 172.21.15.32:0/3242003215 >> v2:172.21.15.39:3300/0 conn(0x7f44f415dc40 0x7f44f40cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f3fff640 1 -- 172.21.15.32:0/3242003215 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40cc7e0 con 0x7f44f40b2800 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f8e51640 1 --2- 172.21.15.32:0/3242003215 >> v2:172.21.15.39:3300/0 conn(0x7f44f415dc40 0x7f44f40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.552+0000 7f44f3fff640 1 --2- 172.21.15.32:0/3242003215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40b2800 0x7f44f40cfd10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f44f4070870 tx=0x7f44e802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9562f3755131e53e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44f37fe640 1 -- 172.21.15.32:0/3242003215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8031750 con 0x7f44f40b2800 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44f37fe640 1 -- 172.21.15.32:0/3242003215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e80318b0 con 0x7f44f40b2800 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44f37fe640 1 -- 172.21.15.32:0/3242003215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8031c40 con 0x7f44f40b2800 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 -- 172.21.15.32:0/3242003215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40b2800 msgr2=0x7f44f40cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/3242003215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40b2800 0x7f44f40cfd10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f44f4070870 tx=0x7f44e802b7f0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 -- 172.21.15.32:0/3242003215 shutdown_connections 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/3242003215 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/3242003215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40b2800 0x7f44f40cfd10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/3242003215 >> v2:172.21.15.39:3300/0 conn(0x7f44f415dc40 0x7f44f40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 -- 172.21.15.32:0/3242003215 >> 172.21.15.32:0/3242003215 conn(0x7f44f40999f0 msgr2=0x7f44f40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 -- 172.21.15.32:0/3242003215 shutdown_connections 2024-02-17T00:37:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.553+0000 7f44fb0b5640 1 -- 172.21.15.32:0/3242003215 wait complete. 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.554+0000 7f44fb0b5640 1 Processor -- start 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.554+0000 7f44fb0b5640 1 -- start start 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44fb0b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f4155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44fb0b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40b2800 0x7f44f40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44fb0b5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 0x7f44f40c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44fb0b5640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40c8c00 con 0x7f44f415dc40 2024-02-17T00:37:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44fb0b5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40c7f80 con 0x7f44f40b2800 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44fb0b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40c8260 con 0x7f44f40af710 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44f9652640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 0x7f44f40c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44f9652640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 0x7f44f40c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43948/0 (socket says 172.21.15.32:43948) 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44f9652640 1 -- 172.21.15.32:0/1632398354 learned_addr learned my addr 172.21.15.32:0/1632398354 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44f8e51640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f4155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.555+0000 7f44f3fff640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40b2800 0x7f44f40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f9652640 1 -- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 msgr2=0x7f44f4155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f9652640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f4155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f9652640 1 -- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40b2800 msgr2=0x7f44f40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f9652640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40b2800 0x7f44f40c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f9652640 1 -- 172.21.15.32:0/1632398354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e80094d0 con 0x7f44f415dc40 2024-02-17T00:37:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f9652640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 0x7f44f40c7610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d5d0 tx=0x7f44e400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4014620 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e40147a0 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f40c8540 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4014b50 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.556+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f4156070 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.557+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f40c8d40 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.557+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f44e4014cb0 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.558+0000 7f44f17fa640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44e006b810 0x7f44e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.558+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f44e408a820 con 0x7f44f415dc40 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.558+0000 7f44f8e51640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44e006b810 0x7f44e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.559+0000 7f44f8e51640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44e006b810 0x7f44e006dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44f41f6c60 tx=0x7f44ec007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.562+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44f40c8d40 con 0x7f44f415dc40 2024-02-17T00:37:08.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.744+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44f40c8d40 con 0x7f44f415dc40 2024-02-17T00:37:08.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.744+0000 7f44f17fa640 1 -- 172.21.15.32:0/1632398354 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44f40c8d40 con 0x7f44f415dc40 2024-02-17T00:37:08.747 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44e006b810 msgr2=0x7f44e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44e006b810 0x7f44e006dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44f41f6c60 tx=0x7f44ec007810 comp rx=0 tx=0).stop 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 msgr2=0x7f44f40c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 0x7f44f40c7610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d5d0 tx=0x7f44e400da90 comp rx=0 tx=0).stop 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 shutdown_connections 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f415dc40 0x7f44f40c7610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44f40b2800 0x7f44f40c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f44e006b810 0x7f44e006dcd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 --2- 172.21.15.32:0/1632398354 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f44f40af710 0x7f44f4155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 >> 172.21.15.32:0/1632398354 conn(0x7f44f40999f0 msgr2=0x7f44f40c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:08.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 shutdown_connections 2024-02-17T00:37:08.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.746+0000 7f44fb0b5640 1 -- 172.21.15.32:0/1632398354 wait complete. 2024-02-17T00:37:08.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:08.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.864+0000 7f0be8f25640 1 Processor -- start 2024-02-17T00:37:08.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.864+0000 7f0be8f25640 1 -- start start 2024-02-17T00:37:08.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be8f25640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40d0780 0x7f0be40d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be8f25640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0be40b9130 0x7f0be40d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be8f25640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be40d10a0 con 0x7f0be40b9590 2024-02-17T00:37:08.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be8f25640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be40b7ef0 con 0x7f0be40b9130 2024-02-17T00:37:08.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be8f25640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be40b81d0 con 0x7f0be40d0780 2024-02-17T00:37:08.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be259c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40d0780 0x7f0be40d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be1d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0be40b9130 0x7f0be40d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be2d9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0be40b9590 0x7f0be40d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:49446/0 (socket says 172.21.15.32:49446) 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be259c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40d0780 0x7f0be40d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:46132/0 (socket says 172.21.15.32:46132) 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be1d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0be40b9130 0x7f0be40d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45474/0 (socket says 172.21.15.32:45474) 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.865+0000 7f0be259c640 1 -- 172.21.15.32:0/2362493152 learned_addr learned my addr 172.21.15.32:0/2362493152 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.866+0000 7f0be1d9b640 1 -- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40d0780 msgr2=0x7f0be40d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.866+0000 7f0be1d9b640 1 --2- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40d0780 0x7f0be40d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.866+0000 7f0be1d9b640 1 -- 172.21.15.32:0/2362493152 >> v1:172.21.15.39:6789/0 conn(0x7f0be40b9590 legacy=0x7f0be40d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.866+0000 7f0be1d9b640 1 -- 172.21.15.32:0/2362493152 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40b84b0 con 0x7f0be40b9130 2024-02-17T00:37:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.866+0000 7f0be1d9b640 1 --2- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40b9130 0x7f0be40d1c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097a0 tx=0x7f0bcc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7399d70aa384475b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be159a640 1 -- 172.21.15.32:0/2362493152 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc031830 con 0x7f0be40b9130 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be159a640 1 -- 172.21.15.32:0/2362493152 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc031990 con 0x7f0be40b9130 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be159a640 1 -- 172.21.15.32:0/2362493152 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc031d20 con 0x7f0be40b9130 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be8f25640 1 -- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40b9130 msgr2=0x7f0be40d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be8f25640 1 --2- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40b9130 0x7f0be40d1c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097a0 tx=0x7f0bcc02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be8f25640 1 -- 172.21.15.32:0/2362493152 shutdown_connections 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be8f25640 1 --2- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40b9130 0x7f0be40d1c30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.867+0000 7f0be8f25640 1 --2- 172.21.15.32:0/2362493152 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40d0780 0x7f0be40d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.868+0000 7f0be8f25640 1 -- 172.21.15.32:0/2362493152 >> 172.21.15.32:0/2362493152 conn(0x7f0be40726b0 msgr2=0x7f0be4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.868+0000 7f0be8f25640 1 -- 172.21.15.32:0/2362493152 shutdown_connections 2024-02-17T00:37:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.868+0000 7f0be8f25640 1 -- 172.21.15.32:0/2362493152 wait complete. 2024-02-17T00:37:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.869+0000 7f0be8f25640 1 Processor -- start 2024-02-17T00:37:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.869+0000 7f0be8f25640 1 -- start start 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40b9130 0x7f0be415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 0x7f0be41f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40d0780 0x7f0be41f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be40aa420 con 0x7f0be40b9590 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41f48e0 con 0x7f0be40d0780 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41f4ea0 con 0x7f0be40b9130 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 0x7f0be41f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 0x7f0be41f33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43962/0 (socket says 172.21.15.32:43962) 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 -- 172.21.15.32:0/4271046613 learned_addr learned my addr 172.21.15.32:0/4271046613 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be259c640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40b9130 0x7f0be415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be2d9d640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40d0780 0x7f0be41f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 -- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40b9130 msgr2=0x7f0be415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40b9130 0x7f0be415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 -- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40d0780 msgr2=0x7f0be41f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40d0780 0x7f0be41f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 -- 172.21.15.32:0/4271046613 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009400 con 0x7f0be40b9590 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be2d9d640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40d0780 0x7f0be41f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be259c640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40b9130 0x7f0be415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be1d9b640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 0x7f0be41f33f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009890 tx=0x7f0bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc03b980 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc03bb00 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be415b300 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc045400 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.870+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be41f3ff0 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.871+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be40685d0 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.872+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0bcc04e440 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.872+0000 7f0bdaffd640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0bc406b810 0x7f0bc406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.872+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0bcc0ac740 con 0x7f0be40b9590 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.872+0000 7f0be259c640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0bc406b810 0x7f0bc406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:08.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.873+0000 7f0be259c640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0bc406b810 0x7f0bc406dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009440 tx=0x7f0bd400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:08.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:08.876+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bcc076e30 con 0x7f0be40b9590 2024-02-17T00:37:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.057+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0be4068f60 con 0x7f0be40b9590 2024-02-17T00:37:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.058+0000 7f0bdaffd640 1 -- 172.21.15.32:0/4271046613 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bcc07a4f0 con 0x7f0be40b9590 2024-02-17T00:37:09.061 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.059+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0bc406b810 msgr2=0x7f0bc406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.059+0000 7f0be8f25640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0bc406b810 0x7f0bc406dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009440 tx=0x7f0bd400b040 comp rx=0 tx=0).stop 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.059+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 msgr2=0x7f0be41f33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.059+0000 7f0be8f25640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 0x7f0be41f33f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009890 tx=0x7f0bcc0046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 shutdown_connections 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0be40d0780 0x7f0be41f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0be40b9590 0x7f0be41f33f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f0bc406b810 0x7f0bc406dcd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 --2- 172.21.15.32:0/4271046613 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0be40b9130 0x7f0be415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 >> 172.21.15.32:0/4271046613 conn(0x7f0be40726b0 msgr2=0x7f0be40ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 shutdown_connections 2024-02-17T00:37:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.060+0000 7f0be8f25640 1 -- 172.21.15.32:0/4271046613 wait complete. 2024-02-17T00:37:09.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:09.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 Processor -- start 2024-02-17T00:37:09.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 -- start start 2024-02-17T00:37:09.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc50c15f1c0 0x7fc50c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc50c0ce830 0x7fc50c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c0ce380 con 0x7fc50c0d3760 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0ceff0 con 0x7fc50c15f1c0 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.175+0000 7fc512f25640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c15f000 con 0x7fc50c0ce830 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc50c15f1c0 0x7fc50c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc50c15f1c0 0x7fc50c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43978/0 (socket says 172.21.15.32:43978) 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 -- 172.21.15.32:0/898968559 learned_addr learned my addr 172.21.15.32:0/898968559 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc5114c2640 1 --2- 172.21.15.32:0/898968559 >> v2:172.21.15.39:3300/0 conn(0x7fc50c0ce830 0x7fc50c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 -- 172.21.15.32:0/898968559 >> v2:172.21.15.39:3300/0 conn(0x7fc50c0ce830 msgr2=0x7fc50c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 --2- 172.21.15.32:0/898968559 >> v2:172.21.15.39:3300/0 conn(0x7fc50c0ce830 0x7fc50c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 -- 172.21.15.32:0/898968559 >> v1:172.21.15.39:6789/0 conn(0x7fc50c0d3760 legacy=0x7fc50c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.176+0000 7fc50bfff640 1 -- 172.21.15.32:0/898968559 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0d2190 con 0x7fc50c15f1c0 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc50bfff640 1 --2- 172.21.15.32:0/898968559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c15f1c0 0x7fc50c15eac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0cf180 tx=0x7fc4fc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70768696292364f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc50b7fe640 1 -- 172.21.15.32:0/898968559 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc030860 con 0x7fc50c15f1c0 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc50b7fe640 1 -- 172.21.15.32:0/898968559 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0309c0 con 0x7fc50c15f1c0 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc50b7fe640 1 -- 172.21.15.32:0/898968559 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc030d50 con 0x7fc50c15f1c0 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 -- 172.21.15.32:0/898968559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c15f1c0 msgr2=0x7fc50c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 --2- 172.21.15.32:0/898968559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c15f1c0 0x7fc50c15eac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0cf180 tx=0x7fc4fc02b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 -- 172.21.15.32:0/898968559 shutdown_connections 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 --2- 172.21.15.32:0/898968559 >> v2:172.21.15.39:3300/0 conn(0x7fc50c0ce830 0x7fc50c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 --2- 172.21.15.32:0/898968559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c15f1c0 0x7fc50c15eac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 -- 172.21.15.32:0/898968559 >> 172.21.15.32:0/898968559 conn(0x7fc50c072680 msgr2=0x7fc50c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 -- 172.21.15.32:0/898968559 shutdown_connections 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.177+0000 7fc512f25640 1 -- 172.21.15.32:0/898968559 wait complete. 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.178+0000 7fc512f25640 1 Processor -- start 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 -- start start 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 0x7fc50c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc50c0d3760 0x7fc50c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc50c15f1c0 0x7fc50c0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c158ea0 con 0x7fc50c0ce830 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1578c0 con 0x7fc50c0d3760 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc512f25640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c157ba0 con 0x7fc50c15f1c0 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc510cc1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 0x7fc50c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.179+0000 7fc510cc1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 0x7fc50c158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43992/0 (socket says 172.21.15.32:43992) 2024-02-17T00:37:09.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 -- 172.21.15.32:0/2480749701 learned_addr learned my addr 172.21.15.32:0/2480749701 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc5114c2640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc50c15f1c0 0x7fc50c0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 -- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc50c15f1c0 msgr2=0x7fc50c0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc50bfff640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc50c0d3760 0x7fc50c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc50c15f1c0 0x7fc50c0cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 -- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc50c0d3760 msgr2=0x7fc50c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc50c0d3760 0x7fc50c0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 -- 172.21.15.32:0/2480749701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0094d0 con 0x7fc50c0ce830 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc510cc1640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 0x7fc50c158960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c790 tx=0x7fc50400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400cea0 con 0x7fc50c0ce830 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504006d50 con 0x7fc50c0ce830 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c157e80 con 0x7fc50c0ce830 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504003bb0 con 0x7fc50c0ce830 2024-02-17T00:37:09.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.180+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c158440 con 0x7fc50c0ce830 2024-02-17T00:37:09.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.181+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c158630 con 0x7fc50c0ce830 2024-02-17T00:37:09.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.181+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc504003d10 con 0x7fc50c0ce830 2024-02-17T00:37:09.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.182+0000 7fc5097fa640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc4ec06b810 0x7fc4ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.182+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc50408a0d0 con 0x7fc50c0ce830 2024-02-17T00:37:09.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.182+0000 7fc50bfff640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc4ec06b810 0x7fc4ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.183+0000 7fc50bfff640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc4ec06b810 0x7fc4ec06dcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc036000 tx=0x7fc4fc03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.186+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc504058370 con 0x7fc50c0ce830 2024-02-17T00:37:09.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.363+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc50c068f60 con 0x7fc50c0ce830 2024-02-17T00:37:09.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.364+0000 7fc5097fa640 1 -- 172.21.15.32:0/2480749701 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc504057f00 con 0x7fc50c0ce830 2024-02-17T00:37:09.367 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc4ec06b810 msgr2=0x7fc4ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc4ec06b810 0x7fc4ec06dcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc036000 tx=0x7fc4fc03b040 comp rx=0 tx=0).stop 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 msgr2=0x7fc50c158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 0x7fc50c158960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c790 tx=0x7fc50400cc50 comp rx=0 tx=0).stop 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 shutdown_connections 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc4ec06b810 0x7fc4ec06dcd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc50c15f1c0 0x7fc50c0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc50c0d3760 0x7fc50c0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 --2- 172.21.15.32:0/2480749701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc50c0ce830 0x7fc50c158960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 >> 172.21.15.32:0/2480749701 conn(0x7fc50c072680 msgr2=0x7fc50c0d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:09.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 shutdown_connections 2024-02-17T00:37:09.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.366+0000 7fc512f25640 1 -- 172.21.15.32:0/2480749701 wait complete. 2024-02-17T00:37:09.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:09.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 Processor -- start 2024-02-17T00:37:09.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 -- start start 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80d3760 0x7f26d815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f26d80ce830 0x7f26d80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d80ce380 con 0x7f26d815f1c0 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80ceff0 con 0x7f26d80ce830 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.481+0000 7f26dc89d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d815f000 con 0x7f26d80d3760 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d659c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80d3760 0x7f26d815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d6d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f26d80ce830 0x7f26d80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26cffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f26d815f1c0 0x7f26d80d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:49468/0 (socket says 172.21.15.32:49468) 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26cffff640 1 -- 172.21.15.32:0/2008532171 learned_addr learned my addr 172.21.15.32:0/2008532171 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d5d9b640 1 -- 172.21.15.32:0/2008532171 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220240380 0 0) 0x7f26d80ce380 con 0x7f26d815f1c0 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d5d9b640 1 -- 172.21.15.32:0/2008532171 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c4003520 con 0x7f26d815f1c0 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d6d9d640 1 -- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80d3760 msgr2=0x7f26d815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d6d9d640 1 --2- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80d3760 0x7f26d815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d6d9d640 1 -- 172.21.15.32:0/2008532171 >> v1:172.21.15.39:6789/0 conn(0x7f26d815f1c0 legacy=0x7f26d80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.482+0000 7f26d6d9d640 1 -- 172.21.15.32:0/2008532171 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d80d2190 con 0x7f26d80ce830 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.483+0000 7f26d6d9d640 1 --2- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80ce830 0x7f26d80b2240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009d90 tx=0x7f26d002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580842542c55cad3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.483+0000 7f26d5d9b640 1 -- 172.21.15.32:0/2008532171 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d002cc50 con 0x7f26d80ce830 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.483+0000 7f26d5d9b640 1 -- 172.21.15.32:0/2008532171 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d002cdb0 con 0x7f26d80ce830 2024-02-17T00:37:09.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.483+0000 7f26d5d9b640 1 -- 172.21.15.32:0/2008532171 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0034660 con 0x7f26d80ce830 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 -- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80ce830 msgr2=0x7f26d80b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 --2- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80ce830 0x7f26d80b2240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009d90 tx=0x7f26d002bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 -- 172.21.15.32:0/2008532171 shutdown_connections 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 --2- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80ce830 0x7f26d80b2240 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 --2- 172.21.15.32:0/2008532171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80d3760 0x7f26d815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 -- 172.21.15.32:0/2008532171 >> 172.21.15.32:0/2008532171 conn(0x7f26d8072680 msgr2=0x7f26d8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:09.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 -- 172.21.15.32:0/2008532171 shutdown_connections 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.484+0000 7f26dc89d640 1 -- 172.21.15.32:0/2008532171 wait complete. 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.485+0000 7f26dc89d640 1 Processor -- start 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.485+0000 7f26dc89d640 1 -- start start 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26dc89d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80ce830 0x7f26d81f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26dc89d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80d3760 0x7f26d81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26dc89d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 0x7f26d8154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26dc89d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80ca0a0 con 0x7f26d815f1c0 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26dc89d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8155450 con 0x7f26d80d3760 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26dc89d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80c9dc0 con 0x7f26d80ce830 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 0x7f26d8154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 0x7f26d8154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44008/0 (socket says 172.21.15.32:44008) 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 -- 172.21.15.32:0/1875751253 learned_addr learned my addr 172.21.15.32:0/1875751253 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26cffff640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80d3760 0x7f26d81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d659c640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80ce830 0x7f26d81f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 -- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80ce830 msgr2=0x7f26d81f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80ce830 0x7f26d81f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 -- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80d3760 msgr2=0x7f26d81549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80d3760 0x7f26d81549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 -- 172.21.15.32:0/1875751253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0009a70 con 0x7f26d815f1c0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26d6d9d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 0x7f26d8154f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009d90 tx=0x7f26d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.486+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0040650 con 0x7f26d815f1c0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.487+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d00407d0 con 0x7f26d815f1c0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.487+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d8156dd0 con 0x7f26d815f1c0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.487+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0040b80 con 0x7f26d815f1c0 2024-02-17T00:37:09.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.487+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d8157390 con 0x7f26d815f1c0 2024-02-17T00:37:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.488+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d8068f60 con 0x7f26d815f1c0 2024-02-17T00:37:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.488+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f26d0040ce0 con 0x7f26d815f1c0 2024-02-17T00:37:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.488+0000 7f26ceffd640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f26b806b810 0x7f26b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.488+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f26d00ad0f0 con 0x7f26d815f1c0 2024-02-17T00:37:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.488+0000 7f26d659c640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f26b806b810 0x7f26b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.489+0000 7f26d659c640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f26b806b810 0x7f26b806dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26d8155b50 tx=0x7f26c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.492+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f26d0077940 con 0x7f26d815f1c0 2024-02-17T00:37:09.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.673+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f26d80ce610 con 0x7f26d815f1c0 2024-02-17T00:37:09.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.673+0000 7f26ceffd640 1 -- 172.21.15.32:0/1875751253 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f26d0009450 con 0x7f26d815f1c0 2024-02-17T00:37:09.676 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f26b806b810 msgr2=0x7f26b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f26b806b810 0x7f26b806dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26d8155b50 tx=0x7f26c8009190 comp rx=0 tx=0).stop 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 msgr2=0x7f26d8154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 0x7f26d8154f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009d90 tx=0x7f26d0004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 shutdown_connections 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26d815f1c0 0x7f26d8154f10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26d80d3760 0x7f26d81549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f26b806b810 0x7f26b806dcd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 --2- 172.21.15.32:0/1875751253 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26d80ce830 0x7f26d81f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 >> 172.21.15.32:0/1875751253 conn(0x7f26d8072680 msgr2=0x7f26d815e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.675+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 shutdown_connections 2024-02-17T00:37:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.676+0000 7f26dc89d640 1 -- 172.21.15.32:0/1875751253 wait complete. 2024-02-17T00:37:09.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:09.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.788+0000 7f7abb54f640 1 Processor -- start 2024-02-17T00:37:09.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.788+0000 7f7abb54f640 1 -- start start 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7abb54f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 0x7f7ab40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7abb54f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ab415c8f0 0x7f7ab406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7abb54f640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab4160110 con 0x7f7ab406b0a0 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7abb54f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab406b530 con 0x7f7ab415c8f0 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7abb54f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab415cd50 con 0x7f7ab4145260 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7ab9aec640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7ab406b0a0 0x7f7ab40d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57674/0 (socket says 172.21.15.32:57674) 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.789+0000 7f7ab9aec640 1 -- 172.21.15.32:0/672122317 learned_addr learned my addr 172.21.15.32:0/672122317 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab92eb640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 0x7f7ab40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558967878 0 0) 0x7f7ab4160110 con 0x7f7ab406b0a0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/672122317 >> v2:172.21.15.39:3300/0 conn(0x7f7ab415c8f0 0x7f7ab406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c003520 con 0x7f7ab406b0a0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 824792080 0 0) 0x7f7a9c003520 con 0x7f7ab406b0a0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 msgr2=0x7f7ab40726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 0x7f7ab40726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 >> v2:172.21.15.39:3300/0 conn(0x7f7ab415c8f0 msgr2=0x7f7ab406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 --2- 172.21.15.32:0/672122317 >> v2:172.21.15.39:3300/0 conn(0x7f7ab415c8f0 0x7f7ab406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab415f500 con 0x7f7ab406b0a0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f7aa40019f0 con 0x7f7ab406b0a0 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/672122317 >> v2:172.21.15.39:3300/0 conn(0x7f7ab415c8f0 0x7f7ab406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 >> v1:172.21.15.32:6789/0 conn(0x7f7ab406b0a0 legacy=0x7f7ab40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 0x7f7a9c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a9c003ef0 0x7f7a9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a9c004d00 0x7f7a9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab406b530 con 0x7f7a9c003ef0 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab415cd50 con 0x7f7a9c004d00 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c00b980 con 0x7f7ab4145260 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a9c003ef0 0x7f7a9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab92eb640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 0x7f7a9c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab9aec640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a9c004d00 0x7f7a9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 -- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 msgr2=0x7f7a9c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7ab4145260 0x7f7a9c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 -- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a9c004d00 msgr2=0x7f7a9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a9c004d00 0x7f7a9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.790+0000 7f7ab8aea640 1 -- 172.21.15.32:0/672122317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c003520 con 0x7f7a9c003ef0 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.791+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a9c003ef0 0x7f7a9c0047c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009c90 tx=0x7f7a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c76175e281a88da server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.791+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa802c980 con 0x7f7a9c003ef0 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.791+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa802cae0 con 0x7f7a9c003ef0 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.791+0000 7f7ab3fff640 1 -- 172.21.15.32:0/672122317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8034440 con 0x7f7a9c003ef0 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7abb54f640 1 -- 172.21.15.32:0/672122317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a9c003ef0 msgr2=0x7f7a9c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7abb54f640 1 --2- 172.21.15.32:0/672122317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a9c003ef0 0x7f7a9c0047c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009c90 tx=0x7f7a9c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7ab9aec640 1 -- 172.21.15.32:0/672122317 reap_dead start 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7abb54f640 1 -- 172.21.15.32:0/672122317 shutdown_connections 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7abb54f640 1 -- 172.21.15.32:0/672122317 >> 172.21.15.32:0/672122317 conn(0x7f7ab40b5c30 msgr2=0x7f7ab40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7abb54f640 1 -- 172.21.15.32:0/672122317 shutdown_connections 2024-02-17T00:37:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.792+0000 7f7abb54f640 1 -- 172.21.15.32:0/672122317 wait complete. 2024-02-17T00:37:09.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.793+0000 7f7abb54f640 1 Processor -- start 2024-02-17T00:37:09.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.793+0000 7f7abb54f640 1 -- start start 2024-02-17T00:37:09.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7abb54f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7a9c003ef0 0x7f7ab409af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7abb54f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ab40afd50 0x7f7ab415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7abb54f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 0x7f7ab41f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7abb54f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab415b610 con 0x7f7ab415b190 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7abb54f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab409b820 con 0x7f7ab40afd50 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7abb54f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab409b540 con 0x7f7a9c003ef0 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 0x7f7ab41f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 0x7f7ab41f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44032/0 (socket says 172.21.15.32:44032) 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 -- 172.21.15.32:0/2819179485 learned_addr learned my addr 172.21.15.32:0/2819179485 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab8aea640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ab40afd50 0x7f7ab415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab92eb640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7a9c003ef0 0x7f7ab409af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 -- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7a9c003ef0 msgr2=0x7f7ab409af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7a9c003ef0 0x7f7ab409af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 -- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ab40afd50 msgr2=0x7f7ab415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ab40afd50 0x7f7ab415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 -- 172.21.15.32:0/2819179485 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4141cc0 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab9aec640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 0x7f7ab41f5090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4072f80 tx=0x7f7aa4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.794+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400ab60 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.795+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400acc0 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.795+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab4141fa0 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.795+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4013630 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.795+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4140570 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.796+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab41424c0 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.796+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7aa4013790 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.796+0000 7f7ab1ffb640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7aa006b840 0x7f7aa006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.796+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7aa408aac0 con 0x7f7ab415b190 2024-02-17T00:37:09.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.797+0000 7f7ab92eb640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7aa006b840 0x7f7aa006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:09.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.797+0000 7f7ab92eb640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7aa006b840 0x7f7aa006dd00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009ae0 tx=0x7f7aac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:09.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:09.801+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ab41424c0 con 0x7f7ab415b190 2024-02-17T00:37:10.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.018+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ab41424c0 con 0x7f7ab415b190 2024-02-17T00:37:10.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.018+0000 7f7ab1ffb640 1 -- 172.21.15.32:0/2819179485 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f7ab41424c0 con 0x7f7ab415b190 2024-02-17T00:37:10.021 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:10.021 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:10.022 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:10.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7aa006b840 msgr2=0x7f7aa006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7aa006b840 0x7f7aa006dd00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009ae0 tx=0x7f7aac009190 comp rx=0 tx=0).stop 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 msgr2=0x7f7ab41f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 0x7f7ab41f5090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4072f80 tx=0x7f7aa4007b10 comp rx=0 tx=0).stop 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 shutdown_connections 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ab415b190 0x7f7ab41f5090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ab40afd50 0x7f7ab415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f7aa006b840 0x7f7aa006dd00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 --2- 172.21.15.32:0/2819179485 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7a9c003ef0 0x7f7ab409af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 >> 172.21.15.32:0/2819179485 conn(0x7f7ab40b5c30 msgr2=0x7f7ab40cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 shutdown_connections 2024-02-17T00:37:10.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.020+0000 7f7abb54f640 1 -- 172.21.15.32:0/2819179485 wait complete. 2024-02-17T00:37:10.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:10.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.134+0000 7fc6532fb640 1 Processor -- start 2024-02-17T00:37:10.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.134+0000 7fc6532fb640 1 -- start start 2024-02-17T00:37:10.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc6532fb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc6532fb640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc64c06b270 0x7fc64c15d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc6532fb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c160110 con 0x7fc64c15c8f0 2024-02-17T00:37:10.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc6532fb640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c15cd50 con 0x7fc64c06b270 2024-02-17T00:37:10.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc6532fb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c15f500 con 0x7fc64c145260 2024-02-17T00:37:10.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc64c06b270 0x7fc64c15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc64c06b270 0x7fc64c15d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44048/0 (socket says 172.21.15.32:44048) 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 -- 172.21.15.32:0/4255731945 learned_addr learned my addr 172.21.15.32:0/4255731945 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651097640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 -- 172.21.15.32:0/4255731945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 msgr2=0x7fc64c0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c0726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 -- 172.21.15.32:0/4255731945 >> v1:172.21.15.39:6789/0 conn(0x7fc64c15c8f0 legacy=0x7fc64c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651898640 1 -- 172.21.15.32:0/4255731945 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c15f7e0 con 0x7fc64c06b270 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.135+0000 7fc651097640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.136+0000 7fc651898640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c06b270 0x7fc64c15d240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc644009e50 tx=0x7fc64402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ef9d895ee2566e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.136+0000 7fc643fff640 1 -- 172.21.15.32:0/4255731945 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64402ca70 con 0x7fc64c06b270 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.136+0000 7fc643fff640 1 -- 172.21.15.32:0/4255731945 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64402cbd0 con 0x7fc64c06b270 2024-02-17T00:37:10.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.136+0000 7fc643fff640 1 -- 172.21.15.32:0/4255731945 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6440343f0 con 0x7fc64c06b270 2024-02-17T00:37:10.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 -- 172.21.15.32:0/4255731945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c06b270 msgr2=0x7fc64c15d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c06b270 0x7fc64c15d240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc644009e50 tx=0x7fc64402bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 -- 172.21.15.32:0/4255731945 shutdown_connections 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c06b270 0x7fc64c15d240 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 --2- 172.21.15.32:0/4255731945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 -- 172.21.15.32:0/4255731945 >> 172.21.15.32:0/4255731945 conn(0x7fc64c0b5c30 msgr2=0x7fc64c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 -- 172.21.15.32:0/4255731945 shutdown_connections 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.137+0000 7fc6532fb640 1 -- 172.21.15.32:0/4255731945 wait complete. 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.138+0000 7fc6532fb640 1 Processor -- start 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.138+0000 7fc6532fb640 1 -- start start 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c06b270 0x7fc64c13d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 0x7fc64c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c13d600 con 0x7fc64c15c8f0 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1510c0 con 0x7fc64c06b270 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c140950 con 0x7fc64c145260 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 0x7fc64c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 0x7fc64c0ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44056/0 (socket says 172.21.15.32:44056) 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 -- 172.21.15.32:0/307821579 learned_addr learned my addr 172.21.15.32:0/307821579 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc650896640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 -- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 msgr2=0x7fc64c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 -- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c06b270 msgr2=0x7fc64c13d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651097640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c06b270 0x7fc64c13d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c06b270 0x7fc64c13d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 -- 172.21.15.32:0/307821579 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc644009b30 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc651898640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 0x7fc64c0ce040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc644036040 tx=0x7fc644004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64403e450 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64403e5d0 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c13fd40 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.139+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64403e980 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.140+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c140300 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.141+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c140a90 con 0x7fc64c15c8f0 2024-02-17T00:37:10.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.141+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc64403eae0 con 0x7fc64c15c8f0 2024-02-17T00:37:10.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.141+0000 7fc641ffb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc63006b810 0x7fc63006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.141+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc6440ad3f0 con 0x7fc64c15c8f0 2024-02-17T00:37:10.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.142+0000 7fc651097640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc63006b810 0x7fc63006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.142+0000 7fc651097640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc63006b810 0x7fc63006dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc64c13d890 tx=0x7fc648008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:10.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.145+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc644077ad0 con 0x7fc64c15c8f0 2024-02-17T00:37:10.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.327+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc64c068fd0 con 0x7fc64c15c8f0 2024-02-17T00:37:10.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.328+0000 7fc641ffb640 1 -- 172.21.15.32:0/307821579 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18470 (secure 0 0 0) 0x7fc64407b190 con 0x7fc64c15c8f0 2024-02-17T00:37:10.331 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:10.331 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:36:42.434086+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc63006b810 msgr2=0x7fc63006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc63006b810 0x7fc63006dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc64c13d890 tx=0x7fc648008040 comp rx=0 tx=0).stop 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 msgr2=0x7fc64c0ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 0x7fc64c0ce040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc644036040 tx=0x7fc644004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 shutdown_connections 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc64c15c8f0 0x7fc64c0ce040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc63006b810 0x7fc63006dcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc64c145260 0x7fc64c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 --2- 172.21.15.32:0/307821579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c06b270 0x7fc64c13d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 >> 172.21.15.32:0/307821579 conn(0x7fc64c0b5c30 msgr2=0x7fc64c06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 shutdown_connections 2024-02-17T00:37:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.330+0000 7fc6532fb640 1 -- 172.21.15.32:0/307821579 wait complete. 2024-02-17T00:37:10.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:10.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.442+0000 7f193a3a0640 1 Processor -- start 2024-02-17T00:37:10.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f193a3a0640 1 -- start start 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f193a3a0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f193415dd00 0x7f19340b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f193a3a0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19340b6a40 0x7f19340b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f193a3a0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193415e0e0 con 0x7f193406bfb0 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f193a3a0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193406cfe0 con 0x7f19340b6a40 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f193a3a0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193406cd00 con 0x7f193415dd00 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f19337fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19340b6a40 0x7f19340b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f19337fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19340b6a40 0x7f19340b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44072/0 (socket says 172.21.15.32:44072) 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.443+0000 7f19337fe640 1 -- 172.21.15.32:0/757182715 learned_addr learned my addr 172.21.15.32:0/757182715 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.444+0000 7f1933fff640 1 --2- 172.21.15.32:0/757182715 >> v2:172.21.15.39:3300/0 conn(0x7f193415dd00 0x7f19340b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.444+0000 7f19337fe640 1 -- 172.21.15.32:0/757182715 >> v2:172.21.15.39:3300/0 conn(0x7f193415dd00 msgr2=0x7f19340b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.444+0000 7f19337fe640 1 --2- 172.21.15.32:0/757182715 >> v2:172.21.15.39:3300/0 conn(0x7f193415dd00 0x7f19340b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.444+0000 7f19337fe640 1 -- 172.21.15.32:0/757182715 >> v1:172.21.15.39:6789/0 conn(0x7f193406bfb0 legacy=0x7f193406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.444+0000 7f19337fe640 1 -- 172.21.15.32:0/757182715 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340d1ca0 con 0x7f19340b6a40 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.444+0000 7f19337fe640 1 --2- 172.21.15.32:0/757182715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19340b6a40 0x7f19340b5c90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19340d4920 tx=0x7f192402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bb638e4e201b57 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f1932ffd640 1 -- 172.21.15.32:0/757182715 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924030860 con 0x7f19340b6a40 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f1932ffd640 1 -- 172.21.15.32:0/757182715 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19240309c0 con 0x7f19340b6a40 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f1932ffd640 1 -- 172.21.15.32:0/757182715 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924030d50 con 0x7f19340b6a40 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 -- 172.21.15.32:0/757182715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19340b6a40 msgr2=0x7f19340b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 --2- 172.21.15.32:0/757182715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19340b6a40 0x7f19340b5c90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19340d4920 tx=0x7f192402b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 -- 172.21.15.32:0/757182715 shutdown_connections 2024-02-17T00:37:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 --2- 172.21.15.32:0/757182715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19340b6a40 0x7f19340b5c90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 --2- 172.21.15.32:0/757182715 >> v2:172.21.15.39:3300/0 conn(0x7f193415dd00 0x7f19340b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 -- 172.21.15.32:0/757182715 >> 172.21.15.32:0/757182715 conn(0x7f19340d07b0 msgr2=0x7f19340d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 -- 172.21.15.32:0/757182715 shutdown_connections 2024-02-17T00:37:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.445+0000 7f193a3a0640 1 -- 172.21.15.32:0/757182715 wait complete. 2024-02-17T00:37:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.446+0000 7f193a3a0640 1 Processor -- start 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 -- start start 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 0x7f19340ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19340b6a40 0x7f19340caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f193415dd00 0x7f19340cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934158b50 con 0x7f193406bfb0 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934157340 con 0x7f19340b6a40 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f193a3a0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934152490 con 0x7f193415dd00 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f1933fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 0x7f19340ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f1933fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 0x7f19340ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44078/0 (socket says 172.21.15.32:44078) 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.447+0000 7f1933fff640 1 -- 172.21.15.32:0/1754224375 learned_addr learned my addr 172.21.15.32:0/1754224375 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f193893d640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f193415dd00 0x7f19340cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f19337fe640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19340b6a40 0x7f19340caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1933fff640 1 -- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f193415dd00 msgr2=0x7f19340cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1933fff640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f193415dd00 0x7f19340cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1933fff640 1 -- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19340b6a40 msgr2=0x7f19340caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1933fff640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19340b6a40 0x7f19340caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1933fff640 1 -- 172.21.15.32:0/1754224375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240094d0 con 0x7f193406bfb0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f19337fe640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19340b6a40 0x7f19340caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1933fff640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 0x7f19340ca9e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f192800d5f0 tx=0x7f192800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280125f0 con 0x7f193406bfb0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928012750 con 0x7f193406bfb0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928012b00 con 0x7f193406bfb0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19340cd670 con 0x7f193406bfb0 2024-02-17T00:37:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.448+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934158770 con 0x7f193406bfb0 2024-02-17T00:37:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.449+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19340680c0 con 0x7f193406bfb0 2024-02-17T00:37:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.450+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1928012c60 con 0x7f193406bfb0 2024-02-17T00:37:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.450+0000 7f1930ff9640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f192006b810 0x7f192006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.450+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f192808a940 con 0x7f193406bfb0 2024-02-17T00:37:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.450+0000 7f19337fe640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f192006b810 0x7f192006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.451+0000 7f19337fe640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f192006b810 0x7f192006dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1924036000 tx=0x7f1924008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.454+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1928055020 con 0x7f193406bfb0 2024-02-17T00:37:10.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.672+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1934158dc0 con 0x7f193406bfb0 2024-02-17T00:37:10.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.673+0000 7f1930ff9640 1 -- 172.21.15.32:0/1754224375 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f19280586e0 con 0x7f193406bfb0 2024-02-17T00:37:10.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:10.676 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:10.677 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:10.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f192006b810 msgr2=0x7f192006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f192006b810 0x7f192006dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1924036000 tx=0x7f1924008030 comp rx=0 tx=0).stop 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 msgr2=0x7f19340ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 0x7f19340ca9e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f192800d5f0 tx=0x7f192800dab0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 shutdown_connections 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f192006b810 0x7f192006dcd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f193415dd00 0x7f19340cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19340b6a40 0x7f19340caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 --2- 172.21.15.32:0/1754224375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193406bfb0 0x7f19340ca9e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 >> 172.21.15.32:0/1754224375 conn(0x7f19340d07b0 msgr2=0x7f19340b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 shutdown_connections 2024-02-17T00:37:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:10.675+0000 7f193a3a0640 1 -- 172.21.15.32:0/1754224375 wait complete. 2024-02-17T00:37:11.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T00:36:37.380132+0000', 'modified': '2024-02-17T00:36:59.479309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6837/268609901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 268609901}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 268609901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T00:37:11.092 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T00:37:11.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-17T00:37:11.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.194+0000 7fcc2b0fb640 1 Processor -- start 2024-02-17T00:37:11.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.194+0000 7fcc2b0fb640 1 -- start start 2024-02-17T00:37:11.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc2b0fb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcc2415db00 0x7fcc240d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc2b0fb640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc240b53b0 0x7fcc240d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc2b0fb640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc240d1e80 con 0x7fcc240ce2b0 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc2b0fb640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc240b5930 con 0x7fcc240b53b0 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc2b0fb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc240b5c10 con 0x7fcc2415db00 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc240b53b0 0x7fcc240d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc240b53b0 0x7fcc240d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44090/0 (socket says 172.21.15.32:44090) 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 -- 172.21.15.32:0/187727185 learned_addr learned my addr 172.21.15.32:0/187727185 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc29698640 1 --1- 172.21.15.32:0/187727185 >> v1:172.21.15.32:6789/0 conn(0x7fcc240ce2b0 0x7fcc24161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57678/0 (socket says 172.21.15.32:57678) 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc28e97640 1 --2- 172.21.15.32:0/187727185 >> v2:172.21.15.39:3300/0 conn(0x7fcc2415db00 0x7fcc240d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 -- 172.21.15.32:0/187727185 >> v2:172.21.15.39:3300/0 conn(0x7fcc2415db00 msgr2=0x7fcc240d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 --2- 172.21.15.32:0/187727185 >> v2:172.21.15.39:3300/0 conn(0x7fcc2415db00 0x7fcc240d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 -- 172.21.15.32:0/187727185 >> v1:172.21.15.32:6789/0 conn(0x7fcc240ce2b0 legacy=0x7fcc24161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc23fff640 1 -- 172.21.15.32:0/187727185 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240b5ef0 con 0x7fcc240b53b0 2024-02-17T00:37:11.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc237fe640 1 -- 172.21.15.32:0/187727185 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177112014 0 0) 0x7fcc240d1e80 con 0x7fcc240ce2b0 2024-02-17T00:37:11.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.195+0000 7fcc28e97640 1 --2- 172.21.15.32:0/187727185 >> v2:172.21.15.39:3300/0 conn(0x7fcc2415db00 0x7fcc240d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.196+0000 7fcc23fff640 1 --2- 172.21.15.32:0/187727185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc240b53b0 0x7fcc240d0880 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc240d4940 tx=0x7fcc1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac54ef734717ce33 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.196+0000 7fcc237fe640 1 -- 172.21.15.32:0/187727185 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10030860 con 0x7fcc240b53b0 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.196+0000 7fcc237fe640 1 -- 172.21.15.32:0/187727185 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc100309c0 con 0x7fcc240b53b0 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.196+0000 7fcc237fe640 1 -- 172.21.15.32:0/187727185 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10030d50 con 0x7fcc240b53b0 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/187727185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc240b53b0 msgr2=0x7fcc240d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/187727185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc240b53b0 0x7fcc240d0880 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc240d4940 tx=0x7fcc1002b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/187727185 shutdown_connections 2024-02-17T00:37:11.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/187727185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc240b53b0 0x7fcc240d0880 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/187727185 >> v2:172.21.15.39:3300/0 conn(0x7fcc2415db00 0x7fcc240d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/187727185 >> 172.21.15.32:0/187727185 conn(0x7fcc24072290 msgr2=0x7fcc240726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/187727185 shutdown_connections 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.197+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/187727185 wait complete. 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.198+0000 7fcc2b0fb640 1 Processor -- start 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.198+0000 7fcc2b0fb640 1 -- start start 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc240b53b0 0x7fcc240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc240ce2b0 0x7fcc241f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 0x7fcc241f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241f0ea0 con 0x7fcc2415db00 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24160370 con 0x7fcc240b53b0 2024-02-17T00:37:11.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24160650 con 0x7fcc240ce2b0 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 0x7fcc241f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 0x7fcc241f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44096/0 (socket says 172.21.15.32:44096) 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 -- 172.21.15.32:0/3281821239 learned_addr learned my addr 172.21.15.32:0/3281821239 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc23fff640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc240ce2b0 0x7fcc241f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc28e97640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc240b53b0 0x7fcc240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 -- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc240ce2b0 msgr2=0x7fcc241f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc240ce2b0 0x7fcc241f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 -- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc240b53b0 msgr2=0x7fcc240b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc240b53b0 0x7fcc240b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 -- 172.21.15.32:0/3281821239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100094d0 con 0x7fcc2415db00 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc29698640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 0x7fcc241f3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c7a0 tx=0x7fcc1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc217fa640 1 -- 172.21.15.32:0/3281821239 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00a640 con 0x7fcc2415db00 2024-02-17T00:37:11.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc217fa640 1 -- 172.21.15.32:0/3281821239 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00a7a0 con 0x7fcc2415db00 2024-02-17T00:37:11.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc24160930 con 0x7fcc2415db00 2024-02-17T00:37:11.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.199+0000 7fcc217fa640 1 -- 172.21.15.32:0/3281821239 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00abd0 con 0x7fcc2415db00 2024-02-17T00:37:11.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.200+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2415fed0 con 0x7fcc2415db00 2024-02-17T00:37:11.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.201+0000 7fcc217fa640 1 -- 172.21.15.32:0/3281821239 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcc1c00ad30 con 0x7fcc2415db00 2024-02-17T00:37:11.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.202+0000 7fcc217fa640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc0806b840 0x7fcc0806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.202+0000 7fcc217fa640 1 -- 172.21.15.32:0/3281821239 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcc1c089c40 con 0x7fcc2415db00 2024-02-17T00:37:11.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.202+0000 7fcc28e97640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc0806b840 0x7fcc0806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.202+0000 7fcc28e97640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc0806b840 0x7fcc0806dd00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc2415c5a0 tx=0x7fcc18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 Processor -- start 2024-02-17T00:37:11.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 -- start start 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f2820a0 0x56256f282480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 0x56256f27f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f255c20 0x56256f27f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f212dc0 con 0x56256f2520c0 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f1c5f20 con 0x56256f2820a0 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x56256f1c3450 con 0x56256f255c20 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.203+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 0x56256f27f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 0x56256f27f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44110/0 (socket says 172.21.15.32:44110) 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 -- 172.21.15.32:0/843927344 learned_addr learned my addr 172.21.15.32:0/843927344 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc28e97640 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f2820a0 0x56256f282480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc29698640 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f255c20 0x56256f27f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 -- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f255c20 msgr2=0x56256f27f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f255c20 0x56256f27f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 -- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f2820a0 msgr2=0x56256f282480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f2820a0 0x56256f282480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 -- 172.21.15.32:0/843927344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56256f173f20 con 0x56256f2520c0 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc23fff640 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 0x56256f27f310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcc100090b0 tx=0x7fcc10030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af36fee44a575c78 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc0e7fc640 1 -- 172.21.15.32:0/843927344 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10030db0 con 0x56256f2520c0 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc0e7fc640 1 -- 172.21.15.32:0/843927344 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10039450 con 0x56256f2520c0 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.204+0000 7fcc0e7fc640 1 -- 172.21.15.32:0/843927344 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10039800 con 0x56256f2520c0 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/843927344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 msgr2=0x56256f27f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 0x56256f27f310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcc100090b0 tx=0x7fcc10030000 comp rx=0 tx=0).stop 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/843927344 shutdown_connections 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f255c20 0x56256f27f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2520c0 0x56256f27f310 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/843927344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f2820a0 0x56256f282480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/843927344 >> 172.21.15.32:0/843927344 conn(0x56256f254330 msgr2=0x56256f29ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/843927344 shutdown_connections 2024-02-17T00:37:11.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/843927344 wait complete. 2024-02-17T00:37:11.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.205+0000 7fcc2ddaf740 1 -- start start 2024-02-17T00:37:11.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 Processor -- start 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f26c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f2820a0 0x56256f285850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 0x56256f282480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f1bec30 con 0x56256f27c120 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f163d30 con 0x56256f255c20 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x56256ee92310 con 0x56256f2820a0 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc2ddaf740 10 client.0 _ll_register_callbacks cb 0x56256f16bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 0x56256f282480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 0x56256f282480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44118/0 (socket says 172.21.15.32:44118) 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f2820a0 0x56256f285850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.206+0000 7fcc29698640 1 -- 172.21.15.32:0/345976798 learned_addr learned my addr 172.21.15.32:0/345976798 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc28e97640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f26c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc29698640 1 -- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f2820a0 msgr2=0x56256f285850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc29698640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f2820a0 0x56256f285850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc29698640 1 -- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 msgr2=0x56256f26c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc29698640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f26c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc29698640 1 -- 172.21.15.32:0/345976798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc240b5ef0 con 0x56256f27c120 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc23fff640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f2820a0 0x56256f285850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc29698640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 0x56256f282480 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c054590 tx=0x7fcc1c0581f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ac4514d927c4f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc037fe640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc037fe640 1 -- 172.21.15.32:0/345976798 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c057780 con 0x56256f27c120 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc037fe640 1 -- 172.21.15.32:0/345976798 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcc1c05e170 con 0x56256f27c120 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56256eebe6c0 con 0x56256f27c120 2024-02-17T00:37:11.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc037fe640 1 -- 172.21.15.32:0/345976798 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc1c0578e0 con 0x56256f27c120 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc2ddaf740 10 client.4842 fetch_fsmap learned FSMap version 8 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56256f1bd2b0 con 0x56256f27c120 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc037fe640 1 -- 172.21.15.32:0/345976798 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56256eebe6c0 con 0x56256f27c120 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc037fe640 1 -- 172.21.15.32:0/345976798 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fcc1c05e350 con 0x56256f27c120 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc2ddaf740 10 client.4842 fetch_fsmap finished waiting for FSMap version 8 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc2ddaf740 10 client.4842 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.207+0000 7fcc2ddaf740 20 client.4842 populate_metadata read hostname 'smithi032' 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.208+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f2babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.208+0000 7fcc2ddaf740 4 client.4842 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.208+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 --> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56256ef0f270 con 0x56256f2b8800 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.208+0000 7fcc28e97640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f2babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.208+0000 7fcc28e97640 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f2babf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebcc989e5b40fd53 server_cookie=ca431e84d007ffc2 in_seq=0 out_seq=0 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.208+0000 7fcc037fe640 10 client.4842 ms_handle_connect on v2:172.21.15.39:6834/268609901 2024-02-17T00:37:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc037fe640 1 -- 172.21.15.32:0/345976798 <== mds.0 v2:172.21.15.39:6834/268609901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56256ef0f270 con 0x56256f2b8800 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc037fe640 10 client.4842 handle_command_reply: tid=0 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 client.4842 shutdown 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 msgr2=0x56256f282480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 0x56256f282480 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c054590 tx=0x7fcc1c0581f0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 shutdown_connections 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f2babf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f27c120 0x56256f282480 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f2820a0 0x56256f285850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc037fe640 0 client.4842 ms_handle_reset on v2:172.21.15.39:6834/268609901 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/345976798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f26c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 >> 172.21.15.32:0/345976798 conn(0x56256f2520c0 msgr2=0x56256f285ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 shutdown_connections 2024-02-17T00:37:11.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/345976798 wait complete. 2024-02-17T00:37:11.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.209+0000 7fcc2ddaf740 20 client.4842 trim_cache size 0 max 16384 2024-02-17T00:37:11.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 Processor -- start 2024-02-17T00:37:11.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 -- start start 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f2af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f144490 con 0x56256f2820a0 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f282df0 con 0x56256f255c20 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.225+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x56256f259700 con 0x56256f27c120 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44128/0 (socket says 172.21.15.32:44128) 2024-02-17T00:37:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 -- 172.21.15.32:0/267035361 learned_addr learned my addr 172.21.15.32:0/267035361 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 -- 172.21.15.32:0/267035361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 msgr2=0x56256f2857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 -- 172.21.15.32:0/267035361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 msgr2=0x56256f2af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f2af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 -- 172.21.15.32:0/267035361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56256f159a20 con 0x56256f2820a0 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc29698640 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c054ab0 tx=0x7fcc1c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a31802f471969 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc0dffb640 1 -- 172.21.15.32:0/267035361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c054120 con 0x56256f2820a0 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc0dffb640 1 -- 172.21.15.32:0/267035361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c05c1d0 con 0x56256f2820a0 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.226+0000 7fcc0dffb640 1 -- 172.21.15.32:0/267035361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0577c0 con 0x56256f2820a0 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/267035361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 msgr2=0x56256f285d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c054ab0 tx=0x7fcc1c01e000 comp rx=0 tx=0).stop 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/267035361 shutdown_connections 2024-02-17T00:37:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/267035361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f2af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/267035361 >> 172.21.15.32:0/267035361 conn(0x56256f2520c0 msgr2=0x56256f258080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/267035361 shutdown_connections 2024-02-17T00:37:11.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/267035361 wait complete. 2024-02-17T00:37:11.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 -- start start 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.227+0000 7fcc2ddaf740 1 Processor -- start 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f27f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f2571d0 con 0x56256f2820a0 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256f257370 con 0x56256f255c20 2024-02-17T00:37:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x56256f2834a0 con 0x56256f27c120 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc2ddaf740 10 client.0 _ll_register_callbacks cb 0x7fcc10006cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc29698640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44142/0 (socket says 172.21.15.32:44142) 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc29698640 1 -- 172.21.15.32:0/2593828258 learned_addr learned my addr 172.21.15.32:0/2593828258 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc23fff640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.228+0000 7fcc28e97640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f27f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc29698640 1 -- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 msgr2=0x56256f2857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc29698640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc29698640 1 -- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 msgr2=0x56256f27f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc29698640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f27f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc29698640 1 -- 172.21.15.32:0/2593828258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56256f1bd2b0 con 0x56256f2820a0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc29698640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c054590 tx=0x7fcc1c087d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d994325dbab312e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc037fe640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-02-17T00:37:11.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc037fe640 1 -- 172.21.15.32:0/2593828258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c05e370 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc037fe640 1 -- 172.21.15.32:0/2593828258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcc1c056ff0 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc10039450 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc037fe640 1 -- 172.21.15.32:0/2593828258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc1c05e4d0 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 10 client.4848 fetch_fsmap learned FSMap version 8 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56256f17f780 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc037fe640 1 -- 172.21.15.32:0/2593828258 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10039450 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc037fe640 1 -- 172.21.15.32:0/2593828258 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fcc1c0571b0 con 0x56256f2820a0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 10 client.4848 fetch_fsmap finished waiting for FSMap version 8 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 10 client.4848 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 20 client.4848 populate_metadata read hostname 'smithi032' 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f277660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 4 client.4848 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.229+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 --> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56256eefb610 con 0x56256f2b8800 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc28e97640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f277660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc28e97640 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f277660 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294c4a22f9fe04c7 server_cookie=4888588a3cb986e3 in_seq=0 out_seq=0 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc037fe640 10 client.4848 ms_handle_connect on v2:172.21.15.39:6834/268609901 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc037fe640 1 -- 172.21.15.32:0/2593828258 <== mds.0 v2:172.21.15.39:6834/268609901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56256eefb610 con 0x56256f2b8800 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc037fe640 10 client.4848 handle_command_reply: tid=0 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 client.4848 shutdown 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 msgr2=0x56256f285d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c054590 tx=0x7fcc1c087d00 comp rx=0 tx=0).stop 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 shutdown_connections 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:6834/268609901,v1:172.21.15.39:6837/268609901] conn(0x56256f2b8800 0x56256f277660 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56256f2820a0 0x56256f285d20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x56256f27c120 0x56256f2857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc037fe640 0 client.4848 ms_handle_reset on v2:172.21.15.39:6834/268609901 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 --2- 172.21.15.32:0/2593828258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56256f255c20 0x56256f27f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 >> 172.21.15.32:0/2593828258 conn(0x56256f2520c0 msgr2=0x56256f2afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.230+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 shutdown_connections 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2ddaf740 1 -- 172.21.15.32:0/2593828258 wait complete. 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2ddaf740 20 client.4848 trim_cache size 0 max 16384 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "2fde0ac4-9f5d-41d6-aea9-1575265f7f65", 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4294, 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-02-17T00:37:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 33.204373920999998, 2024-02-17T00:37:11.241 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 8, 2024-02-17T00:37:11.241 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 27, 2024-02-17T00:37:11.241 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 27, 2024-02-17T00:37:11.241 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 39.855511700999998 2024-02-17T00:37:11.241 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc0806b840 msgr2=0x7fcc0806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc0806b840 0x7fcc0806dd00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc2415c5a0 tx=0x7fcc18008040 comp rx=0 tx=0).stop 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 msgr2=0x7fcc241f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 0x7fcc241f3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c7a0 tx=0x7fcc1c00cc60 comp rx=0 tx=0).stop 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 shutdown_connections 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2415db00 0x7fcc241f3990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcc0806b840 0x7fcc0806dd00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcc240ce2b0 0x7fcc241f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 --2- 172.21.15.32:0/3281821239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc240b53b0 0x7fcc240b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 >> 172.21.15.32:0/3281821239 conn(0x7fcc24072290 msgr2=0x7fcc24157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 shutdown_connections 2024-02-17T00:37:11.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.231+0000 7fcc2b0fb640 1 -- 172.21.15.32:0/3281821239 wait complete. 2024-02-17T00:37:11.245 INFO:teuthology.run_tasks:Running task kclient... 2024-02-17T00:37:11.259 INFO:tasks.kclient:Mounting kernel clients... 2024-02-17T00:37:11.259 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-02-17T00:37:11.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.259 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-02-17T00:37:11.274 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-02-17T00:37:11.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T00:37:11.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-02-17T00:37:11.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.437 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-02-17T00:37:11.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-02-17T00:37:11.520 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2024-02-17T00:37:11.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:37:11.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.522 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-02-17T00:37:11.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.540 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-02-17T00:37:11.613 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-02-17T00:37:11.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:37:11.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.615 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-02-17T00:37:11.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:11.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-02-17T00:37:11.741 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-02-17T00:37:11.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T00:37:11.743 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-17T00:37:11.743 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T00:37:11.743 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T00:37:11.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T00:37:11.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.844+0000 7f94cd283640 1 Processor -- start 2024-02-17T00:37:11.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.844+0000 7f94cd283640 1 -- start start 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94cd283640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f94c80d0a50 0x7f94c80d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94cd283640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80d1e80 con 0x7f94c80b53b0 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94cd283640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80b5930 con 0x7f94c815db00 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94cd283640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80b5c10 con 0x7f94c80d0a50 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c77fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f94c80b53b0 0x7f94c80d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57694/0 (socket says 172.21.15.32:57694) 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c77fe640 1 -- 172.21.15.32:0/2376147134 learned_addr learned my addr 172.21.15.32:0/2376147134 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c67fc640 1 --2- 172.21.15.32:0/2376147134 >> v2:172.21.15.39:3300/0 conn(0x7f94c80d0a50 0x7f94c80d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128179007 0 0) 0x7f94c80d1e80 con 0x7f94c80b53b0 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b0003520 con 0x7f94c80b53b0 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075508929 0 0) 0x7f94c80b5930 con 0x7f94c815db00 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c80d1e80 con 0x7f94c815db00 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 664483381 0 0) 0x7f94b0003520 con 0x7f94c80b53b0 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 >> v2:172.21.15.39:3300/0 conn(0x7f94c80d0a50 msgr2=0x7f94c80d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 --2- 172.21.15.32:0/2376147134 >> v2:172.21.15.39:3300/0 conn(0x7f94c80d0a50 0x7f94c80d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 >> v1:172.21.15.39:6789/0 conn(0x7f94c815db00 legacy=0x7f94c80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80b5ef0 con 0x7f94c80b53b0 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f94b80019f0 con 0x7f94c80b53b0 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.845+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 >> v1:172.21.15.32:6789/0 conn(0x7f94c80b53b0 legacy=0x7f94c80d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c5ffb640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94b0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c5ffb640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94b00047c0 0x7f94b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c5ffb640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94b0005180 0x7f94b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80b5c10 con 0x7f94b0003b50 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b000c050 con 0x7f94b00047c0 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b000c210 con 0x7f94b0005180 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c67fc640 1 --2- 172.21.15.32:0/2376147134 >> v2:172.21.15.39:3300/0 conn(0x7f94c80d0a50 0x7f94c80d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94b0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c77fe640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94b0005180 0x7f94b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c67fc640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94b00047c0 0x7f94b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c6ffd640 1 -- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94b0005180 msgr2=0x7f94b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94b0005180 0x7f94b000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c6ffd640 1 -- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94b00047c0 msgr2=0x7f94b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94b00047c0 0x7f94b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c6ffd640 1 -- 172.21.15.32:0/2376147134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0003520 con 0x7f94b0003b50 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c77fe640 1 -- 172.21.15.32:0/2376147134 reap_dead start 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.846+0000 7f94c67fc640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94b00047c0 0x7f94b0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:11.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94b0003f50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f94c00018c0 tx=0x7f94b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae8f1d63b19786b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c00052d0 con 0x7f94b0003b50 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c0005450 con 0x7f94b0003b50 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94c5ffb640 1 -- 172.21.15.32:0/2376147134 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0003830 con 0x7f94b0003b50 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 -- 172.21.15.32:0/2376147134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 msgr2=0x7f94b0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94b0003f50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f94c00018c0 tx=0x7f94b00057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 -- 172.21.15.32:0/2376147134 shutdown_connections 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 --2- 172.21.15.32:0/2376147134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94b0003f50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 -- 172.21.15.32:0/2376147134 >> 172.21.15.32:0/2376147134 conn(0x7f94c8072290 msgr2=0x7f94c80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 -- 172.21.15.32:0/2376147134 shutdown_connections 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.847+0000 7f94cd283640 1 -- 172.21.15.32:0/2376147134 wait complete. 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 Processor -- start 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 -- start start 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94c81f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94c8143e30 0x7f94c80cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94c80cd8e0 0x7f94c80caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815fc10 con 0x7f94b0003b50 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815f2e0 con 0x7f94c80cd8e0 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.849+0000 7f94cd283640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815f5c0 con 0x7f94c8143e30 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94c81f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94c81f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44156/0 (socket says 172.21.15.32:44156) 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 -- 172.21.15.32:0/981864421 learned_addr learned my addr 172.21.15.32:0/981864421 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c77fe640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94c80cd8e0 0x7f94c80caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c67fc640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94c8143e30 0x7f94c80cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 -- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94c8143e30 msgr2=0x7f94c80cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94c8143e30 0x7f94c80cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 -- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94c80cd8e0 msgr2=0x7f94c80caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94c80cd8e0 0x7f94c80caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 -- 172.21.15.32:0/981864421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c815f8a0 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c77fe640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94c80cd8e0 0x7f94c80caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94c6ffd640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94c81f33e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f94c0005040 tx=0x7f94c00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0007220 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c0007380 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c81f3920 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c00067d0 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.850+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8144290 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.851+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c80b9600 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.852+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f94c0006930 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.852+0000 7f94af7fe640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f94b406b840 0x7f94b406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.852+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94c00abcf0 con 0x7f94b0003b50 2024-02-17T00:37:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.852+0000 7f94c67fc640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f94b406b840 0x7f94b406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:11.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.853+0000 7f94c67fc640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f94b406b840 0x7f94b406dd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f94c81f7000 tx=0x7f94bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:11.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:11.856+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f94c0076490 con 0x7f94b0003b50 2024-02-17T00:37:12.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.075+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94c8144540 con 0x7f94b0003b50 2024-02-17T00:37:12.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.076+0000 7f94af7fe640 1 -- 172.21.15.32:0/981864421 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f94c0079b50 con 0x7f94b0003b50 2024-02-17T00:37:12.079 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f94b406b840 msgr2=0x7f94b406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f94b406b840 0x7f94b406dd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f94c81f7000 tx=0x7f94bc008040 comp rx=0 tx=0).stop 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 msgr2=0x7f94c81f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94c81f33e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f94c0005040 tx=0x7f94c00012d0 comp rx=0 tx=0).stop 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 shutdown_connections 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94c80cd8e0 0x7f94c80caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f94b406b840 0x7f94b406dd00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f94c8143e30 0x7f94c80cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 --2- 172.21.15.32:0/981864421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b0003b50 0x7f94c81f33e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 >> 172.21.15.32:0/981864421 conn(0x7f94c8072290 msgr2=0x7f94c80b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 shutdown_connections 2024-02-17T00:37:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:12.077+0000 7f94cd283640 1 -- 172.21.15.32:0/981864421 wait complete. 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T00:37:12.091 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T00:37:12.092 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T00:37:12.092 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T00:37:12.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.092 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-02-17T00:37:12.106 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:12.106 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:12.106 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:12.106 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42646sec preferred_lft 42646sec 2024-02-17T00:37:12.107 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link noprefixroute 2024-02-17T00:37:12.108 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:12.108 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:12.108 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:12.108 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-02-17T00:37:12.108 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T00:37:12.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.108 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:12.108 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:12.108 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-02-17T00:37:12.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-02-17T00:37:12.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-02-17T00:37:12.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T00:37:12.109 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:12.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.215 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T00:37:12.240 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-02-17T00:37:12.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.241 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-02-17T00:37:12.297 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-02-17T00:37:12.297 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T00:37:12.298 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-17T00:37:12.298 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-17T00:37:12.298 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T00:37:12.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.298 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:12.298 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:12.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-17T00:37:12.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-17T00:37:12.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-17T00:37:12.298 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:12.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.393 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-02-17T00:37:12.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.408 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-02-17T00:37:12.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.462 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:12.462 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:12.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T00:37:12.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-17T00:37:12.463 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:12.544 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-17T00:37:12.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-17T00:37:12.545 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:12.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.670 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:12.670 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:12.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-02-17T00:37:12.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T00:37:12.670 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:12.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:12.711 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T00:37:12.766 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T00:37:12.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:12.766 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T00:37:12.820 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T00:37:12.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:12.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:37:12.904 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:37:12.904 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T00:37:12.905 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:37:13.009 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:37:13.009 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T00:37:13.009 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:37:13.009 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:13.009 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:13.014 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:37:13.014 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T00:37:13.014 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:37:13.014 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:13.014 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:13.014 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790" 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790:/ 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2fde0ac4-9f5d-41d6-aea9-1575265f7f65" will pass to kernel 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: You just mounted a file system that supports labels which does not 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: applications will generate AVC messages and not be allowed access to 2024-02-17T00:37:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-17T00:37:13.017 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T00:37:13.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T00:37:13.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.043 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:13.099 INFO:teuthology.orchestra.run.smithi032.stdout:client4783 2024-02-17T00:37:13.100 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:13.100 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:13.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.155 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:13.211 INFO:teuthology.orchestra.run.smithi032.stdout:client4783 2024-02-17T00:37:13.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:13.270 INFO:teuthology.orchestra.run.smithi032.stdout:client4783 2024-02-17T00:37:13.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.271 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2fde0ac4-9f5d-41d6-aea9-1575265f7f65.client4783/status') 2024-02-17T00:37:13.336 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4783 (3)172.21.15.32:0/1291129254 2024-02-17T00:37:13.336 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2024-02-17T00:37:13.337 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2024-02-17T00:37:13.337 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2024-02-17T00:37:13.337 INFO:teuthology.orchestra.run.smithi032.stderr:70 bytes copied, 2.1191e-05 s, 3.3 MB/s 2024-02-17T00:37:13.338 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-02-17T00:37:13.338 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T00:37:13.338 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-17T00:37:13.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T00:37:13.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.475+0000 7f1293965640 1 Processor -- start 2024-02-17T00:37:13.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1293965640 1 -- start start 2024-02-17T00:37:13.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1293965640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f128c0d0a50 0x7f128c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1293965640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0d1e80 con 0x7f128c15db00 2024-02-17T00:37:13.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1293965640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0b5930 con 0x7f128c0b53b0 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1293965640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0b5c10 con 0x7f128c0d0a50 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1291701640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f128c15db00 0x7f128c0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55688/0 (socket says 172.21.15.32:55688) 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.476+0000 7f1291701640 1 -- 172.21.15.32:0/3783859763 learned_addr learned my addr 172.21.15.32:0/3783859763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1290f00640 1 --2- 172.21.15.32:0/3783859763 >> v2:172.21.15.39:3300/0 conn(0x7f128c0d0a50 0x7f128c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778868642 0 0) 0x7f128c0d1e80 con 0x7f128c15db00 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1278003520 con 0x7f128c15db00 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102775612 0 0) 0x7f1278003520 con 0x7f128c15db00 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 >> v2:172.21.15.39:3300/0 conn(0x7f128c0d0a50 msgr2=0x7f128c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 --2- 172.21.15.32:0/3783859763 >> v2:172.21.15.39:3300/0 conn(0x7f128c0d0a50 0x7f128c0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 >> v1:172.21.15.39:6789/0 conn(0x7f128c0b53b0 legacy=0x7f128c0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0b5ef0 con 0x7f128c15db00 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f1288001670 con 0x7f128c15db00 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 >> v1:172.21.15.32:6789/0 conn(0x7f128c15db00 legacy=0x7f128c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1278003970 0x7f1278003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1278004370 0x7f1278004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278005040 0x7f127800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0b5c10 con 0x7f1278003970 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127800bfa0 con 0x7f1278004370 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127800c160 con 0x7f1278005040 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1291701640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1278003970 0x7f1278003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1290f00640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1278004370 0x7f1278004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.477+0000 7f1291f02640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278005040 0x7f127800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291701640 1 -- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278005040 msgr2=0x7f127800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291701640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278005040 0x7f127800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291701640 1 -- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1278004370 msgr2=0x7f1278004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291701640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1278004370 0x7f1278004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291701640 1 -- 172.21.15.32:0/3783859763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278003520 con 0x7f1278003970 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291f02640 1 -- 172.21.15.32:0/3783859763 reap_dead start 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1291701640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1278003970 0x7f1278003d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f128800c210 tx=0x7f12780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2607c997fa69b83f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288005ad0 con 0x7f1278003970 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288005c50 con 0x7f1278003970 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.478+0000 7f1283fff640 1 -- 172.21.15.32:0/3783859763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128802c8a0 con 0x7f1278003970 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 -- 172.21.15.32:0/3783859763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1278003970 msgr2=0x7f1278003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1278003970 0x7f1278003d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f128800c210 tx=0x7f12780057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 -- 172.21.15.32:0/3783859763 shutdown_connections 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 --2- 172.21.15.32:0/3783859763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1278003970 0x7f1278003d50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 -- 172.21.15.32:0/3783859763 >> 172.21.15.32:0/3783859763 conn(0x7f128c072290 msgr2=0x7f128c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 -- 172.21.15.32:0/3783859763 shutdown_connections 2024-02-17T00:37:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.479+0000 7f1293965640 1 -- 172.21.15.32:0/3783859763 wait complete. 2024-02-17T00:37:13.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.480+0000 7f1293965640 1 Processor -- start 2024-02-17T00:37:13.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.480+0000 7f1293965640 1 -- start start 2024-02-17T00:37:13.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1293965640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278003970 0x7f128c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1293965640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f128c0cec40 0x7f128c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1293965640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 0x7f128c0b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1293965640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15a360 con 0x7f128c0b7190 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1293965640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0b7b50 con 0x7f128c0cec40 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1293965640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0cbdb0 con 0x7f1278003970 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 0x7f128c0b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 0x7f128c0b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40322/0 (socket says 172.21.15.32:40322) 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 -- 172.21.15.32:0/634299054 learned_addr learned my addr 172.21.15.32:0/634299054 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291701640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278003970 0x7f128c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1290f00640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f128c0cec40 0x7f128c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 -- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278003970 msgr2=0x7f128c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278003970 0x7f128c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 -- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f128c0cec40 msgr2=0x7f128c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f128c0cec40 0x7f128c151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 -- 172.21.15.32:0/634299054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c159da0 con 0x7f128c0b7190 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.481+0000 7f1291f02640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 0x7f128c0b7610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f128c0b5860 tx=0x7f128400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:13.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.482+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284006d60 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.482+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1284003970 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.482+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c15a080 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.482+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284003d20 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.482+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c152480 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.483+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c068fd0 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.483+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f128400d6b0 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.483+0000 7f1281ffb640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f127006b840 0x7f127006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.483+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f12840894d0 con 0x7f128c0b7190 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.484+0000 7f1291701640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f127006b840 0x7f127006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.484+0000 7f1291701640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f127006b840 0x7f127006dd00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:13.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.488+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1284053c60 con 0x7f128c0b7190 2024-02-17T00:37:13.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.708+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f128c0d16b0 con 0x7f128c0b7190 2024-02-17T00:37:13.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.708+0000 7f1281ffb640 1 -- 172.21.15.32:0/634299054 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1284057320 con 0x7f128c0b7190 2024-02-17T00:37:13.712 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T00:37:13.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f127006b840 msgr2=0x7f127006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f127006b840 0x7f127006dd00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288009030 comp rx=0 tx=0).stop 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 msgr2=0x7f128c0b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 0x7f128c0b7610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f128c0b5860 tx=0x7f128400feb0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 shutdown_connections 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f128c0b7190 0x7f128c0b7610 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f128c0cec40 0x7f128c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f127006b840 0x7f127006dd00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 --2- 172.21.15.32:0/634299054 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1278003970 0x7f128c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 >> 172.21.15.32:0/634299054 conn(0x7f128c072290 msgr2=0x7f128c153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 shutdown_connections 2024-02-17T00:37:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:13.710+0000 7f1293965640 1 -- 172.21.15.32:0/634299054 wait complete. 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T00:37:13.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-02-17T00:37:13.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.725 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-02-17T00:37:13.739 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T00:37:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42644sec preferred_lft 42644sec 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link noprefixroute 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 32:c1:b5:bf:31:37 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5437:81ff:fe0f:c133/64 scope link 2024-02-17T00:37:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:13.742 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T00:37:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 32:c1:b5:bf:31:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T00:37:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::30c1:b5ff:febf:3137/64 scope link tentative 2024-02-17T00:37:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:13.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.742 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T00:37:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-02-17T00:37:13.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.806 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-02-17T00:37:13.862 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-02-17T00:37:13.862 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T00:37:13.862 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-17T00:37:13.862 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-17T00:37:13.862 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T00:37:13.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.862 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:13.862 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:13.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-17T00:37:13.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-17T00:37:13.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-17T00:37:13.863 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:13.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.956 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-02-17T00:37:13.971 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T00:37:13.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:13.971 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-02-17T00:37:14.025 INFO:teuthology.orchestra.run.smithi032.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-02-17T00:37:14.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.025 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:14.025 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:14.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-17T00:37:14.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-02-17T00:37:14.026 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:14.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.107 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-17T00:37:14.174 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether b2:af:04:d7:30:c7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::b0af:4ff:fed7:30c7/64 scope link tentative 2024-02-17T00:37:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-17T00:37:14.243 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether b2:af:04:d7:30:c7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::b0af:4ff:fed7:30c7/64 scope link tentative 2024-02-17T00:37:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:14.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-02-17T00:37:14.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-02-17T00:37:14.246 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:14.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.371 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:37:14.371 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:37:14.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.1 up 2024-02-17T00:37:14.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.1 master ceph-brx 2024-02-17T00:37:14.371 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:37:14.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:14.412 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-02-17T00:37:14.467 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-02-17T00:37:14.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:14.467 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-02-17T00:37:14.521 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T00:37:14.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-02-17T00:37:14.605 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-02-17T00:37:14.605 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-02-17T00:37:14.605 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:37:14.613 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-02-17T00:37:14.613 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-02-17T00:37:14.613 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:37:14.613 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:14.613 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:14.631 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-02-17T00:37:14.631 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-02-17T00:37:14.631 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:37:14.631 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790" 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790:/ 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=2fde0ac4-9f5d-41d6-aea9-1575265f7f65" will pass to kernel 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout: You just mounted a file system that supports labels which does not 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout: applications will generate AVC messages and not be allowed access to 2024-02-17T00:37:14.632 INFO:teuthology.orchestra.run.smithi032.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-17T00:37:14.633 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T00:37:14.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-02-17T00:37:14.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.701 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:14.756 INFO:teuthology.orchestra.run.smithi032.stdout:client4863 2024-02-17T00:37:14.757 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:14.757 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:14.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.812 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:14.867 INFO:teuthology.orchestra.run.smithi032.stdout:client4863 2024-02-17T00:37:14.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.868 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:14.923 INFO:teuthology.orchestra.run.smithi032.stdout:client4863 2024-02-17T00:37:14.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:14.923 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2fde0ac4-9f5d-41d6-aea9-1575265f7f65.client4863/status') 2024-02-17T00:37:14.989 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4863 (3)192.168.0.2:0/314540346 2024-02-17T00:37:14.989 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2024-02-17T00:37:14.990 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2024-02-17T00:37:14.990 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2024-02-17T00:37:14.990 INFO:teuthology.orchestra.run.smithi032.stderr:68 bytes copied, 2.0558e-05 s, 3.3 MB/s 2024-02-17T00:37:14.991 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-17T00:37:14.991 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T00:37:14.991 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T00:37:14.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T00:37:15.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.129+0000 7fedf0113640 1 Processor -- start 2024-02-17T00:37:15.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.129+0000 7fedf0113640 1 -- start start 2024-02-17T00:37:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedf0113640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fede806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedf0113640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede815e0e0 con 0x7fede815dd00 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedf0113640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede806cfe0 con 0x7fede80b5e60 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedf0113640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede806cd00 con 0x7fede80b6a40 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fededeaf640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fede815dd00 0x7fede80b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55698/0 (socket says 172.21.15.32:55698) 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fededeaf640 1 -- 172.21.15.32:0/2658200599 learned_addr learned my addr 172.21.15.32:0/2658200599 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedee6b0640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fede806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414698707 0 0) 0x7fede4001110 con 0x7fede815dd00 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd4003520 con 0x7fede815dd00 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100280326 0 0) 0x7fedd8001110 con 0x7fede80b5e60 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede4001110 con 0x7fede80b5e60 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092114727 0 0) 0x7fedd4003520 con 0x7fede815dd00 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 msgr2=0x7fede806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fede806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 >> v1:172.21.15.39:6789/0 conn(0x7fede80b5e60 legacy=0x7fede806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede80d1ca0 con 0x7fede815dd00 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fede4001800 con 0x7fede815dd00 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedee6b0640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fede806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 >> v1:172.21.15.32:6789/0 conn(0x7fede815dd00 legacy=0x7fede80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fedd4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedd4004070 0x7fedd40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd4004d00 0x7fedd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede806cd00 con 0x7fedd4004070 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd400ba30 con 0x7fedd4004d00 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.130+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd400bbf0 con 0x7fede80b6a40 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7feded6ae640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedd4004070 0x7fedd40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7fedee6b0640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd4004d00 0x7fedd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7fededeaf640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fedd4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7feded6ae640 1 -- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 msgr2=0x7fedd4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7feded6ae640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede80b6a40 0x7fedd4003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7feded6ae640 1 -- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd4004d00 msgr2=0x7fedd4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7feded6ae640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd4004d00 0x7fedd4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.131+0000 7feded6ae640 1 -- 172.21.15.32:0/2658200599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0009a70 con 0x7fedd4004070 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7feded6ae640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedd4004070 0x7fedd40047c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fedd80018c0 tx=0x7fedd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfd3e91e23c9275 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd80052d0 con 0x7fedd4004070 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8005430 con 0x7fedd4004070 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedecead640 1 -- 172.21.15.32:0/2658200599 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8003810 con 0x7fedd4004070 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedf0113640 1 -- 172.21.15.32:0/2658200599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedd4004070 msgr2=0x7fedd40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedf0113640 1 --2- 172.21.15.32:0/2658200599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedd4004070 0x7fedd40047c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fedd80018c0 tx=0x7fedd40057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedee6b0640 1 -- 172.21.15.32:0/2658200599 reap_dead start 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedf0113640 1 -- 172.21.15.32:0/2658200599 shutdown_connections 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedf0113640 1 -- 172.21.15.32:0/2658200599 >> 172.21.15.32:0/2658200599 conn(0x7fede80d07b0 msgr2=0x7fede80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedf0113640 1 -- 172.21.15.32:0/2658200599 shutdown_connections 2024-02-17T00:37:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.132+0000 7fedf0113640 1 -- 172.21.15.32:0/2658200599 wait complete. 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.133+0000 7fedf0113640 1 Processor -- start 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.133+0000 7fedf0113640 1 -- start start 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedf0113640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede81f3df0 0x7fede8160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedf0113640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede815ec90 0x7fede81f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedf0113640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 0x7fede80cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedf0113640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede815fd10 con 0x7fede81f4710 2024-02-17T00:37:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedf0113640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede815f470 con 0x7fede81f3df0 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedf0113640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede815f750 con 0x7fede815ec90 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 0x7fede80cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 0x7fede80cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40344/0 (socket says 172.21.15.32:40344) 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 -- 172.21.15.32:0/1096015747 learned_addr learned my addr 172.21.15.32:0/1096015747 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fededeaf640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede81f3df0 0x7fede8160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7feded6ae640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede815ec90 0x7fede81f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 -- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede815ec90 msgr2=0x7fede81f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede815ec90 0x7fede81f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 -- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede81f3df0 msgr2=0x7fede8160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.134+0000 7fedee6b0640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede81f3df0 0x7fede8160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedee6b0640 1 -- 172.21.15.32:0/1096015747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede815fa30 con 0x7fede81f4710 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedee6b0640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 0x7fede80cb0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fede806acd0 tx=0x7fede000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000e040 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000f040 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0003bd0 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede80cab80 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.135+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede815f110 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.136+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede80680c0 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.136+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fede0003d30 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.137+0000 7fedde7fc640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fedcc06b840 0x7fedcc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.137+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fede008a340 con 0x7fede81f4710 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.137+0000 7fededeaf640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fedcc06b840 0x7fedcc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.137+0000 7fededeaf640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fedcc06b840 0x7fedcc06dd00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fede4004840 tx=0x7fede4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.141+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fede0054a20 con 0x7fede81f4710 2024-02-17T00:37:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.359+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fede80b9920 con 0x7fede81f4710 2024-02-17T00:37:15.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.360+0000 7fedde7fc640 1 -- 172.21.15.32:0/1096015747 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fede00580e0 con 0x7fede81f4710 2024-02-17T00:37:15.363 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.361+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fedcc06b840 msgr2=0x7fedcc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.361+0000 7fedf0113640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fedcc06b840 0x7fedcc06dd00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fede4004840 tx=0x7fede4009040 comp rx=0 tx=0).stop 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.361+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 msgr2=0x7fede80cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.361+0000 7fedf0113640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 0x7fede80cb0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fede806acd0 tx=0x7fede000f580 comp rx=0 tx=0).stop 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 shutdown_connections 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fede81f4710 0x7fede80cb0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fedcc06b840 0x7fedcc06dd00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fede815ec90 0x7fede81f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 --2- 172.21.15.32:0/1096015747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede81f3df0 0x7fede8160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 >> 172.21.15.32:0/1096015747 conn(0x7fede80d07b0 msgr2=0x7fede80d38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 shutdown_connections 2024-02-17T00:37:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:15.362+0000 7fedf0113640 1 -- 172.21.15.32:0/1096015747 wait complete. 2024-02-17T00:37:15.375 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T00:37:15.375 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T00:37:15.375 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-02-17T00:37:15.375 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T00:37:15.375 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T00:37:15.376 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T00:37:15.376 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T00:37:15.376 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T00:37:15.376 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T00:37:15.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.376 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-02-17T00:37:15.394 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-02-17T00:37:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42683sec preferred_lft 42683sec 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-02-17T00:37:15.396 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T00:37:15.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.396 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:15.396 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:15.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-02-17T00:37:15.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-02-17T00:37:15.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-02-17T00:37:15.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T00:37:15.397 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:15.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.565 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T00:37:15.593 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-02-17T00:37:15.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.595 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-02-17T00:37:15.681 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-02-17T00:37:15.681 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T00:37:15.681 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-17T00:37:15.681 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-17T00:37:15.681 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T00:37:15.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.682 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:15.682 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:15.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-17T00:37:15.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-17T00:37:15.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-17T00:37:15.682 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:15.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.903 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-02-17T00:37:15.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.918 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-02-17T00:37:15.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:15.973 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:15.973 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:15.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T00:37:15.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-17T00:37:15.973 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:16.054 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-17T00:37:16.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-17T00:37:16.055 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:16.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.186 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:16.186 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:16.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-02-17T00:37:16.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T00:37:16.186 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:16.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:16.228 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T00:37:16.281 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T00:37:16.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:16.282 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T00:37:16.336 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T00:37:16.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T00:37:16.420 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T00:37:16.420 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T00:37:16.420 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-02-17T00:37:16.532 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T00:37:16.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T00:37:16.532 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-02-17T00:37:16.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:16.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:16.536 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T00:37:16.536 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T00:37:16.537 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-02-17T00:37:16.537 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:16.537 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:16.537 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790" 2024-02-17T00:37:16.537 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790:/ 2024-02-17T00:37:16.537 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=2fde0ac4-9f5d-41d6-aea9-1575265f7f65" will pass to kernel 2024-02-17T00:37:16.538 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-17T00:37:16.538 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-02-17T00:37:16.538 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-17T00:37:16.538 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-02-17T00:37:16.538 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-17T00:37:16.539 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T00:37:16.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.540 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T00:37:16.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.607 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:16.663 INFO:teuthology.orchestra.run.smithi039.stdout:client4625 2024-02-17T00:37:16.664 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:16.664 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:16.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.718 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:16.773 INFO:teuthology.orchestra.run.smithi039.stdout:client4625 2024-02-17T00:37:16.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.773 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:16.828 INFO:teuthology.orchestra.run.smithi039.stdout:client4625 2024-02-17T00:37:16.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:16.829 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2fde0ac4-9f5d-41d6-aea9-1575265f7f65.client4625/status') 2024-02-17T00:37:16.895 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4625 (3)192.168.0.1:0/1860824205 2024-02-17T00:37:16.895 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-02-17T00:37:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-02-17T00:37:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-02-17T00:37:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:69 bytes copied, 2.0205e-05 s, 3.4 MB/s 2024-02-17T00:37:16.896 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-02-17T00:37:16.896 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T00:37:16.897 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-17T00:37:16.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T00:37:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.007+0000 7fcd11572640 1 Processor -- start 2024-02-17T00:37:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.007+0000 7fcd11572640 1 -- start start 2024-02-17T00:37:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd11572640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd0c15dd00 0x7fcd0c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd11572640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd0c0b6a40 0x7fcd0c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd11572640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c15e0e0 con 0x7fcd0c06bfb0 2024-02-17T00:37:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd11572640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c06cfe0 con 0x7fcd0c15dd00 2024-02-17T00:37:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd11572640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c06cd00 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd0c15dd00 0x7fcd0c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0b7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcd0c06bfb0 0x7fcd0c06c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55702/0 (socket says 172.21.15.32:55702) 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/3619674738 learned_addr learned my addr 172.21.15.32:0/3619674738 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd03fff640 1 --2- 172.21.15.32:0/3619674738 >> v2:172.21.15.39:3300/0 conn(0x7fcd0c0b6a40 0x7fcd0c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0affd640 1 -- 172.21.15.32:0/3619674738 >> v2:172.21.15.39:3300/0 conn(0x7fcd0c0b6a40 msgr2=0x7fcd0c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0affd640 1 --2- 172.21.15.32:0/3619674738 >> v2:172.21.15.39:3300/0 conn(0x7fcd0c0b6a40 0x7fcd0c0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0affd640 1 -- 172.21.15.32:0/3619674738 >> v1:172.21.15.32:6789/0 conn(0x7fcd0c06bfb0 legacy=0x7fcd0c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.008+0000 7fcd0affd640 1 -- 172.21.15.32:0/3619674738 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0d1ca0 con 0x7fcd0c15dd00 2024-02-17T00:37:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.009+0000 7fcd0affd640 1 --2- 172.21.15.32:0/3619674738 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c15dd00 0x7fcd0c0b5750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c08c540 tx=0x7fccfc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4254b79087ba6a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.009+0000 7fcd0a7fc640 1 -- 172.21.15.32:0/3619674738 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc030610 con 0x7fcd0c15dd00 2024-02-17T00:37:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.009+0000 7fcd0a7fc640 1 -- 172.21.15.32:0/3619674738 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc030770 con 0x7fcd0c15dd00 2024-02-17T00:37:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.009+0000 7fcd0a7fc640 1 -- 172.21.15.32:0/3619674738 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc030b00 con 0x7fcd0c15dd00 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 -- 172.21.15.32:0/3619674738 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c15dd00 msgr2=0x7fcd0c0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 --2- 172.21.15.32:0/3619674738 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c15dd00 0x7fcd0c0b5750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c08c540 tx=0x7fccfc02b960 comp rx=0 tx=0).stop 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 -- 172.21.15.32:0/3619674738 shutdown_connections 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 --2- 172.21.15.32:0/3619674738 >> v2:172.21.15.39:3300/0 conn(0x7fcd0c0b6a40 0x7fcd0c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 --2- 172.21.15.32:0/3619674738 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c15dd00 0x7fcd0c0b5750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 -- 172.21.15.32:0/3619674738 >> 172.21.15.32:0/3619674738 conn(0x7fcd0c0d07b0 msgr2=0x7fcd0c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 -- 172.21.15.32:0/3619674738 shutdown_connections 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.010+0000 7fcd11572640 1 -- 172.21.15.32:0/3619674738 wait complete. 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.011+0000 7fcd11572640 1 Processor -- start 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.011+0000 7fcd11572640 1 -- start start 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd11572640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 0x7fcd0c1f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd11572640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 0x7fcd0c0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd11572640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c15dd00 0x7fcd0c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd11572640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c147860 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd11572640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c1f7980 con 0x7fcd0c06bfb0 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd11572640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c15a2d0 con 0x7fcd0c15dd00 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 0x7fcd0c0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd0affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 0x7fcd0c1f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 0x7fcd0c0c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40362/0 (socket says 172.21.15.32:40362) 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd0affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 0x7fcd0c1f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:54994/0 (socket says 172.21.15.32:54994) 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 -- 172.21.15.32:0/1294653263 learned_addr learned my addr 172.21.15.32:0/1294653263 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd0b7fe640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c15dd00 0x7fcd0c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 -- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c15dd00 msgr2=0x7fcd0c15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c15dd00 0x7fcd0c15c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 -- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 msgr2=0x7fcd0c1f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 0x7fcd0c1f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd03fff640 1 -- 172.21.15.32:0/1294653263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009400 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.012+0000 7fcd0affd640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 0x7fcd0c1f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.013+0000 7fcd03fff640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 0x7fcd0c0c9360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fccf400d800 tx=0x7fccf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.013+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400b6c0 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.013+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf400b820 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.013+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400bbb0 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.013+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c15a5b0 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.013+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c15ab70 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.014+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c0680c0 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.014+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fccf400bd10 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.015+0000 7fcd037fe640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fccec06b810 0x7fccec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.015+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fccf408a940 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.015+0000 7fcd0affd640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fccec06b810 0x7fccec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.015+0000 7fcd0affd640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fccec06b810 0x7fccec06dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fccfc036000 tx=0x7fccfc03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:17.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.019+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fccf40550d0 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.239+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd0c068fd0 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.239+0000 7fcd037fe640 1 -- 172.21.15.32:0/1294653263 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fccf4058790 con 0x7fcd0c0b6a40 2024-02-17T00:37:17.242 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fccec06b810 msgr2=0x7fccec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fccec06b810 0x7fccec06dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fccfc036000 tx=0x7fccfc03b040 comp rx=0 tx=0).stop 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 msgr2=0x7fcd0c0c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 0x7fcd0c0c9360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fccf400d800 tx=0x7fccf400dcc0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 shutdown_connections 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fccec06b810 0x7fccec06dcd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c15dd00 0x7fcd0c15c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0b6a40 0x7fcd0c0c9360 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 --2- 172.21.15.32:0/1294653263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c06bfb0 0x7fcd0c1f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:17.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 >> 172.21.15.32:0/1294653263 conn(0x7fcd0c0d07b0 msgr2=0x7fcd0c06c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:17.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 shutdown_connections 2024-02-17T00:37:17.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:17.241+0000 7fcd11572640 1 -- 172.21.15.32:0/1294653263 wait complete. 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T00:37:17.255 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-02-17T00:37:17.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.256 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:17.271 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42681sec preferred_lft 42681sec 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-02-17T00:37:17.272 INFO:teuthology.orchestra.run.smithi039.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c2:54:ba:02:ab:87 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::d877:45ff:fedf:6964/64 scope link tentative 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c2:54:ba:02:ab:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c054:baff:fe02:ab87/64 scope link tentative 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.273 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T00:37:17.336 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-02-17T00:37:17.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.338 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-02-17T00:37:17.393 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-02-17T00:37:17.393 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T00:37:17.393 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-17T00:37:17.393 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-17T00:37:17.393 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T00:37:17.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.394 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:17.394 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:17.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-17T00:37:17.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-17T00:37:17.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-17T00:37:17.394 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:17.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.487 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-02-17T00:37:17.501 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T00:37:17.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.502 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-02-17T00:37:17.556 INFO:teuthology.orchestra.run.smithi039.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-02-17T00:37:17.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.556 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:17.557 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:17.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-17T00:37:17.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-02-17T00:37:17.557 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:17.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.638 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-17T00:37:17.704 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:17.704 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:17.704 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 1a:32:99:f0:ea:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::1832:99ff:fef0:eaf4/64 scope link 2024-02-17T00:37:17.705 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-17T00:37:17.773 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:37:17.953 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:37:17.953 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:37:17.953 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.953 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-02-17T00:37:17.953 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.953 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:37:17.954 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 1a:32:99:f0:ea:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-17T00:37:17.954 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-17T00:37:17.954 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.954 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::1832:99ff:fef0:eaf4/64 scope link 2024-02-17T00:37:17.954 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:37:17.955 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-02-17T00:37:17.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-02-17T00:37:17.956 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:18.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.083 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2024-02-17T00:37:18.083 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-02-17T00:37:18.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.1 up 2024-02-17T00:37:18.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.1 master ceph-brx 2024-02-17T00:37:18.083 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-02-17T00:37:18.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:18.124 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-02-17T00:37:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-02-17T00:37:18.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:37:18.179 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-02-17T00:37:18.233 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T00:37:18.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-02-17T00:37:18.317 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-02-17T00:37:18.317 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-02-17T00:37:18.317 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-02-17T00:37:18.325 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-02-17T00:37:18.325 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-02-17T00:37:18.325 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-02-17T00:37:18.325 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:18.326 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790" 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790:/ 2024-02-17T00:37:18.331 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=2fde0ac4-9f5d-41d6-aea9-1575265f7f65" will pass to kernel 2024-02-17T00:37:18.332 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-02-17T00:37:18.332 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-02-17T00:37:18.332 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-17T00:37:18.332 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-02-17T00:37:18.332 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-17T00:37:18.333 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T00:37:18.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.333 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-02-17T00:37:18.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.399 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:18.455 INFO:teuthology.orchestra.run.smithi039.stdout:client4881 2024-02-17T00:37:18.456 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:18.456 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:18.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.511 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:18.566 INFO:teuthology.orchestra.run.smithi039.stdout:client4881 2024-02-17T00:37:18.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.567 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:37:18.622 INFO:teuthology.orchestra.run.smithi039.stdout:client4881 2024-02-17T00:37:18.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:18.623 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2fde0ac4-9f5d-41d6-aea9-1575265f7f65.client4881/status') 2024-02-17T00:37:18.689 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4881 (3)172.21.15.39:0/2450704355 2024-02-17T00:37:18.689 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-02-17T00:37:18.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-02-17T00:37:18.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-02-17T00:37:18.689 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 2.0877e-05 s, 3.4 MB/s 2024-02-17T00:37:18.690 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-17T00:37:18.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:18.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 Processor -- start 2024-02-17T00:37:18.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 -- start start 2024-02-17T00:37:18.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2bfc15dd00 0x7f2bfc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2bfc0b6a40 0x7f2bfc0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc06bfb0 0x7f2bfc06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc15e0e0 con 0x7f2bfc0b6a40 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc06cfe0 con 0x7f2bfc15dd00 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.816+0000 7f2c0186f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc06cd00 con 0x7f2bfc06bfb0 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2bfc0b6a40 0x7f2bfc0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfb7fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc06bfb0 0x7f2bfc06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2bfc0b6a40 0x7f2bfc0b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40366/0 (socket says 172.21.15.32:40366) 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 -- 172.21.15.32:0/2825144873 learned_addr learned my addr 172.21.15.32:0/2825144873 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfaffd640 1 --2- 172.21.15.32:0/2825144873 >> v2:172.21.15.39:3300/0 conn(0x7f2bfc15dd00 0x7f2bfc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 -- 172.21.15.32:0/2825144873 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc06bfb0 msgr2=0x7f2bfc06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 --2- 172.21.15.32:0/2825144873 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc06bfb0 0x7f2bfc06c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 -- 172.21.15.32:0/2825144873 >> v2:172.21.15.39:3300/0 conn(0x7f2bfc15dd00 msgr2=0x7f2bfc0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 --2- 172.21.15.32:0/2825144873 >> v2:172.21.15.39:3300/0 conn(0x7f2bfc15dd00 0x7f2bfc0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfa7fc640 1 -- 172.21.15.32:0/2825144873 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0d1ca0 con 0x7f2bfc0b6a40 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfb7fe640 1 --2- 172.21.15.32:0/2825144873 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc06bfb0 0x7f2bfc06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:18.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.817+0000 7f2bfaffd640 1 --2- 172.21.15.32:0/2825144873 >> v2:172.21.15.39:3300/0 conn(0x7f2bfc15dd00 0x7f2bfc0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.818+0000 7f2bfa7fc640 1 --2- 172.21.15.32:0/2825144873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc0b6a40 0x7f2bfc0b5c90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0d4920 tx=0x7f2be402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cedfe6fe63be19 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.818+0000 7f2bf9ffb640 1 -- 172.21.15.32:0/2825144873 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4030860 con 0x7f2bfc0b6a40 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.818+0000 7f2bf9ffb640 1 -- 172.21.15.32:0/2825144873 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be40309c0 con 0x7f2bfc0b6a40 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.818+0000 7f2bf9ffb640 1 -- 172.21.15.32:0/2825144873 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4030d50 con 0x7f2bfc0b6a40 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.818+0000 7f2c0186f640 1 -- 172.21.15.32:0/2825144873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc0b6a40 msgr2=0x7f2bfc0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.818+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2825144873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc0b6a40 0x7f2bfc0b5c90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0d4920 tx=0x7f2be402b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 -- 172.21.15.32:0/2825144873 shutdown_connections 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2825144873 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc06bfb0 0x7f2bfc06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2825144873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc0b6a40 0x7f2bfc0b5c90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2825144873 >> v2:172.21.15.39:3300/0 conn(0x7f2bfc15dd00 0x7f2bfc0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 -- 172.21.15.32:0/2825144873 >> 172.21.15.32:0/2825144873 conn(0x7f2bfc0d07b0 msgr2=0x7f2bfc0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:18.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 -- 172.21.15.32:0/2825144873 shutdown_connections 2024-02-17T00:37:18.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.819+0000 7f2c0186f640 1 -- 172.21.15.32:0/2825144873 wait complete. 2024-02-17T00:37:18.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.820+0000 7f2c0186f640 1 Processor -- start 2024-02-17T00:37:18.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.820+0000 7f2c0186f640 1 -- start start 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2c0186f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc06bfb0 0x7f2bfc155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2c0186f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc0b6a40 0x7f2bfc0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2c0186f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 0x7f2bfc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2c0186f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0cd650 con 0x7f2bfc15dd00 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2c0186f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0cca40 con 0x7f2bfc06bfb0 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2c0186f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0ccd20 con 0x7f2bfc0b6a40 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 0x7f2bfc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 0x7f2bfc156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40376/0 (socket says 172.21.15.32:40376) 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 -- 172.21.15.32:0/2461649159 learned_addr learned my addr 172.21.15.32:0/2461649159 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:18.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfa7fc640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc0b6a40 0x7f2bfc0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfaffd640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc06bfb0 0x7f2bfc155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 -- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc0b6a40 msgr2=0x7f2bfc0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc0b6a40 0x7f2bfc0cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 -- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc06bfb0 msgr2=0x7f2bfc155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc06bfb0 0x7f2bfc155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 -- 172.21.15.32:0/2461649159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009a70 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.821+0000 7f2bfb7fe640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 0x7f2bfc156c60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00eed0 tx=0x7f2bec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.822+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec010040 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.822+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00bd20 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.822+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf4009400 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.822+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec003bb0 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.822+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be40094d0 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.823+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0680c0 con 0x7f2bfc15dd00 2024-02-17T00:37:18.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.823+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2bec01d410 con 0x7f2bfc15dd00 2024-02-17T00:37:18.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.823+0000 7f2bf3fff640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2bdc06b810 0x7f2bdc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:18.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.824+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f2bec08abc0 con 0x7f2bfc15dd00 2024-02-17T00:37:18.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.824+0000 7f2bfaffd640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2bdc06b810 0x7f2bdc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:18.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.824+0000 7f2bfaffd640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2bdc06b810 0x7f2bdc06dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009c30 tx=0x7f2bf4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:18.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:18.828+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2bec0553b0 con 0x7f2bfc15dd00 2024-02-17T00:37:19.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.008+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bfc068fd0 con 0x7f2bfc15dd00 2024-02-17T00:37:19.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.010+0000 7f2bf3fff640 1 -- 172.21.15.32:0/2461649159 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f2bec018090 con 0x7f2bfc15dd00 2024-02-17T00:37:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:19.013 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":28,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:18.203479+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.011+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2bdc06b810 msgr2=0x7f2bdc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.011+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2bdc06b810 0x7f2bdc06dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009c30 tx=0x7f2bf4009190 comp rx=0 tx=0).stop 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.011+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 msgr2=0x7f2bfc156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.011+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 0x7f2bfc156c60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00eed0 tx=0x7f2bec00b480 comp rx=0 tx=0).stop 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 shutdown_connections 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc15dd00 0x7f2bfc156c60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f2bdc06b810 0x7f2bdc06dcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f2bfc0b6a40 0x7f2bfc0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 --2- 172.21.15.32:0/2461649159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc06bfb0 0x7f2bfc155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 >> 172.21.15.32:0/2461649159 conn(0x7f2bfc0d07b0 msgr2=0x7f2bfc0b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 shutdown_connections 2024-02-17T00:37:19.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.012+0000 7f2c0186f640 1 -- 172.21.15.32:0/2461649159 wait complete. 2024-02-17T00:37:19.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:19.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:19.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.128+0000 7f41536ae640 1 Processor -- start 2024-02-17T00:37:19.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.128+0000 7f41536ae640 1 -- start start 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.128+0000 7f41536ae640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f414c0b78c0 0x7f414c1685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.128+0000 7f41536ae640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0b7ef0 con 0x7f414c0d2c40 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.128+0000 7f41536ae640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0b81d0 con 0x7f414c0d0780 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.128+0000 7f41536ae640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0b9840 con 0x7f414c0b78c0 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4151c4b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f414c0b78c0 0x7f414c1685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4150c49640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f414c0d2c40 0x7f414c0b9130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55706/0 (socket says 172.21.15.32:55706) 2024-02-17T00:37:19.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4151c4b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f414c0b78c0 0x7f414c1685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40392/0 (socket says 172.21.15.32:40392) 2024-02-17T00:37:19.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4150c49640 1 -- 172.21.15.32:0/1973631898 learned_addr learned my addr 172.21.15.32:0/1973631898 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:19.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4151c4b640 1 -- 172.21.15.32:0/1973631898 >> v1:172.21.15.39:6789/0 conn(0x7f414c0d0780 legacy=0x7f414c0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:19.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4151c4b640 1 -- 172.21.15.32:0/1973631898 >> v1:172.21.15.32:6789/0 conn(0x7f414c0d2c40 legacy=0x7f414c0b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f414bfff640 1 -- 172.21.15.32:0/1973631898 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893687123 0 0) 0x7f414c0b7ef0 con 0x7f414c0d2c40 2024-02-17T00:37:19.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.129+0000 7f4151c4b640 1 -- 172.21.15.32:0/1973631898 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0b84b0 con 0x7f414c0b78c0 2024-02-17T00:37:19.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f4151c4b640 1 --2- 172.21.15.32:0/1973631898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1685d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f413c009d90 tx=0x7f413c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8a733202faa1a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f414bfff640 1 -- 172.21.15.32:0/1973631898 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c02cd00 con 0x7f414c0b78c0 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f414bfff640 1 -- 172.21.15.32:0/1973631898 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c02ce60 con 0x7f414c0b78c0 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f414bfff640 1 -- 172.21.15.32:0/1973631898 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c034660 con 0x7f414c0b78c0 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 -- 172.21.15.32:0/1973631898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 msgr2=0x7f414c1685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 --2- 172.21.15.32:0/1973631898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1685d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f413c009d90 tx=0x7f413c02bf50 comp rx=0 tx=0).stop 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 -- 172.21.15.32:0/1973631898 shutdown_connections 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 --2- 172.21.15.32:0/1973631898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1685d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 -- 172.21.15.32:0/1973631898 >> 172.21.15.32:0/1973631898 conn(0x7f414c0726b0 msgr2=0x7f414c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 -- 172.21.15.32:0/1973631898 shutdown_connections 2024-02-17T00:37:19.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.130+0000 7f41536ae640 1 -- 172.21.15.32:0/1973631898 wait complete. 2024-02-17T00:37:19.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 Processor -- start 2024-02-17T00:37:19.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 -- start start 2024-02-17T00:37:19.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c0d0780 0x7f414c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f414c0d2c40 0x7f414c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c152610 con 0x7f414c0b78c0 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0c7da0 con 0x7f414c0d0780 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f41536ae640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0c8080 con 0x7f414c0d2c40 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f415144a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f415144a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40402/0 (socket says 172.21.15.32:40402) 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.132+0000 7f415144a640 1 -- 172.21.15.32:0/1393830759 learned_addr learned my addr 172.21.15.32:0/1393830759 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f4150c49640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c0d0780 0x7f414c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f4151c4b640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f414c0d2c40 0x7f414c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f415144a640 1 -- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f414c0d2c40 msgr2=0x7f414c0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f415144a640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f414c0d2c40 0x7f414c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f415144a640 1 -- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c0d0780 msgr2=0x7f414c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f415144a640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c0d0780 0x7f414c0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f415144a640 1 -- 172.21.15.32:0/1393830759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009a70 con 0x7f414c0b78c0 2024-02-17T00:37:19.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f4150c49640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c0d0780 0x7f414c0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f415144a640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1520d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f414400c450 tx=0x7f414400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440052d0 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144005430 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c0c8360 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144012870 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.133+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c0c8920 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.134+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c0685d0 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.134+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f41440129d0 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.135+0000 7f4149ffb640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f413806b840 0x7f413806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.135+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4144089fb0 con 0x7f414c0b78c0 2024-02-17T00:37:19.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.135+0000 7f4150c49640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f413806b840 0x7f413806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.135+0000 7f4150c49640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f413806b840 0x7f413806dd00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f414c15d700 tx=0x7f4140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.139+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f41440bd8c0 con 0x7f414c0b78c0 2024-02-17T00:37:19.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.321+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f414c068f60 con 0x7f414c0b78c0 2024-02-17T00:37:19.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.322+0000 7f4149ffb640 1 -- 172.21.15.32:0/1393830759 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41440546f0 con 0x7f414c0b78c0 2024-02-17T00:37:19.325 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f413806b840 msgr2=0x7f413806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f413806b840 0x7f413806dd00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f414c15d700 tx=0x7f4140009040 comp rx=0 tx=0).stop 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 msgr2=0x7f414c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1520d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f414400c450 tx=0x7f414400c910 comp rx=0 tx=0).stop 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 shutdown_connections 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f413806b840 0x7f413806dd00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f414c0d2c40 0x7f414c0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f414c0d0780 0x7f414c0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 --2- 172.21.15.32:0/1393830759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f414c0b78c0 0x7f414c1520d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 >> 172.21.15.32:0/1393830759 conn(0x7f414c0726b0 msgr2=0x7f414c1604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.323+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 shutdown_connections 2024-02-17T00:37:19.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.324+0000 7f41536ae640 1 -- 172.21.15.32:0/1393830759 wait complete. 2024-02-17T00:37:19.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.439+0000 7f4c4102e640 1 Processor -- start 2024-02-17T00:37:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.439+0000 7f4c4102e640 1 -- start start 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c4102e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c3c0ce830 0x7f4c3c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c4102e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c0ce380 con 0x7f4c3c15f1c0 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c4102e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c15f000 con 0x7f4c3c0d3760 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c4102e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3c0ceff0 con 0x7f4c3c0ce830 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3259c640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4c3c15f1c0 0x7f4c3c0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55722/0 (socket says 172.21.15.32:55722) 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3259c640 1 -- 172.21.15.32:0/3482117978 learned_addr learned my addr 172.21.15.32:0/3482117978 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3b59e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c3c0ce830 0x7f4c3c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3a59c640 1 -- 172.21.15.32:0/3482117978 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581049407 0 0) 0x7f4c3c0ce380 con 0x7f4c3c15f1c0 2024-02-17T00:37:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3a59c640 1 -- 172.21.15.32:0/3482117978 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c28003520 con 0x7f4c3c15f1c0 2024-02-17T00:37:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3b59e640 1 -- 172.21.15.32:0/3482117978 >> v1:172.21.15.39:6789/0 conn(0x7f4c3c0d3760 legacy=0x7f4c3c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3b59e640 1 -- 172.21.15.32:0/3482117978 >> v1:172.21.15.32:6789/0 conn(0x7f4c3c15f1c0 legacy=0x7f4c3c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.440+0000 7f4c3b59e640 1 -- 172.21.15.32:0/3482117978 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0d2190 con 0x7f4c3c0ce830 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c3b59e640 1 --2- 172.21.15.32:0/3482117978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0ce830 0x7f4c3c15eac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009d90 tx=0x7f4c3402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e5c3007534f939 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c3a59c640 1 -- 172.21.15.32:0/3482117978 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3402cd00 con 0x7f4c3c0ce830 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c3a59c640 1 -- 172.21.15.32:0/3482117978 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3402ce60 con 0x7f4c3c0ce830 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c3a59c640 1 -- 172.21.15.32:0/3482117978 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34034660 con 0x7f4c3c0ce830 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 -- 172.21.15.32:0/3482117978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0ce830 msgr2=0x7f4c3c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 --2- 172.21.15.32:0/3482117978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0ce830 0x7f4c3c15eac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009d90 tx=0x7f4c3402bf50 comp rx=0 tx=0).stop 2024-02-17T00:37:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 -- 172.21.15.32:0/3482117978 shutdown_connections 2024-02-17T00:37:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 --2- 172.21.15.32:0/3482117978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0ce830 0x7f4c3c15eac0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 -- 172.21.15.32:0/3482117978 >> 172.21.15.32:0/3482117978 conn(0x7f4c3c072680 msgr2=0x7f4c3c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 -- 172.21.15.32:0/3482117978 shutdown_connections 2024-02-17T00:37:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.441+0000 7f4c4102e640 1 -- 172.21.15.32:0/3482117978 wait complete. 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.443+0000 7f4c4102e640 1 Processor -- start 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.443+0000 7f4c4102e640 1 -- start start 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c3c0ce830 0x7f4c3c0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 0x7f4c3c14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c3c15f1c0 0x7f4c3c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c1e7d00 con 0x7f4c3c0d3760 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c1e7080 con 0x7f4c3c15f1c0 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c1e7360 con 0x7f4c3c0ce830 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 0x7f4c3c14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 0x7f4c3c14c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40422/0 (socket says 172.21.15.32:40422) 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 -- 172.21.15.32:0/2526722774 learned_addr learned my addr 172.21.15.32:0/2526722774 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3b59e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c3c15f1c0 0x7f4c3c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3ad9d640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c3c0ce830 0x7f4c3c0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 -- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c3c0ce830 msgr2=0x7f4c3c0b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c3c0ce830 0x7f4c3c0b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 -- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c3c15f1c0 msgr2=0x7f4c3c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c3c15f1c0 0x7f4c3c14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 -- 172.21.15.32:0/2526722774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34009a70 con 0x7f4c3c0d3760 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3ad9d640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c3c0ce830 0x7f4c3c0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c3259c640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 0x7f4c3c14c7d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c3e0 tx=0x7f4c2400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24005ce0 con 0x7f4c3c0d3760 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c24005e40 con 0x7f4c3c0d3760 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.444+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c1e7640 con 0x7f4c3c0d3760 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.445+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240072d0 con 0x7f4c3c0d3760 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.445+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c1e8120 con 0x7f4c3c0d3760 2024-02-17T00:37:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.446+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c1e7e40 con 0x7f4c3c0d3760 2024-02-17T00:37:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.446+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4c240074f0 con 0x7f4c3c0d3760 2024-02-17T00:37:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.446+0000 7f4c33fff640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c1c06b840 0x7f4c1c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.446+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4c24089a40 con 0x7f4c3c0d3760 2024-02-17T00:37:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.447+0000 7f4c3ad9d640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c1c06b840 0x7f4c1c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.447+0000 7f4c3ad9d640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c1c06b840 0x7f4c1c06dd00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c072e40 tx=0x7f4c2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.451+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c3c1e7e40 con 0x7f4c3c0d3760 2024-02-17T00:37:19.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.633+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c3c1e7e40 con 0x7f4c3c0d3760 2024-02-17T00:37:19.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.634+0000 7f4c33fff640 1 -- 172.21.15.32:0/2526722774 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c3c1e7e40 con 0x7f4c3c0d3760 2024-02-17T00:37:19.637 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c1c06b840 msgr2=0x7f4c1c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c1c06b840 0x7f4c1c06dd00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c072e40 tx=0x7f4c2c009040 comp rx=0 tx=0).stop 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 msgr2=0x7f4c3c14c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 0x7f4c3c14c7d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c3e0 tx=0x7f4c2400c8a0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 shutdown_connections 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c3c15f1c0 0x7f4c3c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c0d3760 0x7f4c3c14c7d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c1c06b840 0x7f4c1c06dd00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 --2- 172.21.15.32:0/2526722774 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c3c0ce830 0x7f4c3c0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 >> 172.21.15.32:0/2526722774 conn(0x7f4c3c072680 msgr2=0x7f4c3c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 shutdown_connections 2024-02-17T00:37:19.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.636+0000 7f4c4102e640 1 -- 172.21.15.32:0/2526722774 wait complete. 2024-02-17T00:37:19.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:19.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.751+0000 7f84dcf9e640 1 Processor -- start 2024-02-17T00:37:19.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.751+0000 7f84dcf9e640 1 -- start start 2024-02-17T00:37:19.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84dcf9e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80b48c0 0x7f84d815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84dcf9e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 0x7f84d80b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84dcf9e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d81606e0 con 0x7f84d80d3f90 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84dcf9e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d81609c0 con 0x7f84d8161d90 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84dcf9e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8160ca0 con 0x7f84d80b48c0 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d7fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 0x7f84d80b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d77fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80b48c0 0x7f84d815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d6ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f84d80d3f90 0x7f84d8161680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:32870/0 (socket says 172.21.15.32:32870) 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d6ffd640 1 -- 172.21.15.32:0/4055105661 learned_addr learned my addr 172.21.15.32:0/4055105661 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:19.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d7fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 0x7f84d80b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:55040/0 (socket says 172.21.15.32:55040) 2024-02-17T00:37:19.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d77fe640 1 -- 172.21.15.32:0/4055105661 >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 msgr2=0x7f84d80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:19.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d77fe640 1 --2- 172.21.15.32:0/4055105661 >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 0x7f84d80b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d77fe640 1 -- 172.21.15.32:0/4055105661 >> v1:172.21.15.39:6789/0 conn(0x7f84d80d3f90 legacy=0x7f84d8161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d77fe640 1 -- 172.21.15.32:0/4055105661 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8160f80 con 0x7f84d80b48c0 2024-02-17T00:37:19.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.752+0000 7f84d7fff640 1 --2- 172.21.15.32:0/4055105661 >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 0x7f84d80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:19.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.753+0000 7f84d77fe640 1 --2- 172.21.15.32:0/4055105661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80b48c0 0x7f84d815fe60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84c80097a0 tx=0x7f84c802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4c0f9c69f9c2130 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.753+0000 7f84d67fc640 1 -- 172.21.15.32:0/4055105661 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c802e070 con 0x7f84d80b48c0 2024-02-17T00:37:19.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.753+0000 7f84d67fc640 1 -- 172.21.15.32:0/4055105661 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c80315a0 con 0x7f84d80b48c0 2024-02-17T00:37:19.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84d67fc640 1 -- 172.21.15.32:0/4055105661 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8031930 con 0x7f84d80b48c0 2024-02-17T00:37:19.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 -- 172.21.15.32:0/4055105661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80b48c0 msgr2=0x7f84d815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/4055105661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80b48c0 0x7f84d815fe60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84c80097a0 tx=0x7f84c802b840 comp rx=0 tx=0).stop 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 -- 172.21.15.32:0/4055105661 shutdown_connections 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/4055105661 >> v2:172.21.15.39:3300/0 conn(0x7f84d8161d90 0x7f84d80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/4055105661 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80b48c0 0x7f84d815fe60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 -- 172.21.15.32:0/4055105661 >> 172.21.15.32:0/4055105661 conn(0x7f84d808af80 msgr2=0x7f84d80d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 -- 172.21.15.32:0/4055105661 shutdown_connections 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.754+0000 7f84dcf9e640 1 -- 172.21.15.32:0/4055105661 wait complete. 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.755+0000 7f84dcf9e640 1 Processor -- start 2024-02-17T00:37:19.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 -- start start 2024-02-17T00:37:19.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 0x7f84d81f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80d3f90 0x7f84d80c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84d8161d90 0x7f84d815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81f7cd0 con 0x7f84d80b48c0 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80cb570 con 0x7f84d8161d90 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84dcf9e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80c9f30 con 0x7f84d80d3f90 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84d77fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 0x7f84d81f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84d77fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 0x7f84d81f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40434/0 (socket says 172.21.15.32:40434) 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.756+0000 7f84d77fe640 1 -- 172.21.15.32:0/1009243465 learned_addr learned my addr 172.21.15.32:0/1009243465 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d7fff640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84d8161d90 0x7f84d815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d6ffd640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80d3f90 0x7f84d80c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d77fe640 1 -- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80d3f90 msgr2=0x7f84d80c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d77fe640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80d3f90 0x7f84d80c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d77fe640 1 -- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84d8161d90 msgr2=0x7f84d815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d77fe640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84d8161d90 0x7f84d815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d77fe640 1 -- 172.21.15.32:0/1009243465 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d0009a70 con 0x7f84d80b48c0 2024-02-17T00:37:19.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d7fff640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84d8161d90 0x7f84d815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:19.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84d77fe640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 0x7f84d81f6da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f84c8034040 tx=0x7f84c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8032840 con 0x7f84d80b48c0 2024-02-17T00:37:19.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c8031f00 con 0x7f84d80b48c0 2024-02-17T00:37:19.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8009400 con 0x7f84d80b48c0 2024-02-17T00:37:19.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8032be0 con 0x7f84d80b48c0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.757+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d81f7710 con 0x7f84d80b48c0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.758+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d8068f60 con 0x7f84d80b48c0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.759+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f84c8032d40 con 0x7f84d80b48c0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.759+0000 7f84bffff640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f84c406b810 0x7f84c406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.759+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f84c80ac4f0 con 0x7f84d80b48c0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.759+0000 7f84d6ffd640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f84c406b810 0x7f84c406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.760+0000 7f84d6ffd640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f84c406b810 0x7f84c406dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f84d80d2d90 tx=0x7f84cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:19.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.763+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84c8076c50 con 0x7f84d80b48c0 2024-02-17T00:37:19.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.944+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84d80d0dd0 con 0x7f84d80b48c0 2024-02-17T00:37:19.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.944+0000 7f84bffff640 1 -- 172.21.15.32:0/1009243465 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84c807a310 con 0x7f84d80b48c0 2024-02-17T00:37:19.948 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:19.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f84c406b810 msgr2=0x7f84c406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f84c406b810 0x7f84c406dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f84d80d2d90 tx=0x7f84cc009040 comp rx=0 tx=0).stop 2024-02-17T00:37:19.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 msgr2=0x7f84d81f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 0x7f84d81f6da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f84c8034040 tx=0x7f84c80046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 shutdown_connections 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84d8161d90 0x7f84d815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f84c406b810 0x7f84c406dcd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f84d80d3f90 0x7f84d80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 --2- 172.21.15.32:0/1009243465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d80b48c0 0x7f84d81f6da0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 >> 172.21.15.32:0/1009243465 conn(0x7f84d808af80 msgr2=0x7f84d80d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 shutdown_connections 2024-02-17T00:37:19.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:19.947+0000 7f84dcf9e640 1 -- 172.21.15.32:0/1009243465 wait complete. 2024-02-17T00:37:19.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:20.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.062+0000 7fd687dbc640 1 Processor -- start 2024-02-17T00:37:20.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.062+0000 7fd687dbc640 1 -- start start 2024-02-17T00:37:20.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd687dbc640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6800ced20 0x7fd6800b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd687dbc640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800b2ee0 con 0x7fd680143fb0 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd687dbc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800b3150 con 0x7fd68006e950 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd687dbc640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800b4750 con 0x7fd6800ced20 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd686359640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6800ced20 0x7fd6800b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd685b58640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd680143fb0 0x7fd68006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55724/0 (socket says 172.21.15.32:55724) 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.063+0000 7fd685b58640 1 -- 172.21.15.32:0/2083870713 learned_addr learned my addr 172.21.15.32:0/2083870713 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd686359640 1 -- 172.21.15.32:0/2083870713 >> v1:172.21.15.39:6789/0 conn(0x7fd68006e950 legacy=0x7fd6800ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd686359640 1 -- 172.21.15.32:0/2083870713 >> v1:172.21.15.32:6789/0 conn(0x7fd680143fb0 legacy=0x7fd68006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd686359640 1 -- 172.21.15.32:0/2083870713 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800b3430 con 0x7fd6800ced20 2024-02-17T00:37:20.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd686359640 1 --2- 172.21.15.32:0/2083870713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd6800b3c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd6780097a0 tx=0x7fd67802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f437267cd0a6e3c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd684b56640 1 -- 172.21.15.32:0/2083870713 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678030610 con 0x7fd6800ced20 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd684b56640 1 -- 172.21.15.32:0/2083870713 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678030770 con 0x7fd6800ced20 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.064+0000 7fd684b56640 1 -- 172.21.15.32:0/2083870713 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678030b00 con 0x7fd6800ced20 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 -- 172.21.15.32:0/2083870713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 msgr2=0x7fd6800b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 --2- 172.21.15.32:0/2083870713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd6800b3c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd6780097a0 tx=0x7fd67802b960 comp rx=0 tx=0).stop 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 -- 172.21.15.32:0/2083870713 shutdown_connections 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 --2- 172.21.15.32:0/2083870713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd6800b3c30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 -- 172.21.15.32:0/2083870713 >> 172.21.15.32:0/2083870713 conn(0x7fd68006ab60 msgr2=0x7fd68006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 -- 172.21.15.32:0/2083870713 shutdown_connections 2024-02-17T00:37:20.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.065+0000 7fd687dbc640 1 -- 172.21.15.32:0/2083870713 wait complete. 2024-02-17T00:37:20.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.066+0000 7fd687dbc640 1 Processor -- start 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.066+0000 7fd687dbc640 1 -- start start 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd687dbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd68006e950 0x7fd6801f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd687dbc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd680159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd687dbc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd680143fb0 0x7fd6800a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd687dbc640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68015a520 con 0x7fd6800ced20 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd687dbc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801e5090 con 0x7fd68006e950 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd687dbc640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800a8ab0 con 0x7fd680143fb0 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd680159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd680159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40464/0 (socket says 172.21.15.32:40464) 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 -- 172.21.15.32:0/375978826 learned_addr learned my addr 172.21.15.32:0/375978826 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685b58640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd68006e950 0x7fd6801f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 -- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd680143fb0 msgr2=0x7fd6800a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd686359640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd680143fb0 0x7fd6800a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd680143fb0 0x7fd6800a8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 -- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd68006e950 msgr2=0x7fd6801f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd68006e950 0x7fd6801f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685357640 1 -- 172.21.15.32:0/375978826 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009400 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.067+0000 7fd685b58640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd68006e950 0x7fd6801f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.068+0000 7fd685357640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd680159fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c440 tx=0x7fd674001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.068+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740052d0 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.068+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674005430 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.068+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801e52e0 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.068+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674007260 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.068+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6801e58a0 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.069+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68015abf0 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.069+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd6740073c0 con 0x7fd6800ced20 2024-02-17T00:37:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.070+0000 7fd67e7fc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd66c06b810 0x7fd66c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.070+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fd674089960 con 0x7fd6800ced20 2024-02-17T00:37:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.070+0000 7fd685b58640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd66c06b810 0x7fd66c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.070+0000 7fd685b58640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd66c06b810 0x7fd66c06dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd670005c00 tx=0x7fd670009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.074+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd674054000 con 0x7fd6800ced20 2024-02-17T00:37:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.252+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd680068f60 con 0x7fd6800ced20 2024-02-17T00:37:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.253+0000 7fd67e7fc640 1 -- 172.21.15.32:0/375978826 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd6740576c0 con 0x7fd6800ced20 2024-02-17T00:37:20.256 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd66c06b810 msgr2=0x7fd66c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd66c06b810 0x7fd66c06dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd670005c00 tx=0x7fd670009040 comp rx=0 tx=0).stop 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 msgr2=0x7fd680159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd680159fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c440 tx=0x7fd674001e70 comp rx=0 tx=0).stop 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 shutdown_connections 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd66c06b810 0x7fd66c06dcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd680143fb0 0x7fd6800a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6800ced20 0x7fd680159fe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 --2- 172.21.15.32:0/375978826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd68006e950 0x7fd6801f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 >> 172.21.15.32:0/375978826 conn(0x7fd68006ab60 msgr2=0x7fd6800b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:20.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 shutdown_connections 2024-02-17T00:37:20.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.255+0000 7fd687dbc640 1 -- 172.21.15.32:0/375978826 wait complete. 2024-02-17T00:37:20.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:20.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.367+0000 7f73c438c640 1 Processor -- start 2024-02-17T00:37:20.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.367+0000 7f73c438c640 1 -- start start 2024-02-17T00:37:20.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c438c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73bc0d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c438c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73bc15e8a0 con 0x7f73bc0d0aa0 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c438c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73bc15eb80 con 0x7f73bc15da60 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c438c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc161640 con 0x7f73bc0d2ca0 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1927640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f73bc0d0aa0 0x7f73bc161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55736/0 (socket says 172.21.15.32:55736) 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1927640 1 -- 172.21.15.32:0/1465369863 learned_addr learned my addr 172.21.15.32:0/1465369863 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c2929640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73bc0d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769295379 0 0) 0x7f73bc15e8a0 con 0x7f73bc0d0aa0 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a4003520 con 0x7f73bc0d0aa0 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814214627 0 0) 0x7f73bc15eb80 con 0x7f73bc15da60 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73bc15e8a0 con 0x7f73bc15da60 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3923653663 0 0) 0x7f73a4003520 con 0x7f73bc0d0aa0 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 msgr2=0x7f73bc0d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73bc0d30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 >> v1:172.21.15.39:6789/0 conn(0x7f73bc15da60 legacy=0x7f73bc15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.368+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc15ee60 con 0x7f73bc0d0aa0 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f73b0001670 con 0x7f73bc0d0aa0 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 >> v1:172.21.15.32:6789/0 conn(0x7f73bc0d0aa0 legacy=0x7f73bc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73a4003b30 0x7f73a4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc161640 con 0x7f73a4004d00 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a400bb10 con 0x7f73a4003b30 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a400bca0 con 0x7f73bc0d2ca0 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2929640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1927640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2128640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73a4003b30 0x7f73a4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2929640 1 -- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 msgr2=0x7f73a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:20.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2929640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2929640 1 -- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73a4003b30 msgr2=0x7f73a4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2929640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73a4003b30 0x7f73a4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2929640 1 -- 172.21.15.32:0/1465369863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4003520 con 0x7f73a4004d00 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c2128640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73a4003b30 0x7f73a4003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.369+0000 7f73c1927640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc0d2ca0 0x7f73a40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c2929640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73a4005180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00e170 tx=0x7f73a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930d74cee4ac1338 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac02cbf0 con 0x7f73a4004d00 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac00f040 con 0x7f73a4004d00 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c1126640 1 -- 172.21.15.32:0/1465369863 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac034440 con 0x7f73a4004d00 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c438c640 1 -- 172.21.15.32:0/1465369863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 msgr2=0x7f73a4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c438c640 1 --2- 172.21.15.32:0/1465369863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73a4005180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00e170 tx=0x7f73a40057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c2929640 1 -- 172.21.15.32:0/1465369863 reap_dead start 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c438c640 1 -- 172.21.15.32:0/1465369863 shutdown_connections 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.370+0000 7f73c438c640 1 -- 172.21.15.32:0/1465369863 >> 172.21.15.32:0/1465369863 conn(0x7f73bc06bfe0 msgr2=0x7f73bc06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:20.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.371+0000 7f73c438c640 1 -- 172.21.15.32:0/1465369863 shutdown_connections 2024-02-17T00:37:20.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.371+0000 7f73c438c640 1 -- 172.21.15.32:0/1465369863 wait complete. 2024-02-17T00:37:20.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 Processor -- start 2024-02-17T00:37:20.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 -- start start 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73bc0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc1f6890 0x7f73bc0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc160990 0x7f73bc160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0aa220 con 0x7f73a4004d00 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc161350 con 0x7f73bc160990 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.372+0000 7f73c438c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0aa4c0 con 0x7f73bc1f6890 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73bc0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73bc0b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40484/0 (socket says 172.21.15.32:40484) 2024-02-17T00:37:20.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 -- 172.21.15.32:0/3578907772 learned_addr learned my addr 172.21.15.32:0/3578907772 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2929640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc160990 0x7f73bc160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c1927640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc1f6890 0x7f73bc0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 -- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc1f6890 msgr2=0x7f73bc0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc1f6890 0x7f73bc0b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 -- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc160990 msgr2=0x7f73bc160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc160990 0x7f73bc160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 -- 172.21.15.32:0/3578907772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc162600 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c2128640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73bc0b5570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f73b400e780 tx=0x7f73b400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4017070 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b40050d0 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc1f7070 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4005260 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.373+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc1f7630 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.374+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc0680c0 con 0x7f73a4004d00 2024-02-17T00:37:20.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.375+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f73b4007020 con 0x7f73a4004d00 2024-02-17T00:37:20.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.375+0000 7f73baffd640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.375+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f73b4089c80 con 0x7f73a4004d00 2024-02-17T00:37:20.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.375+0000 7f73c1927640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.376+0000 7f73c1927640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73b0001eb0 tx=0x7f73b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.379+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73b4054480 con 0x7f73a4004d00 2024-02-17T00:37:20.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.561+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73bc1f77c0 con 0x7f73a4004d00 2024-02-17T00:37:20.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.563+0000 7f73baffd640 1 -- 172.21.15.32:0/3578907772 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f73b4057b40 con 0x7f73a4004d00 2024-02-17T00:37:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:20.566 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.564+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 msgr2=0x7f73a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.564+0000 7f73c438c640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73b0001eb0 tx=0x7f73b0009040 comp rx=0 tx=0).stop 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.564+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 msgr2=0x7f73bc0b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.564+0000 7f73c438c640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73bc0b5570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f73b400e780 tx=0x7f73b400ec40 comp rx=0 tx=0).stop 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 shutdown_connections 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc160990 0x7f73bc160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc1f6890 0x7f73bc0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 --2- 172.21.15.32:0/3578907772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d00 0x7f73bc0b5570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 >> 172.21.15.32:0/3578907772 conn(0x7f73bc06bfe0 msgr2=0x7f73bc0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:20.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 shutdown_connections 2024-02-17T00:37:20.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.565+0000 7f73c438c640 1 -- 172.21.15.32:0/3578907772 wait complete. 2024-02-17T00:37:20.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:20.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:20.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.681+0000 7f4d4834f640 1 Processor -- start 2024-02-17T00:37:20.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.681+0000 7f4d4834f640 1 -- start start 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d4834f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d40161200 0x7f4d400cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d4834f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d4009a9a0 0x7f4d400cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d4834f640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4009ae10 con 0x7f4d400d0a00 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d4834f640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d401615e0 con 0x7f4d40161200 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d4834f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4006c9f0 con 0x7f4d4009a9a0 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d460eb640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d40161200 0x7f4d400cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d458ea640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4d400d0a00 0x7f4d4009a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55750/0 (socket says 172.21.15.32:55750) 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d458ea640 1 -- 172.21.15.32:0/1932811407 learned_addr learned my addr 172.21.15.32:0/1932811407 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d468ec640 1 --2- 172.21.15.32:0/1932811407 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d4009a9a0 0x7f4d400cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d460eb640 1 -- 172.21.15.32:0/1932811407 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d4009a9a0 msgr2=0x7f4d400cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d460eb640 1 --2- 172.21.15.32:0/1932811407 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d4009a9a0 0x7f4d400cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d460eb640 1 -- 172.21.15.32:0/1932811407 >> v1:172.21.15.32:6789/0 conn(0x7f4d400d0a00 legacy=0x7f4d4009a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d460eb640 1 -- 172.21.15.32:0/1932811407 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4006ccd0 con 0x7f4d40161200 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.682+0000 7f4d450e9640 1 -- 172.21.15.32:0/1932811407 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414083055 0 0) 0x7f4d4009ae10 con 0x7f4d400d0a00 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.683+0000 7f4d460eb640 1 --2- 172.21.15.32:0/1932811407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cbd00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0097a0 tx=0x7f4d3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff2440cf4de2b6e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.683+0000 7f4d450e9640 1 -- 172.21.15.32:0/1932811407 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c031830 con 0x7f4d40161200 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.683+0000 7f4d450e9640 1 -- 172.21.15.32:0/1932811407 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c031990 con 0x7f4d40161200 2024-02-17T00:37:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.683+0000 7f4d450e9640 1 -- 172.21.15.32:0/1932811407 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c031d20 con 0x7f4d40161200 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 -- 172.21.15.32:0/1932811407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 msgr2=0x7f4d400cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 --2- 172.21.15.32:0/1932811407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cbd00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0097a0 tx=0x7f4d3c02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 -- 172.21.15.32:0/1932811407 shutdown_connections 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 --2- 172.21.15.32:0/1932811407 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d4009a9a0 0x7f4d400cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 --2- 172.21.15.32:0/1932811407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cbd00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 -- 172.21.15.32:0/1932811407 >> 172.21.15.32:0/1932811407 conn(0x7f4d400b31a0 msgr2=0x7f4d400b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 -- 172.21.15.32:0/1932811407 shutdown_connections 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.684+0000 7f4d4834f640 1 -- 172.21.15.32:0/1932811407 wait complete. 2024-02-17T00:37:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.685+0000 7f4d4834f640 1 Processor -- start 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.685+0000 7f4d4834f640 1 -- start start 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.685+0000 7f4d4834f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d4009a9a0 0x7f4d400c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.685+0000 7f4d4834f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d400d0a00 0x7f4d4015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d4834f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d4834f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4015ad40 con 0x7f4d40161200 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d4834f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400c8e10 con 0x7f4d4009a9a0 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d4834f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400c90f0 con 0x7f4d400d0a00 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40496/0 (socket says 172.21.15.32:40496) 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 -- 172.21.15.32:0/2947243672 learned_addr learned my addr 172.21.15.32:0/2947243672 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d460eb640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d4009a9a0 0x7f4d400c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d458ea640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d400d0a00 0x7f4d4015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 -- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d400d0a00 msgr2=0x7f4d4015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d400d0a00 0x7f4d4015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 -- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d4009a9a0 msgr2=0x7f4d400c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d4009a9a0 0x7f4d400c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 -- 172.21.15.32:0/2947243672 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009400 con 0x7f4d40161200 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d458ea640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d400d0a00 0x7f4d4015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d468ec640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cf800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800efc0 tx=0x7f4d3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38009ba0 con 0x7f4d40161200 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3800f040 con 0x7f4d40161200 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d400c93d0 con 0x7f4d40161200 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380146c0 con 0x7f4d40161200 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.686+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4015b0e0 con 0x7f4d40161200 2024-02-17T00:37:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.687+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d400680c0 con 0x7f4d40161200 2024-02-17T00:37:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.688+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4d38014820 con 0x7f4d40161200 2024-02-17T00:37:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.688+0000 7f4d36ffd640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4d2406b810 0x7f4d2406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.688+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4d3808af90 con 0x7f4d40161200 2024-02-17T00:37:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.688+0000 7f4d460eb640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4d2406b810 0x7f4d2406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.689+0000 7f4d460eb640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4d2406b810 0x7f4d2406dcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c036000 tx=0x7f4d3c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.692+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d380be8c0 con 0x7f4d40161200 2024-02-17T00:37:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.872+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d40067ba0 con 0x7f4d40161200 2024-02-17T00:37:20.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.872+0000 7f4d36ffd640 1 -- 172.21.15.32:0/2947243672 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d38018020 con 0x7f4d40161200 2024-02-17T00:37:20.875 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4d2406b810 msgr2=0x7f4d2406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4d2406b810 0x7f4d2406dcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c036000 tx=0x7f4d3c03c040 comp rx=0 tx=0).stop 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 msgr2=0x7f4d400cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cf800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800efc0 tx=0x7f4d3800c490 comp rx=0 tx=0).stop 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 shutdown_connections 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d40161200 0x7f4d400cf800 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4d2406b810 0x7f4d2406dcd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4d400d0a00 0x7f4d4015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 --2- 172.21.15.32:0/2947243672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d4009a9a0 0x7f4d400c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 >> 172.21.15.32:0/2947243672 conn(0x7f4d400b31a0 msgr2=0x7f4d40073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 shutdown_connections 2024-02-17T00:37:20.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.874+0000 7f4d4834f640 1 -- 172.21.15.32:0/2947243672 wait complete. 2024-02-17T00:37:20.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:20.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.989+0000 7f4e2430d640 1 Processor -- start 2024-02-17T00:37:20.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.989+0000 7f4e2430d640 1 -- start start 2024-02-17T00:37:20.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e2430d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e1c0b1480 0x7f4e1c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e2430d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cc580 0x7f4e1c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e2430d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c0b25e0 con 0x7f4e1c0cfc40 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e2430d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c15bec0 con 0x7f4e1c0b1480 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e2430d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0b19d0 con 0x7f4e1c0cc580 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e220a9640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4e1c0cfc40 0x7f4e1c0d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55752/0 (socket says 172.21.15.32:55752) 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e220a9640 1 -- 172.21.15.32:0/795542786 learned_addr learned my addr 172.21.15.32:0/795542786 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e218a8640 1 --2- 172.21.15.32:0/795542786 >> v2:172.21.15.39:3300/0 conn(0x7f4e1c0b1480 0x7f4e1c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.990+0000 7f4e228aa640 1 --2- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cc580 0x7f4e1c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.991+0000 7f4e210a7640 1 -- 172.21.15.32:0/795542786 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790096493 0 0) 0x7f4e1c0b25e0 con 0x7f4e1c0cfc40 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.991+0000 7f4e210a7640 1 -- 172.21.15.32:0/795542786 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e08003520 con 0x7f4e1c0cfc40 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.991+0000 7f4e218a8640 1 -- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cc580 msgr2=0x7f4e1c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.991+0000 7f4e218a8640 1 --2- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cc580 0x7f4e1c0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.991+0000 7f4e218a8640 1 -- 172.21.15.32:0/795542786 >> v1:172.21.15.32:6789/0 conn(0x7f4e1c0cfc40 legacy=0x7f4e1c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.991+0000 7f4e218a8640 1 -- 172.21.15.32:0/795542786 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0b1cb0 con 0x7f4e1c0b1480 2024-02-17T00:37:20.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e218a8640 1 --2- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c0b0ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097a0 tx=0x7f4e0c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2007d11bc244289a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:20.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e210a7640 1 -- 172.21.15.32:0/795542786 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c031830 con 0x7f4e1c0b1480 2024-02-17T00:37:20.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e210a7640 1 -- 172.21.15.32:0/795542786 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c031990 con 0x7f4e1c0b1480 2024-02-17T00:37:20.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e210a7640 1 -- 172.21.15.32:0/795542786 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c031d20 con 0x7f4e1c0b1480 2024-02-17T00:37:20.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 -- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0b1480 msgr2=0x7f4e1c0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 --2- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c0b0ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097a0 tx=0x7f4e0c02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 -- 172.21.15.32:0/795542786 shutdown_connections 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 --2- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c0b0ad0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 --2- 172.21.15.32:0/795542786 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cc580 0x7f4e1c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 -- 172.21.15.32:0/795542786 >> 172.21.15.32:0/795542786 conn(0x7f4e1c08af80 msgr2=0x7f4e1c08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 -- 172.21.15.32:0/795542786 shutdown_connections 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.992+0000 7f4e2430d640 1 -- 172.21.15.32:0/795542786 wait complete. 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.993+0000 7f4e2430d640 1 Processor -- start 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 -- start start 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0cc580 0x7f4e1c152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cfc40 0x7f4e1c1f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0ca430 con 0x7f4e1c0b1480 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c1f1680 con 0x7f4e1c0cc580 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e2430d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0c9db0 con 0x7f4e1c0cfc40 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e220a9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e220a9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40502/0 (socket says 172.21.15.32:40502) 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e220a9640 1 -- 172.21.15.32:0/3343610266 learned_addr learned my addr 172.21.15.32:0/3343610266 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e218a8640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0cc580 0x7f4e1c152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.994+0000 7f4e228aa640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cfc40 0x7f4e1c1f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e220a9640 1 -- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cfc40 msgr2=0x7f4e1c1f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e220a9640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cfc40 0x7f4e1c1f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e220a9640 1 -- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0cc580 msgr2=0x7f4e1c152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e220a9640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0cc580 0x7f4e1c152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e220a9640 1 -- 172.21.15.32:0/3343610266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c009400 con 0x7f4e1c0b1480 2024-02-17T00:37:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e220a9640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c158d30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800c390 tx=0x7f4e1800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18005ce0 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18005e40 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c0b5250 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180072f0 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.995+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c0ca050 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.996+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c0ca570 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.996+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4e18007450 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.997+0000 7f4e12ffd640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e0006b810 0x7f4e0006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.997+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4e18089b80 con 0x7f4e1c0b1480 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.997+0000 7f4e218a8640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e0006b810 0x7f4e0006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:20.997+0000 7f4e218a8640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e0006b810 0x7f4e0006dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c036000 tx=0x7f4e0c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.001+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e1c0ca570 con 0x7f4e1c0b1480 2024-02-17T00:37:21.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.180+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e1c0ca570 con 0x7f4e1c0b1480 2024-02-17T00:37:21.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.180+0000 7f4e12ffd640 1 -- 172.21.15.32:0/3343610266 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e1c0ca570 con 0x7f4e1c0b1480 2024-02-17T00:37:21.183 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:21.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e0006b810 msgr2=0x7f4e0006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e0006b810 0x7f4e0006dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c036000 tx=0x7f4e0c03c040 comp rx=0 tx=0).stop 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 msgr2=0x7f4e1c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c158d30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800c390 tx=0x7f4e1800c850 comp rx=0 tx=0).stop 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 shutdown_connections 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4e0006b810 0x7f4e0006dcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4e1c0cfc40 0x7f4e1c1f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e1c0cc580 0x7f4e1c152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 --2- 172.21.15.32:0/3343610266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e1c0b1480 0x7f4e1c158d30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 >> 172.21.15.32:0/3343610266 conn(0x7f4e1c08af80 msgr2=0x7f4e1c0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 shutdown_connections 2024-02-17T00:37:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.182+0000 7f4e2430d640 1 -- 172.21.15.32:0/3343610266 wait complete. 2024-02-17T00:37:21.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:21.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.298+0000 7f20eb5a0640 1 Processor -- start 2024-02-17T00:37:21.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.298+0000 7f20eb5a0640 1 -- start start 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.298+0000 7f20eb5a0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20e40d3760 0x7f20e415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.298+0000 7f20eb5a0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f20e415f1c0 0x7f20e40d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.298+0000 7f20eb5a0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40ce830 0x7f20e40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20eb5a0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40ceff0 con 0x7f20e40d3760 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20eb5a0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40ce380 con 0x7f20e415f1c0 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20eb5a0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e415f000 con 0x7f20e40ce830 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20e40d3760 0x7f20e415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20e40d3760 0x7f20e415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40508/0 (socket says 172.21.15.32:40508) 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 -- 172.21.15.32:0/1429144077 learned_addr learned my addr 172.21.15.32:0/1429144077 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:21.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e8b3b640 1 --2- 172.21.15.32:0/1429144077 >> v2:172.21.15.39:3300/0 conn(0x7f20e415f1c0 0x7f20e40d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 -- 172.21.15.32:0/1429144077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40ce830 msgr2=0x7f20e40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 --2- 172.21.15.32:0/1429144077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40ce830 0x7f20e40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 -- 172.21.15.32:0/1429144077 >> v2:172.21.15.39:3300/0 conn(0x7f20e415f1c0 msgr2=0x7f20e40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 --2- 172.21.15.32:0/1429144077 >> v2:172.21.15.39:3300/0 conn(0x7f20e415f1c0 0x7f20e40d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e933c640 1 -- 172.21.15.32:0/1429144077 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40d2190 con 0x7f20e40d3760 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.299+0000 7f20e8b3b640 1 --2- 172.21.15.32:0/1429144077 >> v2:172.21.15.39:3300/0 conn(0x7f20e415f1c0 0x7f20e40d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20e933c640 1 --2- 172.21.15.32:0/1429144077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40d3760 0x7f20e415eac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f20e40b9830 tx=0x7f20e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c3c457ac124111 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20dbfff640 1 -- 172.21.15.32:0/1429144077 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e002ca70 con 0x7f20e40d3760 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20dbfff640 1 -- 172.21.15.32:0/1429144077 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e002cbd0 con 0x7f20e40d3760 2024-02-17T00:37:21.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20dbfff640 1 -- 172.21.15.32:0/1429144077 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00343f0 con 0x7f20e40d3760 2024-02-17T00:37:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 -- 172.21.15.32:0/1429144077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40d3760 msgr2=0x7f20e415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/1429144077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40d3760 0x7f20e415eac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f20e40b9830 tx=0x7f20e002bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 -- 172.21.15.32:0/1429144077 shutdown_connections 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/1429144077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40ce830 0x7f20e40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/1429144077 >> v2:172.21.15.39:3300/0 conn(0x7f20e415f1c0 0x7f20e40d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/1429144077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40d3760 0x7f20e415eac0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.300+0000 7f20eb5a0640 1 -- 172.21.15.32:0/1429144077 >> 172.21.15.32:0/1429144077 conn(0x7f20e4072680 msgr2=0x7f20e4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.301+0000 7f20eb5a0640 1 -- 172.21.15.32:0/1429144077 shutdown_connections 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.301+0000 7f20eb5a0640 1 -- 172.21.15.32:0/1429144077 wait complete. 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 Processor -- start 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 -- start start 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 0x7f20e41f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40d3760 0x7f20e40aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e415f1c0 0x7f20e414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40aabd0 con 0x7f20e40ce830 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40cbf30 con 0x7f20e415f1c0 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20eb5a0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40cc210 con 0x7f20e40d3760 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20e933c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 0x7f20e41f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20e933c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 0x7f20e41f73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40516/0 (socket says 172.21.15.32:40516) 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.302+0000 7f20e933c640 1 -- 172.21.15.32:0/4105992527 learned_addr learned my addr 172.21.15.32:0/4105992527 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e933c640 1 -- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40d3760 msgr2=0x7f20e40aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e9b3d640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e415f1c0 0x7f20e414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e8b3b640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40d3760 0x7f20e40aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e933c640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40d3760 0x7f20e40aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e933c640 1 -- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e415f1c0 msgr2=0x7f20e414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e933c640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e415f1c0 0x7f20e414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e933c640 1 -- 172.21.15.32:0/4105992527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0009b30 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e9b3d640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e415f1c0 0x7f20e414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20e933c640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 0x7f20e41f73f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f80 tx=0x7f20e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e003e450 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e003e5f0 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e40cc4f0 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e003e9a0 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.303+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e40ccab0 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.304+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e40ccca0 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.305+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f20e003eb00 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.305+0000 7f20d9ffb640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f20c806b810 0x7f20c806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.305+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f20e00ad450 con 0x7f20e40ce830 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.305+0000 7f20e8b3b640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f20c806b810 0x7f20c806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.306+0000 7f20e8b3b640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f20c806b810 0x7f20c806dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20e415f5a0 tx=0x7f20d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.310+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20e0077b00 con 0x7f20e40ce830 2024-02-17T00:37:21.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.489+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20e4068f60 con 0x7f20e40ce830 2024-02-17T00:37:21.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.489+0000 7f20d9ffb640 1 -- 172.21.15.32:0/4105992527 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20e003edb0 con 0x7f20e40ce830 2024-02-17T00:37:21.492 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:21.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f20c806b810 msgr2=0x7f20c806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f20c806b810 0x7f20c806dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20e415f5a0 tx=0x7f20d4008040 comp rx=0 tx=0).stop 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 msgr2=0x7f20e41f73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 0x7f20e41f73f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f80 tx=0x7f20e0004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 shutdown_connections 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e415f1c0 0x7f20e414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f20c806b810 0x7f20c806dcd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f20e40d3760 0x7f20e40aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 --2- 172.21.15.32:0/4105992527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20e40ce830 0x7f20e41f73f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 >> 172.21.15.32:0/4105992527 conn(0x7f20e4072680 msgr2=0x7f20e40c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 shutdown_connections 2024-02-17T00:37:21.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.491+0000 7f20eb5a0640 1 -- 172.21.15.32:0/4105992527 wait complete. 2024-02-17T00:37:21.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.606+0000 7f5d2dfe2640 1 Processor -- start 2024-02-17T00:37:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.606+0000 7f5d2dfe2640 1 -- start start 2024-02-17T00:37:21.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.606+0000 7f5d2dfe2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d280d3760 0x7f5d2815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.606+0000 7f5d2dfe2640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280ce380 con 0x7f5d280ce830 2024-02-17T00:37:21.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.606+0000 7f5d2dfe2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2815f000 con 0x7f5d2815f1c0 2024-02-17T00:37:21.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.606+0000 7f5d2dfe2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280ceff0 con 0x7f5d280d3760 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d27fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5d280ce830 0x7f5d280b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55754/0 (socket says 172.21.15.32:55754) 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d27fff640 1 -- 172.21.15.32:0/3661368754 learned_addr learned my addr 172.21.15.32:0/3661368754 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487102785 0 0) 0x7f5d280ce380 con 0x7f5d280ce830 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d277fe640 1 --2- 172.21.15.32:0/3661368754 >> v2:172.21.15.39:3300/0 conn(0x7f5d280d3760 0x7f5d2815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d10003520 con 0x7f5d280ce830 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231552061 0 0) 0x7f5d10003520 con 0x7f5d280ce830 2024-02-17T00:37:21.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 >> v2:172.21.15.39:3300/0 conn(0x7f5d280d3760 msgr2=0x7f5d2815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 --2- 172.21.15.32:0/3661368754 >> v2:172.21.15.39:3300/0 conn(0x7f5d280d3760 0x7f5d2815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 >> v1:172.21.15.39:6789/0 conn(0x7f5d2815f1c0 legacy=0x7f5d280d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280d2190 con 0x7f5d280ce830 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f5d200019f0 con 0x7f5d280ce830 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d277fe640 1 --2- 172.21.15.32:0/3661368754 >> v2:172.21.15.39:3300/0 conn(0x7f5d280d3760 0x7f5d2815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 >> v1:172.21.15.32:6789/0 conn(0x7f5d280ce830 legacy=0x7f5d280b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d10003970 0x7f5d10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d10005180 0x7f5d1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280ceff0 con 0x7f5d100047c0 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1000c0d0 con 0x7f5d10005180 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1000c290 con 0x7f5d10003970 2024-02-17T00:37:21.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d277fe640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d10003970 0x7f5d10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.607+0000 7f5d27fff640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d10005180 0x7f5d1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d26ffd640 1 -- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d10003970 msgr2=0x7f5d10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d10003970 0x7f5d10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d26ffd640 1 -- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d10005180 msgr2=0x7f5d1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d10005180 0x7f5d1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d26ffd640 1 -- 172.21.15.32:0/3661368754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d10003520 con 0x7f5d100047c0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d27fff640 1 -- 172.21.15.32:0/3661368754 reap_dead start 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d10004c40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001580 tx=0x7f5d100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e127542a38119f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0052d0 con 0x7f5d100047c0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c02e050 con 0x7f5d100047c0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.608+0000 7f5d267fc640 1 -- 172.21.15.32:0/3661368754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c003830 con 0x7f5d100047c0 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/3661368754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 msgr2=0x7f5d10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d10004c40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001580 tx=0x7f5d100057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/3661368754 shutdown_connections 2024-02-17T00:37:21.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/3661368754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d10004c40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/3661368754 >> 172.21.15.32:0/3661368754 conn(0x7f5d28072680 msgr2=0x7f5d28072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/3661368754 shutdown_connections 2024-02-17T00:37:21.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.609+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/3661368754 wait complete. 2024-02-17T00:37:21.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.610+0000 7f5d2dfe2640 1 Processor -- start 2024-02-17T00:37:21.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.610+0000 7f5d2dfe2640 1 -- start start 2024-02-17T00:37:21.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d2dfe2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d280cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d2dfe2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d281574e0 0x7f5d2814db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d2dfe2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d28159e70 0x7f5d2815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d2dfe2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815a830 con 0x7f5d100047c0 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d2dfe2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28157960 con 0x7f5d28159e70 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d2dfe2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814e0c0 con 0x7f5d281574e0 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d280cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d280cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40522/0 (socket says 172.21.15.32:40522) 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 -- 172.21.15.32:0/1566243170 learned_addr learned my addr 172.21.15.32:0/1566243170 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d27fff640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d28159e70 0x7f5d2815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d281574e0 0x7f5d2814db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 -- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d281574e0 msgr2=0x7f5d2814db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d281574e0 0x7f5d2814db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 -- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d28159e70 msgr2=0x7f5d2815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d28159e70 0x7f5d2815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.611+0000 7f5d277fe640 1 -- 172.21.15.32:0/1566243170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28157be0 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.612+0000 7f5d277fe640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d280cb9d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d180115d0 tx=0x7f5d18011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.612+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800c070 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.612+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800f9b0 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.612+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d28157ec0 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.612+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800fd20 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.612+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28158480 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.613+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d28068f60 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.613+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5d18015460 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.614+0000 7f5d0ffff640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d1406b810 0x7f5d1406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.614+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5d1808a920 con 0x7f5d100047c0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.614+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d1406b810 0x7f5d1406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.615+0000 7f5d26ffd640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d1406b810 0x7f5d1406dcd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c033000 tx=0x7f5d1c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.618+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d18054fd0 con 0x7f5d100047c0 2024-02-17T00:37:21.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.799+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5d280ce610 con 0x7f5d100047c0 2024-02-17T00:37:21.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.799+0000 7f5d0ffff640 1 -- 172.21.15.32:0/1566243170 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d18058690 con 0x7f5d100047c0 2024-02-17T00:37:21.802 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d1406b810 msgr2=0x7f5d1406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d1406b810 0x7f5d1406dcd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c033000 tx=0x7f5d1c009030 comp rx=0 tx=0).stop 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 msgr2=0x7f5d280cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d280cb9d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d180115d0 tx=0x7f5d18011a90 comp rx=0 tx=0).stop 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 shutdown_connections 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d28159e70 0x7f5d2815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5d1406b810 0x7f5d1406dcd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d281574e0 0x7f5d2814db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 --2- 172.21.15.32:0/1566243170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d100047c0 0x7f5d280cb9d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 >> 172.21.15.32:0/1566243170 conn(0x7f5d28072680 msgr2=0x7f5d280d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 shutdown_connections 2024-02-17T00:37:21.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.801+0000 7f5d2dfe2640 1 -- 172.21.15.32:0/1566243170 wait complete. 2024-02-17T00:37:21.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:21.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.913+0000 7f26a34d4640 1 Processor -- start 2024-02-17T00:37:21.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.913+0000 7f26a34d4640 1 -- start start 2024-02-17T00:37:21.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a34d4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f269c15da20 0x7f269c09a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a34d4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0d06e0 con 0x7f269c06c330 2024-02-17T00:37:21.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a34d4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c09a940 con 0x7f269c06bc70 2024-02-17T00:37:21.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a34d4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c0cfad0 con 0x7f269c15da20 2024-02-17T00:37:21.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a1a71640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f269c06c330 0x7f269c0cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55766/0 (socket says 172.21.15.32:55766) 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a1a71640 1 -- 172.21.15.32:0/184458892 learned_addr learned my addr 172.21.15.32:0/184458892 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675066649 0 0) 0x7f269c0d06e0 con 0x7f269c06c330 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f26a1270640 1 --2- 172.21.15.32:0/184458892 >> v2:172.21.15.39:3300/0 conn(0x7f269c15da20 0x7f269c09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.914+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2684003520 con 0x7f269c06c330 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920870636 0 0) 0x7f2684003520 con 0x7f269c06c330 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 >> v2:172.21.15.39:3300/0 conn(0x7f269c15da20 msgr2=0x7f269c09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 --2- 172.21.15.32:0/184458892 >> v2:172.21.15.39:3300/0 conn(0x7f269c15da20 0x7f269c09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 >> v1:172.21.15.39:6789/0 conn(0x7f269c06bc70 legacy=0x7f269c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0cfdb0 con 0x7f269c06c330 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f268c0019f0 con 0x7f269c06c330 2024-02-17T00:37:21.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 --2- 172.21.15.32:0/184458892 >> v2:172.21.15.39:3300/0 conn(0x7f269c15da20 0x7f269c09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 >> v1:172.21.15.32:6789/0 conn(0x7f269c06c330 legacy=0x7f269c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26840039c0 0x7f2684003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840051d0 0x7f268400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0cfad0 con 0x7f26840039c0 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268400c120 con 0x7f26840047c0 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268400c2e0 con 0x7f26840051d0 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26840039c0 0x7f2684003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a0a6f640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1a71640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840051d0 0x7f268400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 -- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840051d0 msgr2=0x7f268400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840051d0 0x7f268400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 -- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26840047c0 msgr2=0x7f2684004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1270640 1 -- 172.21.15.32:0/184458892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684003520 con 0x7f26840039c0 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1a71640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840051d0 0x7f268400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.915+0000 7f26a1a71640 1 -- 172.21.15.32:0/184458892 reap_dead start 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.916+0000 7f26a1270640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26840039c0 0x7f2684003de0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f26940098a0 tx=0x7f26840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f21c1e1a5face0b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.916+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694004230 con 0x7f26840039c0 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.916+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2694004390 con 0x7f26840039c0 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.916+0000 7f269bfff640 1 -- 172.21.15.32:0/184458892 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694003830 con 0x7f26840039c0 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.916+0000 7f26a34d4640 1 -- 172.21.15.32:0/184458892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26840039c0 msgr2=0x7f2684003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.916+0000 7f26a34d4640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26840039c0 0x7f2684003de0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f26940098a0 tx=0x7f26840057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.917+0000 7f26a34d4640 1 -- 172.21.15.32:0/184458892 shutdown_connections 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.917+0000 7f26a34d4640 1 --2- 172.21.15.32:0/184458892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26840039c0 0x7f2684003de0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.917+0000 7f26a34d4640 1 -- 172.21.15.32:0/184458892 >> 172.21.15.32:0/184458892 conn(0x7f269c0d16f0 msgr2=0x7f269c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.917+0000 7f26a34d4640 1 -- 172.21.15.32:0/184458892 shutdown_connections 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.917+0000 7f26a34d4640 1 -- 172.21.15.32:0/184458892 wait complete. 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.918+0000 7f26a34d4640 1 Processor -- start 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.918+0000 7f26a34d4640 1 -- start start 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840039c0 0x7f269c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f269c15bd90 0x7f269c0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 0x7f269c1e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0c6c40 con 0x7f269c0c67c0 2024-02-17T00:37:21.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c15baf0 con 0x7f269c15bd90 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0c5220 con 0x7f26840039c0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 0x7f269c1e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 0x7f269c1e3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40534/0 (socket says 172.21.15.32:40534) 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 -- 172.21.15.32:0/546712565 learned_addr learned my addr 172.21.15.32:0/546712565 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a0a6f640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f269c15bd90 0x7f269c0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1270640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840039c0 0x7f269c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 -- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840039c0 msgr2=0x7f269c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840039c0 0x7f269c15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 -- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f269c15bd90 msgr2=0x7f269c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f269c15bd90 0x7f269c0c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 -- 172.21.15.32:0/546712565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0c54c0 con 0x7f269c0c67c0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a1a71640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 0x7f269c1e3cb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f269c0683d0 tx=0x7f268c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c00eb90 con 0x7f269c0c67c0 2024-02-17T00:37:21.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c00ecf0 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c0c57a0 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.919+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c013620 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.920+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c0c5d60 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.920+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c073ce0 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.921+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f268c013780 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.921+0000 7f2699ffb640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f268806b840 0x7f268806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.921+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f268c08a990 con 0x7f269c0c67c0 2024-02-17T00:37:21.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.921+0000 7f26a1270640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f268806b840 0x7f268806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:21.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.922+0000 7f26a1270640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f268806b840 0x7f268806dd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2694035000 tx=0x7f269403a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:21.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:21.925+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f268c055040 con 0x7f269c0c67c0 2024-02-17T00:37:22.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.110+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f269c068fd0 con 0x7f269c0c67c0 2024-02-17T00:37:22.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.111+0000 7f2699ffb640 1 -- 172.21.15.32:0/546712565 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f268c058700 con 0x7f269c0c67c0 2024-02-17T00:37:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:22.115 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:22.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f268806b840 msgr2=0x7f268806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f268806b840 0x7f268806dd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2694035000 tx=0x7f269403a040 comp rx=0 tx=0).stop 2024-02-17T00:37:22.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 msgr2=0x7f269c1e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 0x7f269c1e3cb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f269c0683d0 tx=0x7f268c00e530 comp rx=0 tx=0).stop 2024-02-17T00:37:22.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 shutdown_connections 2024-02-17T00:37:22.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f269c0c67c0 0x7f269c1e3cb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f269c15bd90 0x7f269c0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f268806b840 0x7f268806dd00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 --2- 172.21.15.32:0/546712565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f26840039c0 0x7f269c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.113+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 >> 172.21.15.32:0/546712565 conn(0x7f269c0d16f0 msgr2=0x7f269c0b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:22.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.114+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 shutdown_connections 2024-02-17T00:37:22.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.114+0000 7f26a34d4640 1 -- 172.21.15.32:0/546712565 wait complete. 2024-02-17T00:37:22.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:22.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:22.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.229+0000 7fcb56dd0640 1 Processor -- start 2024-02-17T00:37:22.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.229+0000 7fcb56dd0640 1 -- start start 2024-02-17T00:37:22.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb56dd0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb500cfc40 0x7fcb500d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb56dd0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b1480 0x7fcb500b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb56dd0640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb500b25e0 con 0x7fcb500ce070 2024-02-17T00:37:22.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb56dd0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5015bec0 con 0x7fcb500cfc40 2024-02-17T00:37:22.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb56dd0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb500d0560 con 0x7fcb500b1480 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb54b6c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb500cfc40 0x7fcb500d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb5536d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcb500ce070 0x7fcb500ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55778/0 (socket says 172.21.15.32:55778) 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb5536d640 1 -- 172.21.15.32:0/3944268962 learned_addr learned my addr 172.21.15.32:0/3944268962 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb4ffff640 1 --2- 172.21.15.32:0/3944268962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b1480 0x7fcb500b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb54b6c640 1 -- 172.21.15.32:0/3944268962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b1480 msgr2=0x7fcb500b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb54b6c640 1 --2- 172.21.15.32:0/3944268962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b1480 0x7fcb500b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb54b6c640 1 -- 172.21.15.32:0/3944268962 >> v1:172.21.15.32:6789/0 conn(0x7fcb500ce070 legacy=0x7fcb500ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.230+0000 7fcb54b6c640 1 -- 172.21.15.32:0/3944268962 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500b19d0 con 0x7fcb500cfc40 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.231+0000 7fcb54b6c640 1 --2- 172.21.15.32:0/3944268962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500cfc40 0x7fcb500d0020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcb440097a0 tx=0x7fcb4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f54ff76cd4c81a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.231+0000 7fcb4f7fe640 1 -- 172.21.15.32:0/3944268962 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44031830 con 0x7fcb500cfc40 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.231+0000 7fcb4f7fe640 1 -- 172.21.15.32:0/3944268962 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44031990 con 0x7fcb500cfc40 2024-02-17T00:37:22.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.231+0000 7fcb4f7fe640 1 -- 172.21.15.32:0/3944268962 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44031d20 con 0x7fcb500cfc40 2024-02-17T00:37:22.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 -- 172.21.15.32:0/3944268962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500cfc40 msgr2=0x7fcb500d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/3944268962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500cfc40 0x7fcb500d0020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcb440097a0 tx=0x7fcb4402b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 -- 172.21.15.32:0/3944268962 shutdown_connections 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/3944268962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b1480 0x7fcb500b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/3944268962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500cfc40 0x7fcb500d0020 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 -- 172.21.15.32:0/3944268962 >> 172.21.15.32:0/3944268962 conn(0x7fcb5008af80 msgr2=0x7fcb5008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 -- 172.21.15.32:0/3944268962 shutdown_connections 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.232+0000 7fcb56dd0640 1 -- 172.21.15.32:0/3944268962 wait complete. 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 Processor -- start 2024-02-17T00:37:22.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 -- start start 2024-02-17T00:37:22.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 0x7fcb50153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb500ce070 0x7fcb500b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b6860 0x7fcb500ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5006bd10 con 0x7fcb500b1480 2024-02-17T00:37:22.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb500b6e80 con 0x7fcb500ce070 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.234+0000 7fcb56dd0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5006bf80 con 0x7fcb500b6860 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 0x7fcb50153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 0x7fcb50153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40548/0 (socket says 172.21.15.32:40548) 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 -- 172.21.15.32:0/1741688037 learned_addr learned my addr 172.21.15.32:0/1741688037 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb4ffff640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb500ce070 0x7fcb500b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb5536d640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b6860 0x7fcb500ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 -- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b6860 msgr2=0x7fcb500ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b6860 0x7fcb500ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 -- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb500ce070 msgr2=0x7fcb500b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb500ce070 0x7fcb500b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 -- 172.21.15.32:0/1741688037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44009400 con 0x7fcb500b1480 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb54b6c640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 0x7fcb50153940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb440098c0 tx=0x7fcb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4403a630 con 0x7fcb500b1480 2024-02-17T00:37:22.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4403a7b0 con 0x7fcb500b1480 2024-02-17T00:37:22.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5006c260 con 0x7fcb500b1480 2024-02-17T00:37:22.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4403ab60 con 0x7fcb500b1480 2024-02-17T00:37:22.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.235+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb500b7160 con 0x7fcb500b1480 2024-02-17T00:37:22.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.236+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb500b6c40 con 0x7fcb500b1480 2024-02-17T00:37:22.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.237+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcb4403acc0 con 0x7fcb500b1480 2024-02-17T00:37:22.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.237+0000 7fcb4d7fa640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcb3406b810 0x7fcb3406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.237+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fcb440abfb0 con 0x7fcb500b1480 2024-02-17T00:37:22.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.238+0000 7fcb4ffff640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcb3406b810 0x7fcb3406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.238+0000 7fcb4ffff640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcb3406b810 0x7fcb3406dcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcb500c7a40 tx=0x7fcb3c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.242+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb440df8c0 con 0x7fcb500b1480 2024-02-17T00:37:22.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.420+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb50068f60 con 0x7fcb500b1480 2024-02-17T00:37:22.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.421+0000 7fcb4d7fa640 1 -- 172.21.15.32:0/1741688037 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb500b6c40 con 0x7fcb500b1480 2024-02-17T00:37:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:22.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcb3406b810 msgr2=0x7fcb3406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcb3406b810 0x7fcb3406dcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcb500c7a40 tx=0x7fcb3c009190 comp rx=0 tx=0).stop 2024-02-17T00:37:22.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 msgr2=0x7fcb50153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 0x7fcb50153940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb440098c0 tx=0x7fcb440046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 shutdown_connections 2024-02-17T00:37:22.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcb3406b810 0x7fcb3406dcd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcb500b6860 0x7fcb500ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb500ce070 0x7fcb500b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 --2- 172.21.15.32:0/1741688037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb500b1480 0x7fcb50153940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 >> 172.21.15.32:0/1741688037 conn(0x7fcb5008af80 msgr2=0x7fcb5008b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 shutdown_connections 2024-02-17T00:37:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.423+0000 7fcb56dd0640 1 -- 172.21.15.32:0/1741688037 wait complete. 2024-02-17T00:37:22.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:22.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.538+0000 7f6baef8a640 1 Processor -- start 2024-02-17T00:37:22.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.538+0000 7f6baef8a640 1 -- start start 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.538+0000 7f6baef8a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6ba80d0780 0x7f6ba80d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.538+0000 7f6baef8a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80d10a0 con 0x7f6ba80b9130 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.538+0000 7f6baef8a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80b7ef0 con 0x7f6ba80b9590 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.538+0000 7f6baef8a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba80b81d0 con 0x7f6ba80d0780 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6bacd26640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6ba80d0780 0x7f6ba80d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6ba7fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6ba80b9130 0x7f6ba80d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55780/0 (socket says 172.21.15.32:55780) 2024-02-17T00:37:22.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6ba7fff640 1 -- 172.21.15.32:0/573521333 learned_addr learned my addr 172.21.15.32:0/573521333 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:22.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6bacd26640 1 -- 172.21.15.32:0/573521333 >> v1:172.21.15.39:6789/0 conn(0x7f6ba80b9590 legacy=0x7f6ba80d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6bacd26640 1 -- 172.21.15.32:0/573521333 >> v1:172.21.15.32:6789/0 conn(0x7f6ba80b9130 legacy=0x7f6ba80d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6bacd26640 1 -- 172.21.15.32:0/573521333 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80b84b0 con 0x7f6ba80d0780 2024-02-17T00:37:22.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.539+0000 7f6ba77fe640 1 -- 172.21.15.32:0/573521333 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840247329 0 0) 0x7f6ba80d10a0 con 0x7f6ba80b9130 2024-02-17T00:37:22.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6bacd26640 1 --2- 172.21.15.32:0/573521333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba80d0b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0097a0 tx=0x7f6b9c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b61d22058f31cf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6ba77fe640 1 -- 172.21.15.32:0/573521333 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c030610 con 0x7f6ba80d0780 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6ba77fe640 1 -- 172.21.15.32:0/573521333 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c030770 con 0x7f6ba80d0780 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6ba77fe640 1 -- 172.21.15.32:0/573521333 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c030b00 con 0x7f6ba80d0780 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 -- 172.21.15.32:0/573521333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 msgr2=0x7f6ba80d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 --2- 172.21.15.32:0/573521333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba80d0b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0097a0 tx=0x7f6b9c02b960 comp rx=0 tx=0).stop 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 -- 172.21.15.32:0/573521333 shutdown_connections 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 --2- 172.21.15.32:0/573521333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba80d0b60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 -- 172.21.15.32:0/573521333 >> 172.21.15.32:0/573521333 conn(0x7f6ba80726b0 msgr2=0x7f6ba8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 -- 172.21.15.32:0/573521333 shutdown_connections 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.540+0000 7f6baef8a640 1 -- 172.21.15.32:0/573521333 wait complete. 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 Processor -- start 2024-02-17T00:37:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 -- start start 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba80b9130 0x7f6ba80ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6ba80b9590 0x7f6ba8149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba81f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80ccf60 con 0x7f6ba80d0780 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80d1c30 con 0x7f6ba80b9130 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.542+0000 7f6baef8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80cd170 con 0x7f6ba80b9590 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba81f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba81f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40568/0 (socket says 172.21.15.32:40568) 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 -- 172.21.15.32:0/2257298921 learned_addr learned my addr 172.21.15.32:0/2257298921 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:22.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bacd26640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba80b9130 0x7f6ba80ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6ba7fff640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6ba80b9590 0x7f6ba8149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 -- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6ba80b9590 msgr2=0x7f6ba8149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6ba80b9590 0x7f6ba8149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 -- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba80b9130 msgr2=0x7f6ba80ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba80b9130 0x7f6ba80ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 -- 172.21.15.32:0/2257298921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009400 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6ba7fff640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6ba80b9590 0x7f6ba8149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6bad527640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba81f6f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c730 tx=0x7f6ba000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0003b70 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0003cd0 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80cd450 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000aa90 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.543+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba80cda10 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.544+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80d1da0 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.545+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6ba000abf0 con 0x7f6ba80d0780 2024-02-17T00:37:22.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.545+0000 7f6ba57fa640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6b8c06b840 0x7f6b8c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.545+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f6ba008a200 con 0x7f6ba80d0780 2024-02-17T00:37:22.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.545+0000 7f6bacd26640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6b8c06b840 0x7f6b8c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.546+0000 7f6bacd26640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6b8c06b840 0x7f6b8c06dd00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c036000 tx=0x7f6b9c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.549+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ba80d1da0 con 0x7f6ba80d0780 2024-02-17T00:37:22.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.726+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ba80d1da0 con 0x7f6ba80d0780 2024-02-17T00:37:22.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.727+0000 7f6ba57fa640 1 -- 172.21.15.32:0/2257298921 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ba80d1da0 con 0x7f6ba80d0780 2024-02-17T00:37:22.730 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6b8c06b840 msgr2=0x7f6b8c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6b8c06b840 0x7f6b8c06dd00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c036000 tx=0x7f6b9c03b040 comp rx=0 tx=0).stop 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 msgr2=0x7f6ba81f6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba81f6f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c730 tx=0x7f6ba000cbf0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 shutdown_connections 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba80d0780 0x7f6ba81f6f50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6b8c06b840 0x7f6b8c06dd00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6ba80b9590 0x7f6ba8149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 --2- 172.21.15.32:0/2257298921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba80b9130 0x7f6ba80ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 >> 172.21.15.32:0/2257298921 conn(0x7f6ba80726b0 msgr2=0x7f6ba80b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 shutdown_connections 2024-02-17T00:37:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.729+0000 7f6baef8a640 1 -- 172.21.15.32:0/2257298921 wait complete. 2024-02-17T00:37:22.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.845+0000 7faa6a49d640 1 Processor -- start 2024-02-17T00:37:22.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.845+0000 7faa6a49d640 1 -- start start 2024-02-17T00:37:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.845+0000 7faa6a49d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 0x7faa64168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa6a49d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6409ae10 con 0x7faa640d0a00 2024-02-17T00:37:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa6a49d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa641615e0 con 0x7faa64161200 2024-02-17T00:37:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa6a49d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6406c9f0 con 0x7faa6409a9a0 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa637fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faa640d0a00 0x7faa6409a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55792/0 (socket says 172.21.15.32:55792) 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa637fe640 1 -- 172.21.15.32:0/877398394 learned_addr learned my addr 172.21.15.32:0/877398394 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007500855 0 0) 0x7faa6409ae10 con 0x7faa640d0a00 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c003520 con 0x7faa640d0a00 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa68a3a640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 0x7faa64168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486715955 0 0) 0x7faa4c003520 con 0x7faa640d0a00 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 msgr2=0x7faa64168b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 0x7faa64168b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 >> v1:172.21.15.39:6789/0 conn(0x7faa64161200 legacy=0x7faa640cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6406ccd0 con 0x7faa640d0a00 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7faa58001670 con 0x7faa640d0a00 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 >> v1:172.21.15.32:6789/0 conn(0x7faa640d0a00 legacy=0x7faa6409a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0039a0 0x7faa4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa4c0047c0 0x7faa4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 0x7faa4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6406c9f0 con 0x7faa4c0047c0 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00ba30 con 0x7faa4c0039a0 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00bbf0 con 0x7faa6409a9a0 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa637fe640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa4c0047c0 0x7faa4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.846+0000 7faa63fff640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0039a0 0x7faa4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa68a3a640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 0x7faa4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa637fe640 1 -- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 msgr2=0x7faa4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa637fe640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa6409a9a0 0x7faa4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa637fe640 1 -- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0039a0 msgr2=0x7faa4c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa637fe640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0039a0 0x7faa4c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa637fe640 1 -- 172.21.15.32:0/877398394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c003520 con 0x7faa4c0047c0 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.847+0000 7faa637fe640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa4c0047c0 0x7faa4c004c40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faa640d0e70 tx=0x7faa4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a9a59026c42dca server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58005ad0 con 0x7faa4c0047c0 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58005c30 con 0x7faa4c0047c0 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa62ffd640 1 -- 172.21.15.32:0/877398394 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5802c850 con 0x7faa4c0047c0 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa6a49d640 1 -- 172.21.15.32:0/877398394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa4c0047c0 msgr2=0x7faa4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa6a49d640 1 --2- 172.21.15.32:0/877398394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa4c0047c0 0x7faa4c004c40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faa640d0e70 tx=0x7faa4c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa68a3a640 1 -- 172.21.15.32:0/877398394 reap_dead start 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa6a49d640 1 -- 172.21.15.32:0/877398394 shutdown_connections 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa6a49d640 1 -- 172.21.15.32:0/877398394 >> 172.21.15.32:0/877398394 conn(0x7faa640b31a0 msgr2=0x7faa640b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa6a49d640 1 -- 172.21.15.32:0/877398394 shutdown_connections 2024-02-17T00:37:22.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.848+0000 7faa6a49d640 1 -- 172.21.15.32:0/877398394 wait complete. 2024-02-17T00:37:22.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.849+0000 7faa6a49d640 1 Processor -- start 2024-02-17T00:37:22.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.849+0000 7faa6a49d640 1 -- start start 2024-02-17T00:37:22.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa6a49d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0047c0 0x7faa640b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa6a49d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 0x7faa6415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa6a49d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa640c6780 0x7faa64154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa6a49d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640b7190 con 0x7faa641f6c90 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa6a49d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641f7230 con 0x7faa4c0047c0 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa6a49d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa641f7510 con 0x7faa640c6780 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa637fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 0x7faa6415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa637fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 0x7faa6415f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40586/0 (socket says 172.21.15.32:40586) 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa637fe640 1 -- 172.21.15.32:0/1986333783 learned_addr learned my addr 172.21.15.32:0/1986333783 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa63fff640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0047c0 0x7faa640b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.850+0000 7faa68a3a640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa640c6780 0x7faa64154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa637fe640 1 -- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa640c6780 msgr2=0x7faa64154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa637fe640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa640c6780 0x7faa64154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa637fe640 1 -- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0047c0 msgr2=0x7faa640b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa637fe640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0047c0 0x7faa640b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa637fe640 1 -- 172.21.15.32:0/1986333783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa641f77f0 con 0x7faa641f6c90 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa637fe640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 0x7faa6415f3d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa58001930 tx=0x7faa58001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58039070 con 0x7faa641f6c90 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5802cc60 con 0x7faa641f6c90 2024-02-17T00:37:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa641f7ad0 con 0x7faa641f6c90 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58007070 con 0x7faa641f6c90 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.851+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6415f910 con 0x7faa641f6c90 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.852+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6415fb00 con 0x7faa641f6c90 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.852+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7faa58032070 con 0x7faa641f6c90 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.853+0000 7faa60ff9640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7faa5006b810 0x7faa5006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.853+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7faa5803c040 con 0x7faa641f6c90 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.853+0000 7faa63fff640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7faa5006b810 0x7faa5006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:22.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.853+0000 7faa63fff640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7faa5006b810 0x7faa5006dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa641f1290 tx=0x7faa54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:22.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:22.857+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa58075ed0 con 0x7faa641f6c90 2024-02-17T00:37:23.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.037+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa640680c0 con 0x7faa641f6c90 2024-02-17T00:37:23.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.037+0000 7faa60ff9640 1 -- 172.21.15.32:0/1986333783 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa58079590 con 0x7faa641f6c90 2024-02-17T00:37:23.040 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:23.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7faa5006b810 msgr2=0x7faa5006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7faa5006b810 0x7faa5006dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa641f1290 tx=0x7faa54009040 comp rx=0 tx=0).stop 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 msgr2=0x7faa6415f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 0x7faa6415f3d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa58001930 tx=0x7faa58001a00 comp rx=0 tx=0).stop 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 shutdown_connections 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7faa5006b810 0x7faa5006dcd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7faa640c6780 0x7faa64154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa641f6c90 0x7faa6415f3d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 --2- 172.21.15.32:0/1986333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa4c0047c0 0x7faa640b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 >> 172.21.15.32:0/1986333783 conn(0x7faa640b31a0 msgr2=0x7faa6415cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 shutdown_connections 2024-02-17T00:37:23.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.039+0000 7faa6a49d640 1 -- 172.21.15.32:0/1986333783 wait complete. 2024-02-17T00:37:23.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:23.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.154+0000 7f80fdd9a640 1 Processor -- start 2024-02-17T00:37:23.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.154+0000 7f80fdd9a640 1 -- start start 2024-02-17T00:37:23.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80fdd9a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80f815eed0 0x7f80f80b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80fdd9a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f80b0810 0x7f80f80cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80fdd9a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f80b0d60 con 0x7f80f809a6e0 2024-02-17T00:37:23.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80fdd9a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f80cf320 con 0x7f80f815eed0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80fdd9a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80cf600 con 0x7f80f80b0810 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80f815eed0 0x7f80f80b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80f815eed0 0x7f80f80b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40588/0 (socket says 172.21.15.32:40588) 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 -- 172.21.15.32:0/2740572812 learned_addr learned my addr 172.21.15.32:0/2740572812 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f6ffd640 1 --2- 172.21.15.32:0/2740572812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f80b0810 0x7f80f80cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 -- 172.21.15.32:0/2740572812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f80b0810 msgr2=0x7f80f80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 --2- 172.21.15.32:0/2740572812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f80b0810 0x7f80f80cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 -- 172.21.15.32:0/2740572812 >> v1:172.21.15.39:6789/0 conn(0x7f80f809a6e0 legacy=0x7f80f80cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.155+0000 7f80f77fe640 1 -- 172.21.15.32:0/2740572812 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80cc360 con 0x7f80f815eed0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.156+0000 7f80f77fe640 1 --2- 172.21.15.32:0/2740572812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f815eed0 0x7f80f80b1010 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009870 tx=0x7f80e802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d7f1d5112ca119 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.156+0000 7f80f67fc640 1 -- 172.21.15.32:0/2740572812 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80317c0 con 0x7f80f815eed0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.156+0000 7f80f67fc640 1 -- 172.21.15.32:0/2740572812 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8031920 con 0x7f80f815eed0 2024-02-17T00:37:23.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.156+0000 7f80f67fc640 1 -- 172.21.15.32:0/2740572812 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8031cb0 con 0x7f80f815eed0 2024-02-17T00:37:23.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2740572812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f815eed0 msgr2=0x7f80f80b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2740572812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f815eed0 0x7f80f80b1010 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009870 tx=0x7f80e802b860 comp rx=0 tx=0).stop 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2740572812 shutdown_connections 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2740572812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f80b0810 0x7f80f80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2740572812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f815eed0 0x7f80f80b1010 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2740572812 >> 172.21.15.32:0/2740572812 conn(0x7f80f80b31a0 msgr2=0x7f80f80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2740572812 shutdown_connections 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.157+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2740572812 wait complete. 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.158+0000 7f80fdd9a640 1 Processor -- start 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.158+0000 7f80fdd9a640 1 -- start start 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80fdd9a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f809a6e0 0x7f80f8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80fdd9a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 0x7f80f80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80fdd9a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f815eed0 0x7f80f80ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80fdd9a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81f3a50 con 0x7f80f80b0810 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80fdd9a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80caaf0 con 0x7f80f809a6e0 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80fdd9a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806d6d0 con 0x7f80f815eed0 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80f6ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 0x7f80f80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80f6ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 0x7f80f80ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40592/0 (socket says 172.21.15.32:40592) 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80f6ffd640 1 -- 172.21.15.32:0/2263780639 learned_addr learned my addr 172.21.15.32:0/2263780639 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80f77fe640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f809a6e0 0x7f80f8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.159+0000 7f80f7fff640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f815eed0 0x7f80f80ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80f6ffd640 1 -- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f815eed0 msgr2=0x7f80f80ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80f6ffd640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f815eed0 0x7f80f80ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80f6ffd640 1 -- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f809a6e0 msgr2=0x7f80f8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80f6ffd640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f809a6e0 0x7f80f8155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80f6ffd640 1 -- 172.21.15.32:0/2263780639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80094d0 con 0x7f80f80b0810 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80f6ffd640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 0x7f80f80ca070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00d800 tx=0x7f80ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00b6c0 con 0x7f80f80b0810 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec00b840 con 0x7f80f80b0810 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80b4370 con 0x7f80f80b0810 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00bbf0 con 0x7f80f80b0810 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.160+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f80b4c10 con 0x7f80f80b0810 2024-02-17T00:37:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.161+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f80680c0 con 0x7f80f80b0810 2024-02-17T00:37:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.161+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f80ec00bd50 con 0x7f80f80b0810 2024-02-17T00:37:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.162+0000 7f80dffff640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f80e406b810 0x7f80e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.162+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f80ec08aa60 con 0x7f80f80b0810 2024-02-17T00:37:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.162+0000 7f80f77fe640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f80e406b810 0x7f80e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.162+0000 7f80f77fe640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f80e406b810 0x7f80e406dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80e8036000 tx=0x7f80e803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.166+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80ec055130 con 0x7f80f80b0810 2024-02-17T00:37:23.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.343+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f80f8068f60 con 0x7f80f80b0810 2024-02-17T00:37:23.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.344+0000 7f80dffff640 1 -- 172.21.15.32:0/2263780639 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f80ec0587f0 con 0x7f80f80b0810 2024-02-17T00:37:23.347 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.345+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f80e406b810 msgr2=0x7f80e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.345+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f80e406b810 0x7f80e406dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80e8036000 tx=0x7f80e803d040 comp rx=0 tx=0).stop 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 msgr2=0x7f80f80ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 0x7f80f80ca070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00d800 tx=0x7f80ec00dcc0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 shutdown_connections 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f80e406b810 0x7f80e406dcd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80f815eed0 0x7f80f80ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f80b0810 0x7f80f80ca070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 --2- 172.21.15.32:0/2263780639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f809a6e0 0x7f80f8155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 >> 172.21.15.32:0/2263780639 conn(0x7f80f80b31a0 msgr2=0x7f80f806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 shutdown_connections 2024-02-17T00:37:23.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.346+0000 7f80fdd9a640 1 -- 172.21.15.32:0/2263780639 wait complete. 2024-02-17T00:37:23.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.458+0000 7fa937dd0640 1 Processor -- start 2024-02-17T00:37:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.458+0000 7fa937dd0640 1 -- start start 2024-02-17T00:37:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa937dd0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300cd740 0x7fa9300d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa937dd0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa93006cd90 0x7fa9300cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa937dd0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9300cdb20 con 0x7fa9300d08d0 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa937dd0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9300d0d30 con 0x7fa93006cd90 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa937dd0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa930099b90 con 0x7fa9300cd740 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa93636d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa93006cd90 0x7fa9300cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa93636d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa93006cd90 0x7fa9300cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40598/0 (socket says 172.21.15.32:40598) 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.459+0000 7fa93636d640 1 -- 172.21.15.32:0/4131214210 learned_addr learned my addr 172.21.15.32:0/4131214210 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.460+0000 7fa935b6c640 1 --2- 172.21.15.32:0/4131214210 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300cd740 0x7fa9300d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.460+0000 7fa93636d640 1 -- 172.21.15.32:0/4131214210 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300cd740 msgr2=0x7fa9300d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.460+0000 7fa93636d640 1 --2- 172.21.15.32:0/4131214210 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300cd740 0x7fa9300d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.460+0000 7fa93636d640 1 -- 172.21.15.32:0/4131214210 >> v1:172.21.15.39:6789/0 conn(0x7fa9300d08d0 legacy=0x7fa93006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.460+0000 7fa93636d640 1 -- 172.21.15.32:0/4131214210 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930099e70 con 0x7fa93006cd90 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.460+0000 7fa93636d640 1 --2- 172.21.15.32:0/4131214210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa9300cbc90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e50 tx=0x7fa92002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95313e86d33d8c9a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa934b6a640 1 -- 172.21.15.32:0/4131214210 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92002cb00 con 0x7fa93006cd90 2024-02-17T00:37:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa934b6a640 1 -- 172.21.15.32:0/4131214210 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92002cc60 con 0x7fa93006cd90 2024-02-17T00:37:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa934b6a640 1 -- 172.21.15.32:0/4131214210 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200343f0 con 0x7fa93006cd90 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 -- 172.21.15.32:0/4131214210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 msgr2=0x7fa9300cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 --2- 172.21.15.32:0/4131214210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa9300cbc90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e50 tx=0x7fa92002bf60 comp rx=0 tx=0).stop 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 -- 172.21.15.32:0/4131214210 shutdown_connections 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 --2- 172.21.15.32:0/4131214210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa9300cbc90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 --2- 172.21.15.32:0/4131214210 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300cd740 0x7fa9300d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 -- 172.21.15.32:0/4131214210 >> 172.21.15.32:0/4131214210 conn(0x7fa9300b3130 msgr2=0x7fa9300b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 -- 172.21.15.32:0/4131214210 shutdown_connections 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.461+0000 7fa937dd0640 1 -- 172.21.15.32:0/4131214210 wait complete. 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.462+0000 7fa937dd0640 1 Processor -- start 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.462+0000 7fa937dd0640 1 -- start start 2024-02-17T00:37:23.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa937dd0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa93009efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa937dd0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9300cd740 0x7fa93015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa937dd0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300d08d0 0x7fa9300cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa937dd0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300ae7c0 con 0x7fa93006cd90 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa937dd0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300af620 con 0x7fa9300cd740 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa937dd0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300aea10 con 0x7fa9300d08d0 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa935b6c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa93009efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa935b6c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa93009efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49244/0 (socket says 172.21.15.32:49244) 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa935b6c640 1 -- 172.21.15.32:0/389399712 learned_addr learned my addr 172.21.15.32:0/389399712 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa93536b640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9300cd740 0x7fa93015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa93636d640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300d08d0 0x7fa9300cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa935b6c640 1 -- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300d08d0 msgr2=0x7fa9300cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.463+0000 7fa935b6c640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300d08d0 0x7fa9300cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa935b6c640 1 -- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9300cd740 msgr2=0x7fa93015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa935b6c640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9300cd740 0x7fa93015d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa935b6c640 1 -- 172.21.15.32:0/389399712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009b30 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa935b6c640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa93009efa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa92800d830 tx=0x7fa92800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92800b6c0 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92800b840 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9300aecf0 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92800bbf0 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.464+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9300af2b0 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.465+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9300b2f30 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.465+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa92801e460 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.466+0000 7fa92e7fc640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa91c06b810 0x7fa91c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.466+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fa92808ad30 con 0x7fa93006cd90 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.466+0000 7fa93536b640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa91c06b810 0x7fa91c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.466+0000 7fa93536b640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa91c06b810 0x7fa91c06dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa930070640 tx=0x7fa924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.470+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9280553e0 con 0x7fa93006cd90 2024-02-17T00:37:23.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.652+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9300b4040 con 0x7fa93006cd90 2024-02-17T00:37:23.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.653+0000 7fa92e7fc640 1 -- 172.21.15.32:0/389399712 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7fa928058aa0 con 0x7fa93006cd90 2024-02-17T00:37:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:23.656 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa91c06b810 msgr2=0x7fa91c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa91c06b810 0x7fa91c06dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa930070640 tx=0x7fa924009040 comp rx=0 tx=0).stop 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 msgr2=0x7fa93009efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa93009efa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa92800d830 tx=0x7fa92800dcf0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 shutdown_connections 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa91c06b810 0x7fa91c06dcd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa9300d08d0 0x7fa9300cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9300cd740 0x7fa93015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 --2- 172.21.15.32:0/389399712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa93006cd90 0x7fa93009efa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 >> 172.21.15.32:0/389399712 conn(0x7fa9300b3130 msgr2=0x7fa930070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 shutdown_connections 2024-02-17T00:37:23.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.655+0000 7fa937dd0640 1 -- 172.21.15.32:0/389399712 wait complete. 2024-02-17T00:37:23.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:23.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:23.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.773+0000 7f657dd8a640 1 Processor -- start 2024-02-17T00:37:23.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.773+0000 7f657dd8a640 1 -- start start 2024-02-17T00:37:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f657dd8a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65780cfc40 0x7f65780d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f657dd8a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65780b1480 0x7f65780b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f657dd8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f657dd8a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780b25e0 con 0x7f65780cfc40 2024-02-17T00:37:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f657dd8a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657815bec0 con 0x7f65780b1480 2024-02-17T00:37:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f657dd8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780d0560 con 0x7f65780ce070 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f65777fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65780cfc40 0x7f65780d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f65777fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65780cfc40 0x7f65780d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49254/0 (socket says 172.21.15.32:49254) 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f65777fe640 1 -- 172.21.15.32:0/206683024 learned_addr learned my addr 172.21.15.32:0/206683024 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f6576ffd640 1 --2- 172.21.15.32:0/206683024 >> v2:172.21.15.39:3300/0 conn(0x7f65780b1480 0x7f65780b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.774+0000 7f6577fff640 1 --2- 172.21.15.32:0/206683024 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.775+0000 7f65777fe640 1 -- 172.21.15.32:0/206683024 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 msgr2=0x7f65780ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.775+0000 7f65777fe640 1 --2- 172.21.15.32:0/206683024 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.775+0000 7f65777fe640 1 -- 172.21.15.32:0/206683024 >> v2:172.21.15.39:3300/0 conn(0x7f65780b1480 msgr2=0x7f65780b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.775+0000 7f65777fe640 1 --2- 172.21.15.32:0/206683024 >> v2:172.21.15.39:3300/0 conn(0x7f65780b1480 0x7f65780b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.775+0000 7f65777fe640 1 -- 172.21.15.32:0/206683024 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780b19d0 con 0x7f65780cfc40 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.775+0000 7f65777fe640 1 --2- 172.21.15.32:0/206683024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780cfc40 0x7f65780d0020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6578067390 tx=0x7f656802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbefad9d39584f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f65767fc640 1 -- 172.21.15.32:0/206683024 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568031870 con 0x7f65780cfc40 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f65767fc640 1 -- 172.21.15.32:0/206683024 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680319d0 con 0x7f65780cfc40 2024-02-17T00:37:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f65767fc640 1 -- 172.21.15.32:0/206683024 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568031d60 con 0x7f65780cfc40 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 -- 172.21.15.32:0/206683024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780cfc40 msgr2=0x7f65780d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 --2- 172.21.15.32:0/206683024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780cfc40 0x7f65780d0020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6578067390 tx=0x7f656802b910 comp rx=0 tx=0).stop 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 -- 172.21.15.32:0/206683024 shutdown_connections 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 --2- 172.21.15.32:0/206683024 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 --2- 172.21.15.32:0/206683024 >> v2:172.21.15.39:3300/0 conn(0x7f65780b1480 0x7f65780b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 --2- 172.21.15.32:0/206683024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780cfc40 0x7f65780d0020 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 -- 172.21.15.32:0/206683024 >> 172.21.15.32:0/206683024 conn(0x7f657808af80 msgr2=0x7f657808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 -- 172.21.15.32:0/206683024 shutdown_connections 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.776+0000 7f657dd8a640 1 -- 172.21.15.32:0/206683024 wait complete. 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.777+0000 7f657dd8a640 1 Processor -- start 2024-02-17T00:37:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 -- start start 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 0x7f6578157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65780cfc40 0x7f65780ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780cdc40 con 0x7f65780b1480 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780c9dc0 con 0x7f65780cfc40 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f657dd8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780ca0a0 con 0x7f65780ce070 2024-02-17T00:37:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f65777fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 0x7f6578157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f65777fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 0x7f6578157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49266/0 (socket says 172.21.15.32:49266) 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f65777fe640 1 -- 172.21.15.32:0/399772257 learned_addr learned my addr 172.21.15.32:0/399772257 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f6577fff640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65780cfc40 0x7f65780ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.778+0000 7f6576ffd640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f65777fe640 1 -- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 msgr2=0x7f65780cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f65777fe640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f65777fe640 1 -- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65780cfc40 msgr2=0x7f65780ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f65777fe640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65780cfc40 0x7f65780ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f65777fe640 1 -- 172.21.15.32:0/399772257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680094d0 con 0x7f65780b1480 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f6577fff640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65780cfc40 0x7f65780ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f6576ffd640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f65777fe640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 0x7f6578157d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f656802b950 tx=0x7f65680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656803ac60 con 0x7f65780b1480 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656803adc0 con 0x7f65780b1480 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657806bdf0 con 0x7f65780b1480 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568044630 con 0x7f65780b1480 2024-02-17T00:37:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.779+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65781582a0 con 0x7f65780b1480 2024-02-17T00:37:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.780+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657806c310 con 0x7f65780b1480 2024-02-17T00:37:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.780+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f656804d450 con 0x7f65780b1480 2024-02-17T00:37:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.781+0000 7f655ffff640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f656406b810 0x7f656406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.781+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f656802d040 con 0x7f65780b1480 2024-02-17T00:37:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.781+0000 7f6576ffd640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f656406b810 0x7f656406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.782+0000 7f6576ffd640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f656406b810 0x7f656406dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f657806f7b0 tx=0x7f656c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:23.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.785+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6568077190 con 0x7f65780b1480 2024-02-17T00:37:23.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.965+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6578068f60 con 0x7f65780b1480 2024-02-17T00:37:23.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.965+0000 7f655ffff640 1 -- 172.21.15.32:0/399772257 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65680350a0 con 0x7f65780b1480 2024-02-17T00:37:23.968 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:23.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f656406b810 msgr2=0x7f656406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f656406b810 0x7f656406dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f657806f7b0 tx=0x7f656c008040 comp rx=0 tx=0).stop 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 msgr2=0x7f6578157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 0x7f6578157d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f656802b950 tx=0x7f65680046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 shutdown_connections 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65780cfc40 0x7f65780ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f656406b810 0x7f656406dcd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65780ce070 0x7f65780cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 --2- 172.21.15.32:0/399772257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65780b1480 0x7f6578157d60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 >> 172.21.15.32:0/399772257 conn(0x7f657808af80 msgr2=0x7f65780ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 shutdown_connections 2024-02-17T00:37:23.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:23.967+0000 7f657dd8a640 1 -- 172.21.15.32:0/399772257 wait complete. 2024-02-17T00:37:23.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:24.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.082+0000 7f724795e640 1 Processor -- start 2024-02-17T00:37:24.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.082+0000 7f724795e640 1 -- start start 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f724795e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f72400d0780 0x7f72400d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f724795e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9590 0x7f72400b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f724795e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72400d10a0 con 0x7f72400b9130 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f724795e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400b7ef0 con 0x7f72400d0780 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f724795e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400b81d0 con 0x7f72400b9590 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f72456fa640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f72400d0780 0x7f72400d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f7244ef9640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f72400b9130 0x7f72400d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35444/0 (socket says 172.21.15.32:35444) 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f7244ef9640 1 -- 172.21.15.32:0/460203968 learned_addr learned my addr 172.21.15.32:0/460203968 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.083+0000 7f7245efb640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9590 0x7f72400b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f72456fa640 1 -- 172.21.15.32:0/460203968 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9590 msgr2=0x7f72400b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f72456fa640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9590 0x7f72400b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f72456fa640 1 -- 172.21.15.32:0/460203968 >> v1:172.21.15.32:6789/0 conn(0x7f72400b9130 legacy=0x7f72400d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f72456fa640 1 -- 172.21.15.32:0/460203968 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400b84b0 con 0x7f72400d0780 2024-02-17T00:37:24.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f7245efb640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9590 0x7f72400b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f72456fa640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400d0780 0x7f72400d0b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7230009d90 tx=0x7f723002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7014b328fde220 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f723ffff640 1 -- 172.21.15.32:0/460203968 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723002cc50 con 0x7f72400d0780 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f723ffff640 1 -- 172.21.15.32:0/460203968 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723002cdb0 con 0x7f72400d0780 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.084+0000 7f723ffff640 1 -- 172.21.15.32:0/460203968 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230034660 con 0x7f72400d0780 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 -- 172.21.15.32:0/460203968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400d0780 msgr2=0x7f72400d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400d0780 0x7f72400d0b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7230009d90 tx=0x7f723002bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 -- 172.21.15.32:0/460203968 shutdown_connections 2024-02-17T00:37:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9590 0x7f72400b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 --2- 172.21.15.32:0/460203968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400d0780 0x7f72400d0b60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 -- 172.21.15.32:0/460203968 >> 172.21.15.32:0/460203968 conn(0x7f72400726b0 msgr2=0x7f7240072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 -- 172.21.15.32:0/460203968 shutdown_connections 2024-02-17T00:37:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.085+0000 7f724795e640 1 -- 172.21.15.32:0/460203968 wait complete. 2024-02-17T00:37:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.086+0000 7f724795e640 1 Processor -- start 2024-02-17T00:37:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.086+0000 7f724795e640 1 -- start start 2024-02-17T00:37:24.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f724795e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9130 0x7f7240155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f724795e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 0x7f72400c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f724795e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72400d0780 0x7f72400cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f724795e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400d1b30 con 0x7f72400b9590 2024-02-17T00:37:24.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f724795e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400d1d40 con 0x7f72400d0780 2024-02-17T00:37:24.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f724795e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400d2020 con 0x7f72400b9130 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 0x7f72400c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 0x7f72400c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49294/0 (socket says 172.21.15.32:49294) 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 -- 172.21.15.32:0/3732425696 learned_addr learned my addr 172.21.15.32:0/3732425696 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f72456fa640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9130 0x7f7240155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7245efb640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72400d0780 0x7f72400cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 -- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9130 msgr2=0x7f7240155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9130 0x7f7240155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 -- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72400d0780 msgr2=0x7f72400cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72400d0780 0x7f72400cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.087+0000 7f7244ef9640 1 -- 172.21.15.32:0/3732425696 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230009a70 con 0x7f72400b9590 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.088+0000 7f7244ef9640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 0x7f72400c82d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f723400c400 tx=0x7f723400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.088+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234005ce0 con 0x7f72400b9590 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.088+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7234005e40 con 0x7f72400b9590 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.088+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72400d2300 con 0x7f72400b9590 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.088+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340072d0 con 0x7f72400b9590 2024-02-17T00:37:24.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.088+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7240156060 con 0x7f72400b9590 2024-02-17T00:37:24.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.089+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72400d2820 con 0x7f72400b9590 2024-02-17T00:37:24.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.089+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f72340074f0 con 0x7f72400b9590 2024-02-17T00:37:24.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.090+0000 7f723dffb640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f722c06b810 0x7f722c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.090+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f7234089ab0 con 0x7f72400b9590 2024-02-17T00:37:24.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.090+0000 7f72456fa640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f722c06b810 0x7f722c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.091+0000 7f72456fa640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f722c06b810 0x7f722c06dcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7230036000 tx=0x7f7230030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.094+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72400d2820 con 0x7f72400b9590 2024-02-17T00:37:24.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.279+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72400d2820 con 0x7f72400b9590 2024-02-17T00:37:24.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.279+0000 7f723dffb640 1 -- 172.21.15.32:0/3732425696 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7234017020 con 0x7f72400b9590 2024-02-17T00:37:24.284 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f722c06b810 msgr2=0x7f722c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f722c06b810 0x7f722c06dcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7230036000 tx=0x7f7230030000 comp rx=0 tx=0).stop 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 msgr2=0x7f72400c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 0x7f72400c82d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f723400c400 tx=0x7f723400c8c0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 shutdown_connections 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72400d0780 0x7f72400cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72400b9590 0x7f72400c82d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f722c06b810 0x7f722c06dcd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 --2- 172.21.15.32:0/3732425696 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f72400b9130 0x7f7240155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 >> 172.21.15.32:0/3732425696 conn(0x7f72400726b0 msgr2=0x7f724015e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 shutdown_connections 2024-02-17T00:37:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.281+0000 7f724795e640 1 -- 172.21.15.32:0/3732425696 wait complete. 2024-02-17T00:37:24.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:24.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.396+0000 7f73c40d4640 1 Processor -- start 2024-02-17T00:37:24.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.396+0000 7f73c40d4640 1 -- start start 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c40d4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f73bc161200 0x7f73bc0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c40d4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73bc0d0a00 0x7f73bc09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c40d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc161830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c40d4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73bc1615e0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c40d4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73bc06c9f0 con 0x7f73bc161200 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c40d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc06ccd0 con 0x7f73bc09a7d0 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73bc0d0a00 0x7f73bc09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73bc0d0a00 0x7f73bc09a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49310/0 (socket says 172.21.15.32:49310) 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 -- 172.21.15.32:0/102436867 learned_addr learned my addr 172.21.15.32:0/102436867 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c1e70640 1 --2- 172.21.15.32:0/102436867 >> v2:172.21.15.39:3300/0 conn(0x7f73bc161200 0x7f73bc0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c2671640 1 --2- 172.21.15.32:0/102436867 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 -- 172.21.15.32:0/102436867 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 msgr2=0x7f73bc161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:24.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 --2- 172.21.15.32:0/102436867 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 -- 172.21.15.32:0/102436867 >> v2:172.21.15.39:3300/0 conn(0x7f73bc161200 msgr2=0x7f73bc0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:24.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 --2- 172.21.15.32:0/102436867 >> v2:172.21.15.39:3300/0 conn(0x7f73bc161200 0x7f73bc0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c166f640 1 -- 172.21.15.32:0/102436867 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc099a90 con 0x7f73bc0d0a00 2024-02-17T00:37:24.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.397+0000 7f73c1e70640 1 --2- 172.21.15.32:0/102436867 >> v2:172.21.15.39:3300/0 conn(0x7f73bc161200 0x7f73bc0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:24.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.398+0000 7f73c166f640 1 --2- 172.21.15.32:0/102436867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc09a290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f73bc072ba0 tx=0x7f73b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4244e7fe6d61f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.398+0000 7f73c0e6e640 1 -- 172.21.15.32:0/102436867 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0031870 con 0x7f73bc0d0a00 2024-02-17T00:37:24.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.398+0000 7f73c0e6e640 1 -- 172.21.15.32:0/102436867 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00319d0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.398+0000 7f73c0e6e640 1 -- 172.21.15.32:0/102436867 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0031d60 con 0x7f73bc0d0a00 2024-02-17T00:37:24.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 -- 172.21.15.32:0/102436867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 msgr2=0x7f73bc09a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 --2- 172.21.15.32:0/102436867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc09a290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f73bc072ba0 tx=0x7f73b002b910 comp rx=0 tx=0).stop 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 -- 172.21.15.32:0/102436867 shutdown_connections 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 --2- 172.21.15.32:0/102436867 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 --2- 172.21.15.32:0/102436867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc09a290 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 --2- 172.21.15.32:0/102436867 >> v2:172.21.15.39:3300/0 conn(0x7f73bc161200 0x7f73bc0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 -- 172.21.15.32:0/102436867 >> 172.21.15.32:0/102436867 conn(0x7f73bc0b31a0 msgr2=0x7f73bc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 -- 172.21.15.32:0/102436867 shutdown_connections 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.399+0000 7f73c40d4640 1 -- 172.21.15.32:0/102436867 wait complete. 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.400+0000 7f73c40d4640 1 Processor -- start 2024-02-17T00:37:24.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.400+0000 7f73c40d4640 1 -- start start 2024-02-17T00:37:24.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c40d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc1f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c40d4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc0b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c40d4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc161200 0x7f73bc0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c40d4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc1f3b70 con 0x7f73bc0d0a00 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c40d4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0b70c0 con 0x7f73bc161200 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c40d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0b73a0 con 0x7f73bc09a7d0 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc0b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc0b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49324/0 (socket says 172.21.15.32:49324) 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 -- 172.21.15.32:0/677982621 learned_addr learned my addr 172.21.15.32:0/677982621 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c1e70640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc1f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c2671640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc161200 0x7f73bc0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 -- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 msgr2=0x7f73bc1f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc1f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 -- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc161200 msgr2=0x7f73bc0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc161200 0x7f73bc0b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 -- 172.21.15.32:0/677982621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00094d0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.401+0000 7f73c166f640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc0b6570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73b002b950 tx=0x7f73b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.402+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b003ad30 con 0x7f73bc0d0a00 2024-02-17T00:37:24.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.402+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00443f0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.402+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc1f3e30 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.402+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00447a0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.402+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc1581f0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.403+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc0680c0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.403+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f73b004d450 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.404+0000 7f73ba7fc640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.404+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f73b002d040 con 0x7f73bc0d0a00 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.404+0000 7f73c1e70640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.404+0000 7f73c1e70640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006fd0 tx=0x7f73b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.408+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73b0077120 con 0x7f73bc0d0a00 2024-02-17T00:37:24.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.586+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73bc1f4350 con 0x7f73bc0d0a00 2024-02-17T00:37:24.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.586+0000 7f73ba7fc640 1 -- 172.21.15.32:0/677982621 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73b007a7e0 con 0x7f73bc0d0a00 2024-02-17T00:37:24.590 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 msgr2=0x7f73a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006fd0 tx=0x7f73b4008040 comp rx=0 tx=0).stop 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 msgr2=0x7f73bc0b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc0b6570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73b002b950 tx=0x7f73b00046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 shutdown_connections 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73bc161200 0x7f73bc0b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73bc0d0a00 0x7f73bc0b6570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f73a806b810 0x7f73a806dcd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 --2- 172.21.15.32:0/677982621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f73bc09a7d0 0x7f73bc1f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 >> 172.21.15.32:0/677982621 conn(0x7f73bc0b31a0 msgr2=0x7f73bc06f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:24.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 shutdown_connections 2024-02-17T00:37:24.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.588+0000 7f73c40d4640 1 -- 172.21.15.32:0/677982621 wait complete. 2024-02-17T00:37:24.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:24.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.703+0000 7f049be9d640 1 Processor -- start 2024-02-17T00:37:24.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.703+0000 7f049be9d640 1 -- start start 2024-02-17T00:37:24.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049be9d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04940d0780 0x7f04940d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049be9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940b9130 0x7f04940d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049be9d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940d10a0 con 0x7f04940b9590 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049be9d640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04940b7ef0 con 0x7f04940d0780 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049be9d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940b81d0 con 0x7f04940b9130 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499c39640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04940d0780 0x7f04940d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049a43a640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f04940b9590 0x7f04940d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35446/0 (socket says 172.21.15.32:35446) 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499c39640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04940d0780 0x7f04940d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49338/0 (socket says 172.21.15.32:49338) 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f049a43a640 1 -- 172.21.15.32:0/3555659610 learned_addr learned my addr 172.21.15.32:0/3555659610 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499438640 1 --2- 172.21.15.32:0/3555659610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940b9130 0x7f04940d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499c39640 1 -- 172.21.15.32:0/3555659610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940b9130 msgr2=0x7f04940d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499c39640 1 --2- 172.21.15.32:0/3555659610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940b9130 0x7f04940d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499c39640 1 -- 172.21.15.32:0/3555659610 >> v1:172.21.15.32:6789/0 conn(0x7f04940b9590 legacy=0x7f04940d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0498c37640 1 -- 172.21.15.32:0/3555659610 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863330319 0 0) 0x7f04940d10a0 con 0x7f04940b9590 2024-02-17T00:37:24.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.704+0000 7f0499c39640 1 -- 172.21.15.32:0/3555659610 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04940b84b0 con 0x7f04940d0780 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.705+0000 7f0499c39640 1 --2- 172.21.15.32:0/3555659610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940d0780 0x7f04940d0b60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097a0 tx=0x7f048c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17f7d4cebfc170d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.705+0000 7f0498c37640 1 -- 172.21.15.32:0/3555659610 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c031830 con 0x7f04940d0780 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.705+0000 7f0498c37640 1 -- 172.21.15.32:0/3555659610 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c031990 con 0x7f04940d0780 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.705+0000 7f0498c37640 1 -- 172.21.15.32:0/3555659610 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c031d20 con 0x7f04940d0780 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 -- 172.21.15.32:0/3555659610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940d0780 msgr2=0x7f04940d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 --2- 172.21.15.32:0/3555659610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940d0780 0x7f04940d0b60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097a0 tx=0x7f048c02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 -- 172.21.15.32:0/3555659610 shutdown_connections 2024-02-17T00:37:24.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 --2- 172.21.15.32:0/3555659610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940b9130 0x7f04940d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 --2- 172.21.15.32:0/3555659610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940d0780 0x7f04940d0b60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 -- 172.21.15.32:0/3555659610 >> 172.21.15.32:0/3555659610 conn(0x7f04940726b0 msgr2=0x7f0494072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:24.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 -- 172.21.15.32:0/3555659610 shutdown_connections 2024-02-17T00:37:24.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.706+0000 7f049be9d640 1 -- 172.21.15.32:0/3555659610 wait complete. 2024-02-17T00:37:24.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.707+0000 7f049be9d640 1 Processor -- start 2024-02-17T00:37:24.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.707+0000 7f049be9d640 1 -- start start 2024-02-17T00:37:24.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 0x7f049415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04940b9590 0x7f049415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940d0780 0x7f04940ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049415a660 con 0x7f04940b9130 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049415b030 con 0x7f04940b9590 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0494159d30 con 0x7f04940d0780 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 0x7f049415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 0x7f049415aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49354/0 (socket says 172.21.15.32:49354) 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 -- 172.21.15.32:0/3690892065 learned_addr learned my addr 172.21.15.32:0/3690892065 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 -- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940d0780 msgr2=0x7f04940ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940d0780 0x7f04940ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 -- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04940b9590 msgr2=0x7f049415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04940b9590 0x7f049415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 -- 172.21.15.32:0/3690892065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c009400 con 0x7f04940b9130 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f0499c39640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 0x7f049415aaf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f048c000c00 tx=0x7f048c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c03aa60 con 0x7f04940b9130 2024-02-17T00:37:24.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c03abc0 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049415a010 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c0443f0 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.708+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940ca0d0 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.709+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04940685d0 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.710+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f048c04d450 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.710+0000 7f04927fc640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f048006b840 0x7f048006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.710+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f048c0ac720 con 0x7f04940b9130 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.710+0000 7f0499438640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f048006b840 0x7f048006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.711+0000 7f0499438640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f048006b840 0x7f048006dd00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0488006fd0 tx=0x7f0488008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:24.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.714+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f048c076e80 con 0x7f04940b9130 2024-02-17T00:37:24.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.892+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0494068f60 con 0x7f04940b9130 2024-02-17T00:37:24.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.893+0000 7f04927fc640 1 -- 172.21.15.32:0/3690892065 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f048c07a540 con 0x7f04940b9130 2024-02-17T00:37:24.896 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f048006b840 msgr2=0x7f048006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f048006b840 0x7f048006dd00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0488006fd0 tx=0x7f0488008040 comp rx=0 tx=0).stop 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 msgr2=0x7f049415aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 0x7f049415aaf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f048c000c00 tx=0x7f048c0046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 shutdown_connections 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f048006b840 0x7f048006dd00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f04940d0780 0x7f04940ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04940b9590 0x7f049415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 --2- 172.21.15.32:0/3690892065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04940b9130 0x7f049415aaf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 >> 172.21.15.32:0/3690892065 conn(0x7f04940726b0 msgr2=0x7f0494072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 shutdown_connections 2024-02-17T00:37:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:24.894+0000 7f049be9d640 1 -- 172.21.15.32:0/3690892065 wait complete. 2024-02-17T00:37:24.919 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-17T00:37:24.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:25.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.018+0000 7f6567c76640 1 Processor -- start 2024-02-17T00:37:25.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.018+0000 7f6567c76640 1 -- start start 2024-02-17T00:37:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6567c76640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65600d0aa0 0x7f6560161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6567c76640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65601622b0 0x7f65600ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6567c76640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656015e8a0 con 0x7f656015da60 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6567c76640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6560161640 con 0x7f65601622b0 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6567c76640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656015eb80 con 0x7f65600d0aa0 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6566213640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65601622b0 0x7f65600ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6565a12640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f656015da60 0x7f656015de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35450/0 (socket says 172.21.15.32:35450) 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6565a12640 1 -- 172.21.15.32:0/3180357750 learned_addr learned my addr 172.21.15.32:0/3180357750 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.019+0000 7f6565211640 1 --2- 172.21.15.32:0/3180357750 >> v2:172.21.15.39:3300/0 conn(0x7f65600d0aa0 0x7f6560161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6566213640 1 -- 172.21.15.32:0/3180357750 >> v2:172.21.15.39:3300/0 conn(0x7f65600d0aa0 msgr2=0x7f6560161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6566213640 1 --2- 172.21.15.32:0/3180357750 >> v2:172.21.15.39:3300/0 conn(0x7f65600d0aa0 0x7f6560161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6566213640 1 -- 172.21.15.32:0/3180357750 >> v1:172.21.15.32:6789/0 conn(0x7f656015da60 legacy=0x7f656015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6566213640 1 -- 172.21.15.32:0/3180357750 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656015ee60 con 0x7f65601622b0 2024-02-17T00:37:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6564a10640 1 -- 172.21.15.32:0/3180357750 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761342493 0 0) 0x7f656015e8a0 con 0x7f656015da60 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6566213640 1 --2- 172.21.15.32:0/3180357750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65601622b0 0x7f65600ce520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65600b3260 tx=0x7f655002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f9a9e50a1c9471 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6564a10640 1 -- 172.21.15.32:0/3180357750 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655002cbf0 con 0x7f65601622b0 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6564a10640 1 -- 172.21.15.32:0/3180357750 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655002cd50 con 0x7f65601622b0 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.020+0000 7f6564a10640 1 -- 172.21.15.32:0/3180357750 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550034660 con 0x7f65601622b0 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 -- 172.21.15.32:0/3180357750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65601622b0 msgr2=0x7f65600ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 --2- 172.21.15.32:0/3180357750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65601622b0 0x7f65600ce520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65600b3260 tx=0x7f655002be40 comp rx=0 tx=0).stop 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 -- 172.21.15.32:0/3180357750 shutdown_connections 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 --2- 172.21.15.32:0/3180357750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65601622b0 0x7f65600ce520 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 --2- 172.21.15.32:0/3180357750 >> v2:172.21.15.39:3300/0 conn(0x7f65600d0aa0 0x7f6560161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 -- 172.21.15.32:0/3180357750 >> 172.21.15.32:0/3180357750 conn(0x7f656006bfe0 msgr2=0x7f656006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 -- 172.21.15.32:0/3180357750 shutdown_connections 2024-02-17T00:37:25.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.021+0000 7f6567c76640 1 -- 172.21.15.32:0/3180357750 wait complete. 2024-02-17T00:37:25.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.022+0000 7f6567c76640 1 Processor -- start 2024-02-17T00:37:25.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.022+0000 7f6567c76640 1 -- start start 2024-02-17T00:37:25.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6567c76640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 0x7f6560154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6567c76640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f656015da60 0x7f65600cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6567c76640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65601622b0 0x7f65600b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6567c76640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6560154950 con 0x7f65600d0aa0 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6567c76640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65600cb2b0 con 0x7f656015da60 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6567c76640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65600caac0 con 0x7f65601622b0 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 0x7f6560154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 0x7f6560154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49368/0 (socket says 172.21.15.32:49368) 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 -- 172.21.15.32:0/2832130159 learned_addr learned my addr 172.21.15.32:0/2832130159 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565211640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f656015da60 0x7f65600cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6566213640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65601622b0 0x7f65600b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 -- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65601622b0 msgr2=0x7f65600b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65601622b0 0x7f65600b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 -- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f656015da60 msgr2=0x7f65600cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f656015da60 0x7f65600cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.023+0000 7f6565a12640 1 -- 172.21.15.32:0/2832130159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550009a70 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.024+0000 7f6565a12640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 0x7f6560154410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f655800c4d0 tx=0x7f655800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.024+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65580074e0 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.024+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6558007660 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.024+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65600cada0 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.024+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558004a20 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.024+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65600cde90 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.025+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65600680c0 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.025+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6558004b80 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.026+0000 7f655e7fc640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f654c06b810 0x7f654c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.026+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f6558089a40 con 0x7f65600d0aa0 2024-02-17T00:37:25.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.026+0000 7f6565211640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f654c06b810 0x7f654c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.027+0000 7f6565211640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f654c06b810 0x7f654c06dcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65600b1cf0 tx=0x7f6554008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.031+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f655808be60 con 0x7f65600d0aa0 2024-02-17T00:37:25.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.215+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65600cba20 con 0x7f65600d0aa0 2024-02-17T00:37:25.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.216+0000 7f655e7fc640 1 -- 172.21.15.32:0/2832130159 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f6558018090 con 0x7f65600d0aa0 2024-02-17T00:37:25.219 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:25.219 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f654c06b810 msgr2=0x7f654c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f654c06b810 0x7f654c06dcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65600b1cf0 tx=0x7f6554008040 comp rx=0 tx=0).stop 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 msgr2=0x7f6560154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 0x7f6560154410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f655800c4d0 tx=0x7f655800c990 comp rx=0 tx=0).stop 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 shutdown_connections 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f654c06b810 0x7f654c06dcd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f65601622b0 0x7f65600b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f656015da60 0x7f65600cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 --2- 172.21.15.32:0/2832130159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65600d0aa0 0x7f6560154410 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 >> 172.21.15.32:0/2832130159 conn(0x7f656006bfe0 msgr2=0x7f6560160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 shutdown_connections 2024-02-17T00:37:25.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.218+0000 7f6567c76640 1 -- 172.21.15.32:0/2832130159 wait complete. 2024-02-17T00:37:25.232 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:25.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:25.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.334+0000 7eff2189a640 1 Processor -- start 2024-02-17T00:37:25.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.334+0000 7eff2189a640 1 -- start start 2024-02-17T00:37:25.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff2189a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff1c0d3760 0x7eff1c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff2189a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c0d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff2189a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff1c0ce830 0x7eff1c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff2189a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0ceff0 con 0x7eff1c0d3760 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff2189a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0ce380 con 0x7eff1c0ce830 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff2189a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c15f000 con 0x7eff1c15f1c0 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff1c0d3760 0x7eff1c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff1c0d3760 0x7eff1c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49376/0 (socket says 172.21.15.32:49376) 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 -- 172.21.15.32:0/3067084535 learned_addr learned my addr 172.21.15.32:0/3067084535 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1b7fe640 1 --2- 172.21.15.32:0/3067084535 >> v2:172.21.15.39:3300/0 conn(0x7eff1c0ce830 0x7eff1c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1a7fc640 1 --2- 172.21.15.32:0/3067084535 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c0d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 -- 172.21.15.32:0/3067084535 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 msgr2=0x7eff1c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 --2- 172.21.15.32:0/3067084535 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c0d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 -- 172.21.15.32:0/3067084535 >> v2:172.21.15.39:3300/0 conn(0x7eff1c0ce830 msgr2=0x7eff1c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 --2- 172.21.15.32:0/3067084535 >> v2:172.21.15.39:3300/0 conn(0x7eff1c0ce830 0x7eff1c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.335+0000 7eff1affd640 1 -- 172.21.15.32:0/3067084535 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0d2190 con 0x7eff1c0d3760 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.336+0000 7eff1affd640 1 --2- 172.21.15.32:0/3067084535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c15eac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0d1760 tx=0x7eff0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d5ec8d49e3d2e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.336+0000 7eff19ffb640 1 -- 172.21.15.32:0/3067084535 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c031870 con 0x7eff1c0d3760 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.336+0000 7eff19ffb640 1 -- 172.21.15.32:0/3067084535 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0319d0 con 0x7eff1c0d3760 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.336+0000 7eff19ffb640 1 -- 172.21.15.32:0/3067084535 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c031d60 con 0x7eff1c0d3760 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.336+0000 7eff2189a640 1 -- 172.21.15.32:0/3067084535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 msgr2=0x7eff1c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.336+0000 7eff2189a640 1 --2- 172.21.15.32:0/3067084535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c15eac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0d1760 tx=0x7eff0c02b910 comp rx=0 tx=0).stop 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 -- 172.21.15.32:0/3067084535 shutdown_connections 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 --2- 172.21.15.32:0/3067084535 >> v2:172.21.15.39:3300/0 conn(0x7eff1c0ce830 0x7eff1c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 --2- 172.21.15.32:0/3067084535 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c0d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 --2- 172.21.15.32:0/3067084535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c15eac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 -- 172.21.15.32:0/3067084535 >> 172.21.15.32:0/3067084535 conn(0x7eff1c072680 msgr2=0x7eff1c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 -- 172.21.15.32:0/3067084535 shutdown_connections 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.337+0000 7eff2189a640 1 -- 172.21.15.32:0/3067084535 wait complete. 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.338+0000 7eff2189a640 1 Processor -- start 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.338+0000 7eff2189a640 1 -- start start 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff1c0ce830 0x7eff1c1f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c158c00 con 0x7eff1c0d3760 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c158ee0 con 0x7eff1c0ce830 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1591c0 con 0x7eff1c15f1c0 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49384/0 (socket says 172.21.15.32:49384) 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 -- 172.21.15.32:0/4249529571 learned_addr learned my addr 172.21.15.32:0/4249529571 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1affd640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff1c0ce830 0x7eff1c1f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1b7fe640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 -- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 msgr2=0x7eff1c158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 -- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff1c0ce830 msgr2=0x7eff1c1f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff1c0ce830 0x7eff1c1f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 -- 172.21.15.32:0/4249529571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0094d0 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1affd640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff1c0ce830 0x7eff1c1f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff1a7fc640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c159ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d5c0 tx=0x7eff1000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100125f0 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10012750 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012b00 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.339+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c1594a0 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.340+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1f69e0 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.341+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c068f60 con 0x7eff1c0d3760 2024-02-17T00:37:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.341+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7eff10012c60 con 0x7eff1c0d3760 2024-02-17T00:37:25.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.341+0000 7eff03fff640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7eff0806b810 0x7eff0806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.341+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7eff1008a970 con 0x7eff1c0d3760 2024-02-17T00:37:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.341+0000 7eff1affd640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7eff0806b810 0x7eff0806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.342+0000 7eff1affd640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7eff0806b810 0x7eff0806dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff0c036000 tx=0x7eff0c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.346+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff10055020 con 0x7eff1c0d3760 2024-02-17T00:37:25.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.527+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff1c15cd20 con 0x7eff1c0d3760 2024-02-17T00:37:25.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.528+0000 7eff03fff640 1 -- 172.21.15.32:0/4249529571 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff100586e0 con 0x7eff1c0d3760 2024-02-17T00:37:25.531 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7eff0806b810 msgr2=0x7eff0806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7eff0806b810 0x7eff0806dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff0c036000 tx=0x7eff0c03c040 comp rx=0 tx=0).stop 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 msgr2=0x7eff1c159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c159ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d5c0 tx=0x7eff1000da80 comp rx=0 tx=0).stop 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 shutdown_connections 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7eff0806b810 0x7eff0806dcd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7eff1c15f1c0 0x7eff1c158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff1c0d3760 0x7eff1c159ca0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 --2- 172.21.15.32:0/4249529571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff1c0ce830 0x7eff1c1f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 >> 172.21.15.32:0/4249529571 conn(0x7eff1c072680 msgr2=0x7eff1c0b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 shutdown_connections 2024-02-17T00:37:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.530+0000 7eff2189a640 1 -- 172.21.15.32:0/4249529571 wait complete. 2024-02-17T00:37:25.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:25.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.645+0000 7f4f91fd0640 1 Processor -- start 2024-02-17T00:37:25.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.645+0000 7f4f91fd0640 1 -- start start 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f91fd0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f8c06f7d0 0x7f4f8c1620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f91fd0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4f8c06ab60 0x7f4f8c06fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f91fd0640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c161c10 con 0x7f4f8c0b2950 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f91fd0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c06b690 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f91fd0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c1625e0 con 0x7f4f8c06ab60 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8b7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f8c06f7d0 0x7f4f8c1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8bfff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4f8c0b2950 0x7f4f8c06e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35464/0 (socket says 172.21.15.32:35464) 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8bfff640 1 -- 172.21.15.32:0/1539543251 learned_addr learned my addr 172.21.15.32:0/1539543251 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8affd640 1 --2- 172.21.15.32:0/1539543251 >> v2:172.21.15.39:3300/0 conn(0x7f4f8c06ab60 0x7f4f8c06fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8b7fe640 1 -- 172.21.15.32:0/1539543251 >> v2:172.21.15.39:3300/0 conn(0x7f4f8c06ab60 msgr2=0x7f4f8c06fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8b7fe640 1 --2- 172.21.15.32:0/1539543251 >> v2:172.21.15.39:3300/0 conn(0x7f4f8c06ab60 0x7f4f8c06fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8b7fe640 1 -- 172.21.15.32:0/1539543251 >> v1:172.21.15.32:6789/0 conn(0x7f4f8c0b2950 legacy=0x7f4f8c06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8b7fe640 1 -- 172.21.15.32:0/1539543251 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0700f0 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.646+0000 7f4f8a7fc640 1 -- 172.21.15.32:0/1539543251 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814405579 0 0) 0x7f4f8c161c10 con 0x7f4f8c0b2950 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.647+0000 7f4f8b7fe640 1 --2- 172.21.15.32:0/1539543251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c1620a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0ce7f0 tx=0x7f4f7c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b0c98c3c4093cc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.647+0000 7f4f8a7fc640 1 -- 172.21.15.32:0/1539543251 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c030610 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.647+0000 7f4f8a7fc640 1 -- 172.21.15.32:0/1539543251 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c030770 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.647+0000 7f4f8a7fc640 1 -- 172.21.15.32:0/1539543251 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c030b00 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1539543251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 msgr2=0x7f4f8c1620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1539543251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c1620a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0ce7f0 tx=0x7f4f7c02b960 comp rx=0 tx=0).stop 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1539543251 shutdown_connections 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1539543251 >> v2:172.21.15.39:3300/0 conn(0x7f4f8c06ab60 0x7f4f8c06fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1539543251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c1620a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1539543251 >> 172.21.15.32:0/1539543251 conn(0x7f4f8c0999f0 msgr2=0x7f4f8c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1539543251 shutdown_connections 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.648+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1539543251 wait complete. 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.649+0000 7f4f91fd0640 1 Processor -- start 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.649+0000 7f4f91fd0640 1 -- start start 2024-02-17T00:37:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4f8c06ab60 0x7f4f8c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f8c0b2950 0x7f4f8c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c15fa70 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c15fd50 con 0x7f4f8c0b2950 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c160030 con 0x7f4f8c06ab60 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c0c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49414/0 (socket says 172.21.15.32:49414) 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 -- 172.21.15.32:0/1345547554 learned_addr learned my addr 172.21.15.32:0/1345547554 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8bfff640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f8c0b2950 0x7f4f8c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 -- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4f8c06ab60 msgr2=0x7f4f8c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4f8c06ab60 0x7f4f8c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 -- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f8c0b2950 msgr2=0x7f4f8c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f8c0b2950 0x7f4f8c156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 -- 172.21.15.32:0/1345547554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c009400 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f8affd640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c0c4020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000d5f0 tx=0x7f4f8000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800125f0 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80012750 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80012b00 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c160310 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.650+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c15f6f0 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.651+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c068f60 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.652+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4f80012c60 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.652+0000 7f4f73fff640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4f7806b840 0x7f4f7806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.652+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4f8008a900 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.652+0000 7f4f8b7fe640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4f7806b840 0x7f4f7806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.653+0000 7f4f8b7fe640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4f7806b840 0x7f4f7806dd00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c036000 tx=0x7f4f7c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.656+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f80055040 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.835+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f8c06b7d0 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.836+0000 7f4f73fff640 1 -- 172.21.15.32:0/1345547554 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f80058700 con 0x7f4f8c06f7d0 2024-02-17T00:37:25.839 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:25.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4f7806b840 msgr2=0x7f4f7806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4f7806b840 0x7f4f7806dd00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c036000 tx=0x7f4f7c030000 comp rx=0 tx=0).stop 2024-02-17T00:37:25.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 msgr2=0x7f4f8c0c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c0c4020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000d5f0 tx=0x7f4f8000dab0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 shutdown_connections 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f8c0b2950 0x7f4f8c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f8c06f7d0 0x7f4f8c0c4020 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4f7806b840 0x7f4f7806dd00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 --2- 172.21.15.32:0/1345547554 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4f8c06ab60 0x7f4f8c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 >> 172.21.15.32:0/1345547554 conn(0x7f4f8c0999f0 msgr2=0x7f4f8c0affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 shutdown_connections 2024-02-17T00:37:25.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.838+0000 7f4f91fd0640 1 -- 172.21.15.32:0/1345547554 wait complete. 2024-02-17T00:37:25.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:25.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.953+0000 7f9532ce1640 1 Processor -- start 2024-02-17T00:37:25.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.953+0000 7f9532ce1640 1 -- start start 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9532ce1640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f952c0d0780 0x7f952c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9532ce1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9532ce1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0d10a0 con 0x7f952c0b9130 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9532ce1640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c0b7ef0 con 0x7f952c0d0780 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9532ce1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0b81d0 con 0x7f952c0b9590 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f952c0d0780 0x7f952c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f952c0d0780 0x7f952c0d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49426/0 (socket says 172.21.15.32:49426) 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 -- 172.21.15.32:0/3825490227 learned_addr learned my addr 172.21.15.32:0/3825490227 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f953127e640 1 --2- 172.21.15.32:0/3825490227 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 -- 172.21.15.32:0/3825490227 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 msgr2=0x7f952c0b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 --2- 172.21.15.32:0/3825490227 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 -- 172.21.15.32:0/3825490227 >> v1:172.21.15.39:6789/0 conn(0x7f952c0b9130 legacy=0x7f952c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.954+0000 7f9530a7d640 1 -- 172.21.15.32:0/3825490227 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0b84b0 con 0x7f952c0d0780 2024-02-17T00:37:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.955+0000 7f9530a7d640 1 --2- 172.21.15.32:0/3825490227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c0d0b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f951c009870 tx=0x7f951c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd2bc71c15beede server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.955+0000 7f952b7fe640 1 -- 172.21.15.32:0/3825490227 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c030840 con 0x7f952c0d0780 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.955+0000 7f952b7fe640 1 -- 172.21.15.32:0/3825490227 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0309a0 con 0x7f952c0d0780 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.955+0000 7f952b7fe640 1 -- 172.21.15.32:0/3825490227 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c030d30 con 0x7f952c0d0780 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 -- 172.21.15.32:0/3825490227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 msgr2=0x7f952c0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3825490227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c0d0b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f951c009870 tx=0x7f951c02b980 comp rx=0 tx=0).stop 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 -- 172.21.15.32:0/3825490227 shutdown_connections 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3825490227 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3825490227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c0d0b60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 -- 172.21.15.32:0/3825490227 >> 172.21.15.32:0/3825490227 conn(0x7f952c0726b0 msgr2=0x7f952c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:25.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 -- 172.21.15.32:0/3825490227 shutdown_connections 2024-02-17T00:37:25.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.956+0000 7f9532ce1640 1 -- 172.21.15.32:0/3825490227 wait complete. 2024-02-17T00:37:25.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.957+0000 7f9532ce1640 1 Processor -- start 2024-02-17T00:37:25.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.957+0000 7f9532ce1640 1 -- start start 2024-02-17T00:37:25.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9532ce1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f952c0b9130 0x7f952c0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9532ce1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9532ce1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9532ce1640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c8c20 con 0x7f952c0d0780 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9532ce1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c8f00 con 0x7f952c0b9130 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9532ce1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c91e0 con 0x7f952c0b9590 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c14cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49436/0 (socket says 172.21.15.32:49436) 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f9530a7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f952c0b9130 0x7f952c0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 -- 172.21.15.32:0/3702056135 learned_addr learned my addr 172.21.15.32:0/3702056135 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f952bfff640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 -- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 msgr2=0x7f952c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 -- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f952c0b9130 msgr2=0x7f952c0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:25.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f952c0b9130 0x7f952c0c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.958+0000 7f953127e640 1 -- 172.21.15.32:0/3702056135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0094d0 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.959+0000 7f953127e640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c14cbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9524007de0 tx=0x7f952400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.959+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524014620 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.959+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400ee90 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.959+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0c94c0 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.959+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95240149e0 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.959+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c1e6480 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.960+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0c99e0 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.960+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9524014b40 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.960+0000 7f95297fa640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f951806b810 0x7f951806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.961+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f952408ae20 con 0x7f952c0d0780 2024-02-17T00:37:25.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.961+0000 7f9530a7d640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f951806b810 0x7f951806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:25.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.961+0000 7f9530a7d640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f951806b810 0x7f951806dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f951c036000 tx=0x7f951c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:25.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:25.965+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f952c0c99e0 con 0x7f952c0d0780 2024-02-17T00:37:26.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.149+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f952c0c99e0 con 0x7f952c0d0780 2024-02-17T00:37:26.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.149+0000 7f95297fa640 1 -- 172.21.15.32:0/3702056135 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f952c0c99e0 con 0x7f952c0d0780 2024-02-17T00:37:26.152 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.151+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f951806b810 msgr2=0x7f951806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.151+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f951806b810 0x7f951806dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f951c036000 tx=0x7f951c008030 comp rx=0 tx=0).stop 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.151+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 msgr2=0x7f952c14cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.151+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c14cbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9524007de0 tx=0x7f952400e4b0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 shutdown_connections 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0d0780 0x7f952c14cbe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f951806b810 0x7f951806dcd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f952c0b9590 0x7f952c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 --2- 172.21.15.32:0/3702056135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f952c0b9130 0x7f952c0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 >> 172.21.15.32:0/3702056135 conn(0x7f952c0726b0 msgr2=0x7f952c0d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:26.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 shutdown_connections 2024-02-17T00:37:26.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.152+0000 7f9532ce1640 1 -- 172.21.15.32:0/3702056135 wait complete. 2024-02-17T00:37:26.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.268+0000 7efeb71f4640 1 Processor -- start 2024-02-17T00:37:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.268+0000 7efeb71f4640 1 -- start start 2024-02-17T00:37:26.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.268+0000 7efeb71f4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efeb015deb0 0x7efeb00b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.268+0000 7efeb71f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb00d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb71f4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00ce4c0 con 0x7efeb00ce030 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb71f4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00d4130 con 0x7efeb015deb0 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb71f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00d1a40 con 0x7efeb00d3760 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb4f90640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efeb015deb0 0x7efeb00b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb5791640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb00d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeaffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efeb00ce030 0x7efeb00b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:57328/0 (socket says 172.21.15.32:57328) 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeaffff640 1 -- 172.21.15.32:0/3317347936 learned_addr learned my addr 172.21.15.32:0/3317347936 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeaf7fe640 1 -- 172.21.15.32:0/3317347936 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689244772 0 0) 0x7efeb00ce4c0 con 0x7efeb00ce030 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeaf7fe640 1 -- 172.21.15.32:0/3317347936 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea0003520 con 0x7efeb00ce030 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb5791640 1 -- 172.21.15.32:0/3317347936 >> v2:172.21.15.39:3300/0 conn(0x7efeb015deb0 msgr2=0x7efeb00b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb5791640 1 --2- 172.21.15.32:0/3317347936 >> v2:172.21.15.39:3300/0 conn(0x7efeb015deb0 0x7efeb00b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb5791640 1 -- 172.21.15.32:0/3317347936 >> v1:172.21.15.39:6789/0 conn(0x7efeb00ce030 legacy=0x7efeb00b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb5791640 1 -- 172.21.15.32:0/3317347936 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00d1d20 con 0x7efeb00d3760 2024-02-17T00:37:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.269+0000 7efeb4f90640 1 --2- 172.21.15.32:0/3317347936 >> v2:172.21.15.39:3300/0 conn(0x7efeb015deb0 0x7efeb00b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.270+0000 7efeb5791640 1 --2- 172.21.15.32:0/3317347936 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb00d3bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efea8009d90 tx=0x7efea802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dbfc5453b61f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.270+0000 7efeaf7fe640 1 -- 172.21.15.32:0/3317347936 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea802cc50 con 0x7efeb00d3760 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.270+0000 7efeaf7fe640 1 -- 172.21.15.32:0/3317347936 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea802cdb0 con 0x7efeb00d3760 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.270+0000 7efeaf7fe640 1 -- 172.21.15.32:0/3317347936 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8034660 con 0x7efeb00d3760 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 -- 172.21.15.32:0/3317347936 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 msgr2=0x7efeb00d3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 --2- 172.21.15.32:0/3317347936 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb00d3bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efea8009d90 tx=0x7efea802bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 -- 172.21.15.32:0/3317347936 shutdown_connections 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 --2- 172.21.15.32:0/3317347936 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb00d3bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 --2- 172.21.15.32:0/3317347936 >> v2:172.21.15.39:3300/0 conn(0x7efeb015deb0 0x7efeb00b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 -- 172.21.15.32:0/3317347936 >> 172.21.15.32:0/3317347936 conn(0x7efeb00726b0 msgr2=0x7efeb0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 -- 172.21.15.32:0/3317347936 shutdown_connections 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.271+0000 7efeb71f4640 1 -- 172.21.15.32:0/3317347936 wait complete. 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.272+0000 7efeb71f4640 1 Processor -- start 2024-02-17T00:37:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.272+0000 7efeb71f4640 1 -- start start 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb71f4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 0x7efeb0160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb71f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb71f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efeb015deb0 0x7efeb015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb71f4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb015fbe0 con 0x7efeb00ce030 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb71f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb015fec0 con 0x7efeb015deb0 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb71f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01601a0 con 0x7efeb00d3760 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 0x7efeb0160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 0x7efeb0160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49440/0 (socket says 172.21.15.32:49440) 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 -- 172.21.15.32:0/4181246448 learned_addr learned my addr 172.21.15.32:0/4181246448 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb5791640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efeb015deb0 0x7efeb015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeaffff640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 -- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 msgr2=0x7efeb0156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb0156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 -- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efeb015deb0 msgr2=0x7efeb015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efeb015deb0 0x7efeb015eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 -- 172.21.15.32:0/4181246448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009400 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeaffff640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb0156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.273+0000 7efeb4f90640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 0x7efeb0160c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efea400e960 tx=0x7efea400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.274+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400ca00 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.274+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400cb60 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.274+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4013470 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.274+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8009a70 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.274+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0160760 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.275+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0068f60 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.275+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7efea40135d0 con 0x7efeb00ce030 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.275+0000 7efead7fa640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efe9406b810 0x7efe9406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.275+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7efea408a740 con 0x7efeb00ce030 2024-02-17T00:37:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.276+0000 7efeaffff640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efe9406b810 0x7efe9406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.276+0000 7efeaffff640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efe9406b810 0x7efe9406dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efeb00caa50 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.280+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efea4054e80 con 0x7efeb00ce030 2024-02-17T00:37:26.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.458+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efeb00b85a0 con 0x7efeb00ce030 2024-02-17T00:37:26.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.458+0000 7efead7fa640 1 -- 172.21.15.32:0/4181246448 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7efea4058540 con 0x7efeb00ce030 2024-02-17T00:37:26.461 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:26.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efe9406b810 msgr2=0x7efe9406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efe9406b810 0x7efe9406dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efeb00caa50 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 msgr2=0x7efeb0160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 0x7efeb0160c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efea400e960 tx=0x7efea400ee20 comp rx=0 tx=0).stop 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 shutdown_connections 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efeb015deb0 0x7efeb015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efe9406b810 0x7efe9406dcd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efeb00d3760 0x7efeb0156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 --2- 172.21.15.32:0/4181246448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeb00ce030 0x7efeb0160c80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 >> 172.21.15.32:0/4181246448 conn(0x7efeb00726b0 msgr2=0x7efeb0072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 shutdown_connections 2024-02-17T00:37:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.460+0000 7efeb71f4640 1 -- 172.21.15.32:0/4181246448 wait complete. 2024-02-17T00:37:26.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-02-17T00:37:26.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.572+0000 7f681f06f640 1 Processor -- start 2024-02-17T00:37:26.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.572+0000 7f681f06f640 1 -- start start 2024-02-17T00:37:26.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681f06f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68180cd740 0x7f68180d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681f06f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f681806cd90 0x7f68180cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681f06f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180cdb20 con 0x7f68180d08d0 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681f06f640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6818099b90 con 0x7f68180cd740 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681f06f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6818099e70 con 0x7f681806cd90 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681ce0b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68180cd740 0x7f68180d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681ce0b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68180cd740 0x7f68180d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49444/0 (socket says 172.21.15.32:49444) 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.573+0000 7f681ce0b640 1 -- 172.21.15.32:0/1494542455 learned_addr learned my addr 172.21.15.32:0/1494542455 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.574+0000 7f681d60c640 1 --2- 172.21.15.32:0/1494542455 >> v2:172.21.15.39:3300/0 conn(0x7f681806cd90 0x7f68180cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.574+0000 7f681ce0b640 1 -- 172.21.15.32:0/1494542455 >> v2:172.21.15.39:3300/0 conn(0x7f681806cd90 msgr2=0x7f68180cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.574+0000 7f681ce0b640 1 --2- 172.21.15.32:0/1494542455 >> v2:172.21.15.39:3300/0 conn(0x7f681806cd90 0x7f68180cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.574+0000 7f681ce0b640 1 -- 172.21.15.32:0/1494542455 >> v1:172.21.15.39:6789/0 conn(0x7f68180d08d0 legacy=0x7f681806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.574+0000 7f681ce0b640 1 -- 172.21.15.32:0/1494542455 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681809a150 con 0x7f68180cd740 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.574+0000 7f681ce0b640 1 --2- 172.21.15.32:0/1494542455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180cd740 0x7f68180d0390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f68180cdfe0 tx=0x7f680802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef70f25702ac59e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f68177fe640 1 -- 172.21.15.32:0/1494542455 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808031870 con 0x7f68180cd740 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f68177fe640 1 -- 172.21.15.32:0/1494542455 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68080319d0 con 0x7f68180cd740 2024-02-17T00:37:26.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f68177fe640 1 -- 172.21.15.32:0/1494542455 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808031d60 con 0x7f68180cd740 2024-02-17T00:37:26.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 -- 172.21.15.32:0/1494542455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180cd740 msgr2=0x7f68180d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 --2- 172.21.15.32:0/1494542455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180cd740 0x7f68180d0390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f68180cdfe0 tx=0x7f680802b910 comp rx=0 tx=0).stop 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 -- 172.21.15.32:0/1494542455 shutdown_connections 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 --2- 172.21.15.32:0/1494542455 >> v2:172.21.15.39:3300/0 conn(0x7f681806cd90 0x7f68180cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 --2- 172.21.15.32:0/1494542455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180cd740 0x7f68180d0390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 -- 172.21.15.32:0/1494542455 >> 172.21.15.32:0/1494542455 conn(0x7f68180b3130 msgr2=0x7f68180b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 -- 172.21.15.32:0/1494542455 shutdown_connections 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.575+0000 7f681f06f640 1 -- 172.21.15.32:0/1494542455 wait complete. 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.576+0000 7f681f06f640 1 Processor -- start 2024-02-17T00:37:26.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.576+0000 7f681f06f640 1 -- start start 2024-02-17T00:37:26.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681f06f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f681806cd90 0x7f68180ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681f06f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f68180cd740 0x7f68180b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681f06f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 0x7f68180b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681f06f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c77d0 con 0x7f68180d08d0 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681f06f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c6bc0 con 0x7f681806cd90 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681f06f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c6ea0 con 0x7f68180cd740 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681d60c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 0x7f68180b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681d60c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 0x7f68180b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49452/0 (socket says 172.21.15.32:49452) 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681d60c640 1 -- 172.21.15.32:0/1526429271 learned_addr learned my addr 172.21.15.32:0/1526429271 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f681ce0b640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f681806cd90 0x7f68180ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.577+0000 7f6817fff640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f68180cd740 0x7f68180b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681d60c640 1 -- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f68180cd740 msgr2=0x7f68180b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681d60c640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f68180cd740 0x7f68180b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681d60c640 1 -- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f681806cd90 msgr2=0x7f68180ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681d60c640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f681806cd90 0x7f68180ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681d60c640 1 -- 172.21.15.32:0/1526429271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080094d0 con 0x7f68180d08d0 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f6817fff640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f68180cd740 0x7f68180b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:26.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681ce0b640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f681806cd90 0x7f68180ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681d60c640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 0x7f68180b0550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f681000cc30 tx=0x7f681000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000ce40 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6810003990 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68180c7180 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6810003d20 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.578+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68180c6850 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.579+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68180b2f30 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.579+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6810003e80 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.580+0000 7f68157fa640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f680406b810 0x7f680406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.580+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f681008a8c0 con 0x7f68180d08d0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.580+0000 7f681ce0b640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f680406b810 0x7f680406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:26.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.581+0000 7f681ce0b640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f680406b810 0x7f680406dcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6808036000 tx=0x7f680803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:26.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.584+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6810054f70 con 0x7f68180d08d0 2024-02-17T00:37:26.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:26.833+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f6818068fd0 con 0x7f68180d08d0 2024-02-17T00:37:27.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.245+0000 7f68157fa640 1 -- 172.21.15.32:0/1526429271 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v71) v1 ==== 147+0+0 (secure 0 0 0) 0x7f681001d0d0 con 0x7f68180d08d0 2024-02-17T00:37:27.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f680406b810 msgr2=0x7f680406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f680406b810 0x7f680406dcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6808036000 tx=0x7f680803c040 comp rx=0 tx=0).stop 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 msgr2=0x7f68180b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 0x7f68180b0550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f681000cc30 tx=0x7f681000a5c0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 shutdown_connections 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68180d08d0 0x7f68180b0550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f680406b810 0x7f680406dcd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f68180cd740 0x7f68180b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 --2- 172.21.15.32:0/1526429271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f681806cd90 0x7f68180ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.247+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 >> 172.21.15.32:0/1526429271 conn(0x7f68180b3130 msgr2=0x7f681806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.248+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 shutdown_connections 2024-02-17T00:37:27.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.248+0000 7f681f06f640 1 -- 172.21.15.32:0/1526429271 wait complete. 2024-02-17T00:37:27.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-17T00:37:27.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.365+0000 7f17d4508640 1 Processor -- start 2024-02-17T00:37:27.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.365+0000 7f17d4508640 1 -- start start 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d4508640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0b29c0 0x7f17cc0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d4508640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17cc0d1ac0 0x7f17cc06c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d4508640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0b1b90 con 0x7f17cc15d990 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d4508640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0d1f70 con 0x7f17cc0d1ac0 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d4508640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0cbcb0 con 0x7f17cc0b29c0 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d2aa5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17cc0d1ac0 0x7f17cc06c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d2aa5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17cc0d1ac0 0x7f17cc06c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49464/0 (socket says 172.21.15.32:49464) 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.366+0000 7f17d2aa5640 1 -- 172.21.15.32:0/2436841263 learned_addr learned my addr 172.21.15.32:0/2436841263 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d2aa5640 1 -- 172.21.15.32:0/2436841263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0b29c0 msgr2=0x7f17cc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d1aa3640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0b29c0 0x7f17cc0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d2aa5640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0b29c0 0x7f17cc0d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d2aa5640 1 -- 172.21.15.32:0/2436841263 >> v1:172.21.15.39:6789/0 conn(0x7f17cc15d990 legacy=0x7f17cc0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:27.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d2aa5640 1 -- 172.21.15.32:0/2436841263 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0b1df0 con 0x7f17cc0d1ac0 2024-02-17T00:37:27.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d1aa3640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0b29c0 0x7f17cc0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:27.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.367+0000 7f17d2aa5640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0d1ac0 0x7f17cc06c360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009e50 tx=0x7f17bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23fc36cc7725a9a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:27.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d12a2640 1 -- 172.21.15.32:0/2436841263 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc02ca70 con 0x7f17cc0d1ac0 2024-02-17T00:37:27.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d12a2640 1 -- 172.21.15.32:0/2436841263 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc02cbd0 con 0x7f17cc0d1ac0 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d12a2640 1 -- 172.21.15.32:0/2436841263 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0343f0 con 0x7f17cc0d1ac0 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 -- 172.21.15.32:0/2436841263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0d1ac0 msgr2=0x7f17cc06c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0d1ac0 0x7f17cc06c360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009e50 tx=0x7f17bc02bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 -- 172.21.15.32:0/2436841263 shutdown_connections 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0d1ac0 0x7f17cc06c360 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 --2- 172.21.15.32:0/2436841263 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0b29c0 0x7f17cc0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 -- 172.21.15.32:0/2436841263 >> 172.21.15.32:0/2436841263 conn(0x7f17cc08af80 msgr2=0x7f17cc08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 -- 172.21.15.32:0/2436841263 shutdown_connections 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.368+0000 7f17d4508640 1 -- 172.21.15.32:0/2436841263 wait complete. 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.369+0000 7f17d4508640 1 Processor -- start 2024-02-17T00:37:27.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.369+0000 7f17d4508640 1 -- start start 2024-02-17T00:37:27.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d4508640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 0x7f17cc14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d4508640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0d1ac0 0x7f17cc1f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d4508640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17cc15d990 0x7f17cc0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d4508640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0b5f90 con 0x7f17cc0b29c0 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d4508640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1502d0 con 0x7f17cc15d990 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d4508640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0b53c0 con 0x7f17cc0d1ac0 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d22a4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 0x7f17cc14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d22a4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 0x7f17cc14fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49480/0 (socket says 172.21.15.32:49480) 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d22a4640 1 -- 172.21.15.32:0/859961415 learned_addr learned my addr 172.21.15.32:0/859961415 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d1aa3640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0d1ac0 0x7f17cc1f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.370+0000 7f17d2aa5640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17cc15d990 0x7f17cc0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d22a4640 1 -- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0d1ac0 msgr2=0x7f17cc1f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d22a4640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0d1ac0 0x7f17cc1f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d22a4640 1 -- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17cc15d990 msgr2=0x7f17cc0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d22a4640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17cc15d990 0x7f17cc0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d22a4640 1 -- 172.21.15.32:0/859961415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009b30 con 0x7f17cc0b29c0 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d1aa3640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0d1ac0 0x7f17cc1f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:27.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d22a4640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 0x7f17cc14fd90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c3c0 tx=0x7f17c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40052d0 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4005450 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc0b5660 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4007260 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.371+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc0b5c20 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.372+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc068f60 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.372+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f17c40073c0 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.373+0000 7f17caffd640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f17b806b840 0x7f17b806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.373+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f17c4089840 con 0x7f17cc0b29c0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.373+0000 7f17d1aa3640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f17b806b840 0x7f17b806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.374+0000 7f17d1aa3640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f17b806b840 0x7f17b806dd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006fd0 tx=0x7f17c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:27.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.377+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17c4053f80 con 0x7f17cc0b29c0 2024-02-17T00:37:27.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.556+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f17cc15d140 con 0x7f17cc0b29c0 2024-02-17T00:37:27.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.559+0000 7f17caffd640 1 -- 172.21.15.32:0/859961415 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f17c4057640 con 0x7f17cc0b29c0 2024-02-17T00:37:27.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f17b806b840 msgr2=0x7f17b806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f17b806b840 0x7f17b806dd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006fd0 tx=0x7f17c0008040 comp rx=0 tx=0).stop 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 msgr2=0x7f17cc14fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 0x7f17cc14fd90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c3c0 tx=0x7f17c400c880 comp rx=0 tx=0).stop 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 shutdown_connections 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17cc15d990 0x7f17cc0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f17b806b840 0x7f17b806dd00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f17cc0d1ac0 0x7f17cc1f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 --2- 172.21.15.32:0/859961415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17cc0b29c0 0x7f17cc14fd90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 >> 172.21.15.32:0/859961415 conn(0x7f17cc08af80 msgr2=0x7f17cc0d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 shutdown_connections 2024-02-17T00:37:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.561+0000 7f17d4508640 1 -- 172.21.15.32:0/859961415 wait complete. 2024-02-17T00:37:27.575 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T00:37:27.575 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T00:37:27.617 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T00:37:27.674 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T00:37:27.675 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:27.675 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:27.689 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:27.690 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:27.745 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:27.746 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:27.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:27.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.937+0000 7fe63f963640 1 Processor -- start 2024-02-17T00:37:27.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.937+0000 7fe63f963640 1 -- start start 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63f963640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6380999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63f963640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6380cd7d0 con 0x7fe638099f30 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63f963640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6380d0790 con 0x7fe63815b8e0 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63f963640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63809a340 con 0x7fe6380d0330 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63df00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe638099f30 0x7fe6380b0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35474/0 (socket says 172.21.15.32:35474) 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63df00640 1 -- 172.21.15.32:0/2405673384 learned_addr learned my addr 172.21.15.32:0/2405673384 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811194042 0 0) 0x7fe6380cd7d0 con 0x7fe638099f30 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe620003520 con 0x7fe638099f30 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.938+0000 7fe63cefe640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6380999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340734602 0 0) 0x7fe620003520 con 0x7fe638099f30 2024-02-17T00:37:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 msgr2=0x7fe6380999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6380999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 >> v1:172.21.15.39:6789/0 conn(0x7fe63815b8e0 legacy=0x7fe6380cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380ccbc0 con 0x7fe638099f30 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fe6280019f0 con 0x7fe638099f30 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 >> v1:172.21.15.32:6789/0 conn(0x7fe638099f30 legacy=0x7fe6380b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200039a0 0x7fe620003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6200047c0 0x7fe620004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63809a340 con 0x7fe6200047c0 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000bab0 con 0x7fe6200039a0 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000bc70 con 0x7fe6380d0330 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63cefe640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6200047c0 0x7fe620004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63d6ff640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200039a0 0x7fe620003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63df00640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63cefe640 1 -- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 msgr2=0x7fe6200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63cefe640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63cefe640 1 -- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200039a0 msgr2=0x7fe620003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63cefe640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200039a0 0x7fe620003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63cefe640 1 -- 172.21.15.32:0/2405673384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620003520 con 0x7fe6200047c0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.939+0000 7fe63df00640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe6380d0330 0x7fe6200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.940+0000 7fe63cefe640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6200047c0 0x7fe620004c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00ba30 tx=0x7fe6200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4663487126c61276 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.940+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c032640 con 0x7fe6200047c0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.940+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c0327a0 con 0x7fe6200047c0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.940+0000 7fe637fff640 1 -- 172.21.15.32:0/2405673384 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c032b30 con 0x7fe6200047c0 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63f963640 1 -- 172.21.15.32:0/2405673384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6200047c0 msgr2=0x7fe620004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63f963640 1 --2- 172.21.15.32:0/2405673384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6200047c0 0x7fe620004c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00ba30 tx=0x7fe6200057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63df00640 1 -- 172.21.15.32:0/2405673384 reap_dead start 2024-02-17T00:37:27.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63f963640 1 -- 172.21.15.32:0/2405673384 shutdown_connections 2024-02-17T00:37:27.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63f963640 1 -- 172.21.15.32:0/2405673384 >> 172.21.15.32:0/2405673384 conn(0x7fe6380b3130 msgr2=0x7fe6380b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:27.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63f963640 1 -- 172.21.15.32:0/2405673384 shutdown_connections 2024-02-17T00:37:27.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.941+0000 7fe63f963640 1 -- 172.21.15.32:0/2405673384 wait complete. 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.942+0000 7fe63f963640 1 Processor -- start 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.942+0000 7fe63f963640 1 -- start start 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200047c0 0x7fe6381564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 0x7fe6380af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe63814a390 0x7fe63814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638156bb0 con 0x7fe6380b6970 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638156e90 con 0x7fe6200047c0 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe638157170 con 0x7fe63814a390 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 0x7fe6380af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 0x7fe6380af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49496/0 (socket says 172.21.15.32:49496) 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 -- 172.21.15.32:0/4084782878 learned_addr learned my addr 172.21.15.32:0/4084782878 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63d6ff640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200047c0 0x7fe6381564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63df00640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe63814a390 0x7fe63814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 -- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe63814a390 msgr2=0x7fe63814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe63814a390 0x7fe63814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 -- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200047c0 msgr2=0x7fe6381564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200047c0 0x7fe6381564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 -- 172.21.15.32:0/4084782878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638157450 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63df00640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe63814a390 0x7fe63814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63cefe640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 0x7fe6380af990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe62c035040 tx=0x7fe62c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c004220 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c0043a0 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe638157730 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.943+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c003850 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.944+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6380afed0 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.944+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6380685e0 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.945+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe62c043070 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.945+0000 7fe635ffb640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe62406b810 0x7fe62406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.945+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fe62c0acc50 con 0x7fe6380b6970 2024-02-17T00:37:27.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.946+0000 7fe63d6ff640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe62406b810 0x7fe62406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:27.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.946+0000 7fe63d6ff640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe62406b810 0x7fe62406dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6300017e0 tx=0x7fe630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:27.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:27.950+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe62c0b2020 con 0x7fe6380b6970 2024-02-17T00:37:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.130+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe638068fd0 con 0x7fe6380b6970 2024-02-17T00:37:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.131+0000 7fe635ffb640 1 -- 172.21.15.32:0/4084782878 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7fe62c036090 con 0x7fe6380b6970 2024-02-17T00:37:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:28.135 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe62406b810 msgr2=0x7fe62406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe62406b810 0x7fe62406dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6300017e0 tx=0x7fe630009040 comp rx=0 tx=0).stop 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 msgr2=0x7fe6380af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 0x7fe6380af990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe62c035040 tx=0x7fe62c004730 comp rx=0 tx=0).stop 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 shutdown_connections 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe62406b810 0x7fe62406dcd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe63814a390 0x7fe63814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6380b6970 0x7fe6380af990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 --2- 172.21.15.32:0/4084782878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6200047c0 0x7fe6381564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 >> 172.21.15.32:0/4084782878 conn(0x7fe6380b3130 msgr2=0x7fe63815e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 shutdown_connections 2024-02-17T00:37:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.134+0000 7fe63f963640 1 -- 172.21.15.32:0/4084782878 wait complete. 2024-02-17T00:37:28.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:28.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:28.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.250+0000 7ff03aaa7640 1 Processor -- start 2024-02-17T00:37:28.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.250+0000 7ff03aaa7640 1 -- start start 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff03aaa7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0340d3760 0x7ff03415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff03aaa7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff03415f1c0 0x7ff0340d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff03aaa7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff0340ce830 0x7ff0340b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff03aaa7640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0340ceff0 con 0x7ff0340d3760 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff03aaa7640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0340ce380 con 0x7ff0340ce830 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff03aaa7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415f000 con 0x7ff03415f1c0 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0340d3760 0x7ff03415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0340d3760 0x7ff03415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49502/0 (socket says 172.21.15.32:49502) 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 -- 172.21.15.32:0/1175977955 learned_addr learned my addr 172.21.15.32:0/1175977955 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff039044640 1 --2- 172.21.15.32:0/1175977955 >> v2:172.21.15.39:3300/0 conn(0x7ff0340ce830 0x7ff0340b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff033fff640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff03415f1c0 0x7ff0340d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 -- 172.21.15.32:0/1175977955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff03415f1c0 msgr2=0x7ff0340d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff03415f1c0 0x7ff0340d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 -- 172.21.15.32:0/1175977955 >> v2:172.21.15.39:3300/0 conn(0x7ff0340ce830 msgr2=0x7ff0340b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 --2- 172.21.15.32:0/1175977955 >> v2:172.21.15.39:3300/0 conn(0x7ff0340ce830 0x7ff0340b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff038843640 1 -- 172.21.15.32:0/1175977955 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0340d2190 con 0x7ff0340d3760 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff039044640 1 --2- 172.21.15.32:0/1175977955 >> v2:172.21.15.39:3300/0 conn(0x7ff0340ce830 0x7ff0340b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.251+0000 7ff033fff640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff03415f1c0 0x7ff0340d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff038843640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0340d3760 0x7ff03415eac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff0340d1760 tx=0x7ff02802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77778df7363672d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff0337fe640 1 -- 172.21.15.32:0/1175977955 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028031860 con 0x7ff0340d3760 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff0337fe640 1 -- 172.21.15.32:0/1175977955 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0280319c0 con 0x7ff0340d3760 2024-02-17T00:37:28.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff0337fe640 1 -- 172.21.15.32:0/1175977955 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028031d50 con 0x7ff0340d3760 2024-02-17T00:37:28.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 -- 172.21.15.32:0/1175977955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0340d3760 msgr2=0x7ff03415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0340d3760 0x7ff03415eac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff0340d1760 tx=0x7ff02802b900 comp rx=0 tx=0).stop 2024-02-17T00:37:28.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 -- 172.21.15.32:0/1175977955 shutdown_connections 2024-02-17T00:37:28.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/1175977955 >> v2:172.21.15.39:3300/0 conn(0x7ff0340ce830 0x7ff0340b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff03415f1c0 0x7ff0340d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/1175977955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0340d3760 0x7ff03415eac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.252+0000 7ff03aaa7640 1 -- 172.21.15.32:0/1175977955 >> 172.21.15.32:0/1175977955 conn(0x7ff034072680 msgr2=0x7ff034072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.253+0000 7ff03aaa7640 1 -- 172.21.15.32:0/1175977955 shutdown_connections 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.253+0000 7ff03aaa7640 1 -- 172.21.15.32:0/1175977955 wait complete. 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.254+0000 7ff03aaa7640 1 Processor -- start 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.254+0000 7ff03aaa7640 1 -- start start 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0340ce830 0x7ff0341593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0340d3760 0x7ff034148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 0x7ff034152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034153470 con 0x7ff03415f1c0 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0341f3650 con 0x7ff0340d3760 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340c79b0 con 0x7ff0340ce830 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 0x7ff034152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 0x7ff034152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49512/0 (socket says 172.21.15.32:49512) 2024-02-17T00:37:28.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 -- 172.21.15.32:0/2180318413 learned_addr learned my addr 172.21.15.32:0/2180318413 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff033fff640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0340d3760 0x7ff034148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff038843640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0340ce830 0x7ff0341593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 -- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0340ce830 msgr2=0x7ff0341593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0340ce830 0x7ff0341593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 -- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0340d3760 msgr2=0x7ff034148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0340d3760 0x7ff034148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 -- 172.21.15.32:0/2180318413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280094d0 con 0x7ff03415f1c0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff033fff640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0340d3760 0x7ff034148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff038843640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0340ce830 0x7ff0341593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff039044640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 0x7ff034152690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00ce40 tx=0x7ff02c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c00d840 con 0x7ff03415f1c0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c00d9a0 con 0x7ff03415f1c0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c00dd50 con 0x7ff03415f1c0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0340c8250 con 0x7ff03415f1c0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.255+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0340c7ee0 con 0x7ff03415f1c0 2024-02-17T00:37:28.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.256+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff034068f60 con 0x7ff03415f1c0 2024-02-17T00:37:28.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.257+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff02c01e3b0 con 0x7ff03415f1c0 2024-02-17T00:37:28.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.257+0000 7ff0317fa640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff01806b810 0x7ff01806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.257+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7ff02c08af90 con 0x7ff03415f1c0 2024-02-17T00:37:28.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.258+0000 7ff038843640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff01806b810 0x7ff01806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.258+0000 7ff038843640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff01806b810 0x7ff01806dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff028036000 tx=0x7ff02803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.261+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff02c0be8c0 con 0x7ff03415f1c0 2024-02-17T00:37:28.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.441+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0340ce610 con 0x7ff03415f1c0 2024-02-17T00:37:28.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.441+0000 7ff0317fa640 1 -- 172.21.15.32:0/2180318413 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff02c01a020 con 0x7ff03415f1c0 2024-02-17T00:37:28.444 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:28.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff01806b810 msgr2=0x7ff01806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff01806b810 0x7ff01806dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff028036000 tx=0x7ff02803c040 comp rx=0 tx=0).stop 2024-02-17T00:37:28.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 msgr2=0x7ff034152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 0x7ff034152690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00ce40 tx=0x7ff02c00a710 comp rx=0 tx=0).stop 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 shutdown_connections 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff03415f1c0 0x7ff034152690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0340d3760 0x7ff034148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff01806b810 0x7ff01806dcd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 --2- 172.21.15.32:0/2180318413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0340ce830 0x7ff0341593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 >> 172.21.15.32:0/2180318413 conn(0x7ff034072680 msgr2=0x7ff0340d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 shutdown_connections 2024-02-17T00:37:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.443+0000 7ff03aaa7640 1 -- 172.21.15.32:0/2180318413 wait complete. 2024-02-17T00:37:28.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:28.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.558+0000 7f64a197a640 1 Processor -- start 2024-02-17T00:37:28.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.558+0000 7f64a197a640 1 -- start start 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f64a197a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f649c0b0810 0x7f649c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f64a197a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0b0d60 con 0x7f649c0d03a0 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f64a197a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0cf320 con 0x7f649c15eed0 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f64a197a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0cf600 con 0x7f649c0b0810 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649b7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f649c0b0810 0x7f649c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649a7fc640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f649c0d03a0 0x7f649c0cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35480/0 (socket says 172.21.15.32:35480) 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649b7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f649c0b0810 0x7f649c0b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49520/0 (socket says 172.21.15.32:49520) 2024-02-17T00:37:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649b7fe640 1 -- 172.21.15.32:0/3194389636 learned_addr learned my addr 172.21.15.32:0/3194389636 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649b7fe640 1 -- 172.21.15.32:0/3194389636 >> v1:172.21.15.39:6789/0 conn(0x7f649c15eed0 legacy=0x7f649c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649b7fe640 1 -- 172.21.15.32:0/3194389636 >> v1:172.21.15.32:6789/0 conn(0x7f649c0d03a0 legacy=0x7f649c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.559+0000 7f649b7fe640 1 -- 172.21.15.32:0/3194389636 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0cc360 con 0x7f649c0b0810 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.560+0000 7f649b7fe640 1 --2- 172.21.15.32:0/3194389636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c0b1010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6494009e50 tx=0x7f649402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ae1add081499c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.560+0000 7f6499ffb640 1 -- 172.21.15.32:0/3194389636 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649402cb20 con 0x7f649c0b0810 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.560+0000 7f6499ffb640 1 -- 172.21.15.32:0/3194389636 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649402cc80 con 0x7f649c0b0810 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.560+0000 7f6499ffb640 1 -- 172.21.15.32:0/3194389636 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940343f0 con 0x7f649c0b0810 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 -- 172.21.15.32:0/3194389636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 msgr2=0x7f649c0b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 --2- 172.21.15.32:0/3194389636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c0b1010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6494009e50 tx=0x7f649402bf80 comp rx=0 tx=0).stop 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 -- 172.21.15.32:0/3194389636 shutdown_connections 2024-02-17T00:37:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 --2- 172.21.15.32:0/3194389636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c0b1010 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 -- 172.21.15.32:0/3194389636 >> 172.21.15.32:0/3194389636 conn(0x7f649c0b31a0 msgr2=0x7f649c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:28.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 -- 172.21.15.32:0/3194389636 shutdown_connections 2024-02-17T00:37:28.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.561+0000 7f64a197a640 1 -- 172.21.15.32:0/3194389636 wait complete. 2024-02-17T00:37:28.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.562+0000 7f64a197a640 1 Processor -- start 2024-02-17T00:37:28.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.562+0000 7f64a197a640 1 -- start start 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f64a197a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f64a197a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f649c0d03a0 0x7f649c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f64a197a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f649c15eed0 0x7f649c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f64a197a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c15ce80 con 0x7f649c0b0810 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f64a197a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c15d0a0 con 0x7f649c0d03a0 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f64a197a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c15d380 con 0x7f649c15eed0 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49534/0 (socket says 172.21.15.32:49534) 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 -- 172.21.15.32:0/2226016612 learned_addr learned my addr 172.21.15.32:0/2226016612 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649a7fc640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f649c0d03a0 0x7f649c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649b7fe640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f649c15eed0 0x7f649c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 -- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f649c15eed0 msgr2=0x7f649c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f649c15eed0 0x7f649c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 -- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f649c0d03a0 msgr2=0x7f649c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f649c0d03a0 0x7f649c159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.563+0000 7f649affd640 1 -- 172.21.15.32:0/2226016612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009b30 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.564+0000 7f649affd640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c15c4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c400 tx=0x7f648c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.564+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0052d0 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.564+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c005450 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.564+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c0c8780 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.564+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c007260 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.564+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c15a2b0 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.565+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c0680c0 con 0x7f649c0b0810 2024-02-17T00:37:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.565+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f648c0073c0 con 0x7f649c0b0810 2024-02-17T00:37:28.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.565+0000 7f6483fff640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f648806b810 0x7f648806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.566+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f648c089830 con 0x7f649c0b0810 2024-02-17T00:37:28.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.566+0000 7f649a7fc640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f648806b810 0x7f648806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.566+0000 7f649a7fc640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f648806b810 0x7f648806dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f649c0afef0 tx=0x7f6490000fb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.570+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f648c054020 con 0x7f649c0b0810 2024-02-17T00:37:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.751+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f649c068f60 con 0x7f649c0b0810 2024-02-17T00:37:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.751+0000 7f6483fff640 1 -- 172.21.15.32:0/2226016612 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f648c0576e0 con 0x7f649c0b0810 2024-02-17T00:37:28.754 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:28.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f648806b810 msgr2=0x7f648806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f648806b810 0x7f648806dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f649c0afef0 tx=0x7f6490000fb0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 msgr2=0x7f649c15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c15c4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c400 tx=0x7f648c00c8c0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 shutdown_connections 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f648806b810 0x7f648806dcd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f649c15eed0 0x7f649c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f649c0d03a0 0x7f649c159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 --2- 172.21.15.32:0/2226016612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f649c0b0810 0x7f649c15c4c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 >> 172.21.15.32:0/2226016612 conn(0x7f649c0b31a0 msgr2=0x7f649c0cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 shutdown_connections 2024-02-17T00:37:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.753+0000 7f64a197a640 1 -- 172.21.15.32:0/2226016612 wait complete. 2024-02-17T00:37:28.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:28.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.868+0000 7f4018dd0640 1 Processor -- start 2024-02-17T00:37:28.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.868+0000 7f4018dd0640 1 -- start start 2024-02-17T00:37:28.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4018dd0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f401415f1c0 0x7f401415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4018dd0640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140ce380 con 0x7f40140ce830 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4018dd0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401415f000 con 0x7f40140d3760 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4018dd0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40140ceff0 con 0x7f401415f1c0 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4011d9b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f401415f1c0 0x7f401415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4012d9d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f40140ce830 0x7f40140b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35488/0 (socket says 172.21.15.32:35488) 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.869+0000 7f4012d9d640 1 -- 172.21.15.32:0/3474919082 learned_addr learned my addr 172.21.15.32:0/3474919082 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.870+0000 7f4011d9b640 1 -- 172.21.15.32:0/3474919082 >> v1:172.21.15.39:6789/0 conn(0x7f40140d3760 legacy=0x7f40140d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.870+0000 7f4011d9b640 1 -- 172.21.15.32:0/3474919082 >> v1:172.21.15.32:6789/0 conn(0x7f40140ce830 legacy=0x7f40140b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.870+0000 7f401159a640 1 -- 172.21.15.32:0/3474919082 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580018922 0 0) 0x7f40140ce380 con 0x7f40140ce830 2024-02-17T00:37:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.870+0000 7f4011d9b640 1 -- 172.21.15.32:0/3474919082 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40140d2190 con 0x7f401415f1c0 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.870+0000 7f4011d9b640 1 --2- 172.21.15.32:0/3474919082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f401415f1c0 0x7f401415eac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0097a0 tx=0x7f3ffc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7a8f7346d65546 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f401159a640 1 -- 172.21.15.32:0/3474919082 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc030610 con 0x7f401415f1c0 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f401159a640 1 -- 172.21.15.32:0/3474919082 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc030770 con 0x7f401415f1c0 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f401159a640 1 -- 172.21.15.32:0/3474919082 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc030b00 con 0x7f401415f1c0 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 -- 172.21.15.32:0/3474919082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f401415f1c0 msgr2=0x7f401415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 --2- 172.21.15.32:0/3474919082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f401415f1c0 0x7f401415eac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0097a0 tx=0x7f3ffc02b960 comp rx=0 tx=0).stop 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 -- 172.21.15.32:0/3474919082 shutdown_connections 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 --2- 172.21.15.32:0/3474919082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f401415f1c0 0x7f401415eac0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 -- 172.21.15.32:0/3474919082 >> 172.21.15.32:0/3474919082 conn(0x7f4014072680 msgr2=0x7f4014072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 -- 172.21.15.32:0/3474919082 shutdown_connections 2024-02-17T00:37:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.871+0000 7f4018dd0640 1 -- 172.21.15.32:0/3474919082 wait complete. 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 Processor -- start 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 -- start start 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 0x7f4014158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40140d3760 0x7f40140cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f401415f1c0 0x7f40140ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401415a390 con 0x7f40140ce830 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141585f0 con 0x7f40140d3760 2024-02-17T00:37:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f4018dd0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40141579e0 con 0x7f401415f1c0 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f401259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 0x7f4014158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f401259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 0x7f4014158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49550/0 (socket says 172.21.15.32:49550) 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.873+0000 7f401259c640 1 -- 172.21.15.32:0/2672802278 learned_addr learned my addr 172.21.15.32:0/2672802278 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f4011d9b640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40140d3760 0x7f40140cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f4012d9d640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f401415f1c0 0x7f40140ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f401259c640 1 -- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f401415f1c0 msgr2=0x7f40140ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f401259c640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f401415f1c0 0x7f40140ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f401259c640 1 -- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40140d3760 msgr2=0x7f40140cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f401259c640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40140d3760 0x7f40140cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f401259c640 1 -- 172.21.15.32:0/2672802278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009400 con 0x7f40140ce830 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f401259c640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 0x7f4014158a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f400400c870 tx=0x7f400400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004003b70 con 0x7f40140ce830 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004003cf0 con 0x7f40140ce830 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4014157cc0 con 0x7f40140ce830 2024-02-17T00:37:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400aa90 con 0x7f40140ce830 2024-02-17T00:37:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.874+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4014158280 con 0x7f40140ce830 2024-02-17T00:37:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.875+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4014068f60 con 0x7f40140ce830 2024-02-17T00:37:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.875+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f400400abf0 con 0x7f40140ce830 2024-02-17T00:37:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.876+0000 7f400affd640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3ff406b810 0x7f3ff406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.876+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f400408a110 con 0x7f40140ce830 2024-02-17T00:37:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.876+0000 7f4011d9b640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3ff406b810 0x7f3ff406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.877+0000 7f4011d9b640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3ff406b810 0x7f3ff406dcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc036000 tx=0x7f3ffc03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:28.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:28.880+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4004054880 con 0x7f40140ce830 2024-02-17T00:37:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.059+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f401415efd0 con 0x7f40140ce830 2024-02-17T00:37:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.059+0000 7f400affd640 1 -- 172.21.15.32:0/2672802278 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4004057f40 con 0x7f40140ce830 2024-02-17T00:37:29.062 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3ff406b810 msgr2=0x7f3ff406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3ff406b810 0x7f3ff406dcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc036000 tx=0x7f3ffc03b040 comp rx=0 tx=0).stop 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 msgr2=0x7f4014158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 0x7f4014158a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f400400c870 tx=0x7f400400cd30 comp rx=0 tx=0).stop 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 shutdown_connections 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3ff406b810 0x7f3ff406dcd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f401415f1c0 0x7f40140ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40140d3760 0x7f40140cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 --2- 172.21.15.32:0/2672802278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40140ce830 0x7f4014158a80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 >> 172.21.15.32:0/2672802278 conn(0x7f4014072680 msgr2=0x7f4014072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 shutdown_connections 2024-02-17T00:37:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.061+0000 7f4018dd0640 1 -- 172.21.15.32:0/2672802278 wait complete. 2024-02-17T00:37:29.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:29.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.177+0000 7efd8833a640 1 Processor -- start 2024-02-17T00:37:29.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.177+0000 7efd8833a640 1 -- start start 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.177+0000 7efd8833a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd800b2c30 0x7efd800ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.177+0000 7efd8833a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd800d3760 0x7efd800d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd8833a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd800d1a40 con 0x7efd8015deb0 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd8833a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800d4130 con 0x7efd800b2c30 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd8833a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800b30c0 con 0x7efd800d3760 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd858d5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd800b2c30 0x7efd800ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd860d6640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7efd8015deb0 0x7efd800b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35496/0 (socket says 172.21.15.32:35496) 2024-02-17T00:37:29.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd860d6640 1 -- 172.21.15.32:0/2527179888 learned_addr learned my addr 172.21.15.32:0/2527179888 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:29.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd858d5640 1 -- 172.21.15.32:0/2527179888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd800d3760 msgr2=0x7efd800d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:29.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd858d5640 1 --2- 172.21.15.32:0/2527179888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd800d3760 0x7efd800d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd858d5640 1 -- 172.21.15.32:0/2527179888 >> v1:172.21.15.32:6789/0 conn(0x7efd8015deb0 legacy=0x7efd800b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd858d5640 1 -- 172.21.15.32:0/2527179888 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800d1d20 con 0x7efd800b2c30 2024-02-17T00:37:29.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.178+0000 7efd850d4640 1 -- 172.21.15.32:0/2527179888 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461940056 0 0) 0x7efd800d1a40 con 0x7efd8015deb0 2024-02-17T00:37:29.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd858d5640 1 --2- 172.21.15.32:0/2527179888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800b2c30 0x7efd800ce030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efd700097a0 tx=0x7efd7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3d80351665925c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:29.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd850d4640 1 -- 172.21.15.32:0/2527179888 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70031830 con 0x7efd800b2c30 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd850d4640 1 -- 172.21.15.32:0/2527179888 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70031990 con 0x7efd800b2c30 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd850d4640 1 -- 172.21.15.32:0/2527179888 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70031d20 con 0x7efd800b2c30 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd8833a640 1 -- 172.21.15.32:0/2527179888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800b2c30 msgr2=0x7efd800ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd8833a640 1 --2- 172.21.15.32:0/2527179888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800b2c30 0x7efd800ce030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efd700097a0 tx=0x7efd7002b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd8833a640 1 -- 172.21.15.32:0/2527179888 shutdown_connections 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd8833a640 1 --2- 172.21.15.32:0/2527179888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800b2c30 0x7efd800ce030 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd8833a640 1 --2- 172.21.15.32:0/2527179888 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd800d3760 0x7efd800d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.179+0000 7efd8833a640 1 -- 172.21.15.32:0/2527179888 >> 172.21.15.32:0/2527179888 conn(0x7efd800726b0 msgr2=0x7efd80072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.180+0000 7efd8833a640 1 -- 172.21.15.32:0/2527179888 shutdown_connections 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.180+0000 7efd8833a640 1 -- 172.21.15.32:0/2527179888 wait complete. 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 Processor -- start 2024-02-17T00:37:29.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 -- start start 2024-02-17T00:37:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd800b2c30 0x7efd80157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 0x7efd80158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8015deb0 0x7efd800b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8015ecd0 con 0x7efd800d3760 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80157ca0 con 0x7efd800b2c30 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.181+0000 7efd8833a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd80161200 con 0x7efd8015deb0 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 0x7efd80158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 0x7efd80158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49570/0 (socket says 172.21.15.32:49570) 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 -- 172.21.15.32:0/2111869896 learned_addr learned my addr 172.21.15.32:0/2111869896 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd860d6640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd800b2c30 0x7efd80157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd868d7640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8015deb0 0x7efd800b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 -- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8015deb0 msgr2=0x7efd800b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8015deb0 0x7efd800b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 -- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd800b2c30 msgr2=0x7efd80157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd800b2c30 0x7efd80157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 -- 172.21.15.32:0/2111869896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009400 con 0x7efd800d3760 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd860d6640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd800b2c30 0x7efd80157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd858d5640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 0x7efd80158630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efd700098c0 tx=0x7efd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7003ba70 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7003bbf0 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8015e330 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700453f0 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.182+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8015e8f0 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.183+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8015ee10 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.184+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7efd7004e450 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.184+0000 7efd76ffd640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efd6406b810 0x7efd6406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.184+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7efd700ac790 con 0x7efd800d3760 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.184+0000 7efd860d6640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efd6406b810 0x7efd6406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.185+0000 7efd860d6640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efd6406b810 0x7efd6406dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000f60 tx=0x7efd7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:29.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.188+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd8015ee10 con 0x7efd800d3760 2024-02-17T00:37:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.369+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd8015ee10 con 0x7efd800d3760 2024-02-17T00:37:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.369+0000 7efd76ffd640 1 -- 172.21.15.32:0/2111869896 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd8015ee10 con 0x7efd800d3760 2024-02-17T00:37:29.372 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.371+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efd6406b810 msgr2=0x7efd6406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.371+0000 7efd8833a640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efd6406b810 0x7efd6406dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000f60 tx=0x7efd7c009040 comp rx=0 tx=0).stop 2024-02-17T00:37:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.371+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 msgr2=0x7efd80158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.371+0000 7efd8833a640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 0x7efd80158630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efd700098c0 tx=0x7efd700046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 shutdown_connections 2024-02-17T00:37:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7efd6406b810 0x7efd6406dcd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8015deb0 0x7efd800b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd800d3760 0x7efd80158630 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 --2- 172.21.15.32:0/2111869896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd800b2c30 0x7efd80157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 >> 172.21.15.32:0/2111869896 conn(0x7efd800726b0 msgr2=0x7efd800ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 shutdown_connections 2024-02-17T00:37:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.372+0000 7efd8833a640 1 -- 172.21.15.32:0/2111869896 wait complete. 2024-02-17T00:37:29.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T00:37:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 Processor -- start 2024-02-17T00:37:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 -- start start 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 0x7f2448161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f24481622b0 0x7f24480ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244815e8a0 con 0x7f244815da60 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448161640 con 0x7f24481622b0 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.486+0000 7f244d13e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244815eb80 con 0x7f24480d0aa0 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f243ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 0x7f2448161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f244759e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f24481622b0 0x7f24480ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f2446d9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f244815da60 0x7f244815de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:57374/0 (socket says 172.21.15.32:57374) 2024-02-17T00:37:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f243ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 0x7f2448161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:57780/0 (socket says 172.21.15.32:57780) 2024-02-17T00:37:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f2446d9d640 1 -- 172.21.15.32:0/1259057703 learned_addr learned my addr 172.21.15.32:0/1259057703 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f244759e640 1 -- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 msgr2=0x7f2448161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f244759e640 1 --2- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 0x7f2448161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f244759e640 1 -- 172.21.15.32:0/1259057703 >> v1:172.21.15.39:6789/0 conn(0x7f244815da60 legacy=0x7f244815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f244759e640 1 -- 172.21.15.32:0/1259057703 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244815ee60 con 0x7f24481622b0 2024-02-17T00:37:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.487+0000 7f243ffff640 1 --2- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 0x7f2448161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.488+0000 7f244759e640 1 --2- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480ce520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2440009d90 tx=0x7f244002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6908fa63f4e8216 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.488+0000 7f244659c640 1 -- 172.21.15.32:0/1259057703 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244002cbc0 con 0x7f24481622b0 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.488+0000 7f244659c640 1 -- 172.21.15.32:0/1259057703 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244002cd20 con 0x7f24481622b0 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.488+0000 7f244659c640 1 -- 172.21.15.32:0/1259057703 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440034660 con 0x7f24481622b0 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 -- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 msgr2=0x7f24480ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 --2- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480ce520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2440009d90 tx=0x7f244002be10 comp rx=0 tx=0).stop 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 -- 172.21.15.32:0/1259057703 shutdown_connections 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 --2- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480ce520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 --2- 172.21.15.32:0/1259057703 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f24480d0aa0 0x7f2448161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 -- 172.21.15.32:0/1259057703 >> 172.21.15.32:0/1259057703 conn(0x7f244806bfe0 msgr2=0x7f244806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 -- 172.21.15.32:0/1259057703 shutdown_connections 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.489+0000 7f244d13e640 1 -- 172.21.15.32:0/1259057703 wait complete. 2024-02-17T00:37:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.490+0000 7f244d13e640 1 Processor -- start 2024-02-17T00:37:29.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.490+0000 7f244d13e640 1 -- start start 2024-02-17T00:37:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244d13e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 0x7f24481f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244d13e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f244815da60 0x7f24481f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244d13e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244d13e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24481f6570 con 0x7f24480d0aa0 2024-02-17T00:37:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244d13e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480b3320 con 0x7f24481622b0 2024-02-17T00:37:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244d13e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480b35c0 con 0x7f244815da60 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 0x7f24481f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 0x7f24481f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49586/0 (socket says 172.21.15.32:49586) 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 -- 172.21.15.32:0/2251027154 learned_addr learned my addr 172.21.15.32:0/2251027154 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f244759e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f243ffff640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f244815da60 0x7f24481f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 -- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f244815da60 msgr2=0x7f24481f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f244815da60 0x7f24481f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 -- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 msgr2=0x7f24480cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 -- 172.21.15.32:0/2251027154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430009400 con 0x7f24480d0aa0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f2446d9d640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 0x7f24481f3160 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f243800c400 tx=0x7f243800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.491+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438005ce0 con 0x7f24480d0aa0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.492+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438005e40 con 0x7f24480d0aa0 2024-02-17T00:37:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.492+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2440009a70 con 0x7f24480d0aa0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.492+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380072d0 con 0x7f24480d0aa0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.492+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24480b3b80 con 0x7f24480d0aa0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.492+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24480680c0 con 0x7f24480d0aa0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.493+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2438007430 con 0x7f24480d0aa0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.493+0000 7f243f7fe640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f242806b840 0x7f242806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.493+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f2438089a90 con 0x7f24480d0aa0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.494+0000 7f243ffff640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f242806b840 0x7f242806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.494+0000 7f243ffff640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f242806b840 0x7f242806dd00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2430009cd0 tx=0x7f2430009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:29.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.498+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f24380541f0 con 0x7f24480d0aa0 2024-02-17T00:37:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.690+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2448068fd0 con 0x7f24480d0aa0 2024-02-17T00:37:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.690+0000 7f243f7fe640 1 -- 172.21.15.32:0/2251027154 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2438017080 con 0x7f24480d0aa0 2024-02-17T00:37:29.694 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f242806b840 msgr2=0x7f242806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f242806b840 0x7f242806dd00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2430009cd0 tx=0x7f2430009190 comp rx=0 tx=0).stop 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 msgr2=0x7f24481f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 0x7f24481f3160 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f243800c400 tx=0x7f243800c8c0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 shutdown_connections 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24481622b0 0x7f24480cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f242806b840 0x7f242806dd00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f244815da60 0x7f24481f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 --2- 172.21.15.32:0/2251027154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24480d0aa0 0x7f24481f3160 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 >> 172.21.15.32:0/2251027154 conn(0x7f244806bfe0 msgr2=0x7f24480d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:29.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 shutdown_connections 2024-02-17T00:37:29.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:29.692+0000 7f244d13e640 1 -- 172.21.15.32:0/2251027154 wait complete. 2024-02-17T00:37:29.706 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-17T00:37:29.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:29.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-17T00:37:29.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:37:29.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:29.734 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T00:37:29.789 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:29.789 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:29.808 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:29.808 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:29.866 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:29.866 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:29.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:30.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.024+0000 7f01acea3640 1 Processor -- start 2024-02-17T00:37:30.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.024+0000 7f01acea3640 1 -- start start 2024-02-17T00:37:30.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01acea3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 0x7f01a8161630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01acea3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a80b9250 0x7f01a80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01acea3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80d1de0 con 0x7f01a815dd00 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01acea3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a8162560 con 0x7f01a815d920 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01acea3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8161fa0 con 0x7f01a80b9250 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01a659c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 0x7f01a8161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f019ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a80b9250 0x7f01a80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01a659c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 0x7f01a8161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:50708/0 (socket says 172.21.15.32:50708) 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01a6d9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f01a815dd00 0x7f01a80b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:57380/0 (socket says 172.21.15.32:57380) 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f01a659c640 1 -- 172.21.15.32:0/1841885266 learned_addr learned my addr 172.21.15.32:0/1841885266 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f019ffff640 1 -- 172.21.15.32:0/1841885266 >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 msgr2=0x7f01a8161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f019ffff640 1 --2- 172.21.15.32:0/1841885266 >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 0x7f01a8161630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.025+0000 7f019ffff640 1 -- 172.21.15.32:0/1841885266 >> v1:172.21.15.39:6789/0 conn(0x7f01a815dd00 legacy=0x7f01a80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.026+0000 7f019ffff640 1 -- 172.21.15.32:0/1841885266 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8162280 con 0x7f01a80b9250 2024-02-17T00:37:30.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.026+0000 7f01a659c640 1 --2- 172.21.15.32:0/1841885266 >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 0x7f01a8161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.026+0000 7f019ffff640 1 --2- 172.21.15.32:0/1841885266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a80b9250 0x7f01a80ce620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01900097a0 tx=0x7f019002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692f008cf4e003e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.026+0000 7f01a5d9b640 1 -- 172.21.15.32:0/1841885266 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019002e070 con 0x7f01a80b9250 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01a5d9b640 1 -- 172.21.15.32:0/1841885266 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900315a0 con 0x7f01a80b9250 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01a5d9b640 1 -- 172.21.15.32:0/1841885266 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190031930 con 0x7f01a80b9250 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 -- 172.21.15.32:0/1841885266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a80b9250 msgr2=0x7f01a80ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 --2- 172.21.15.32:0/1841885266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a80b9250 0x7f01a80ce620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01900097a0 tx=0x7f019002b840 comp rx=0 tx=0).stop 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 -- 172.21.15.32:0/1841885266 shutdown_connections 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 --2- 172.21.15.32:0/1841885266 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a80b9250 0x7f01a80ce620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 --2- 172.21.15.32:0/1841885266 >> v2:172.21.15.39:3300/0 conn(0x7f01a815d920 0x7f01a8161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 -- 172.21.15.32:0/1841885266 >> 172.21.15.32:0/1841885266 conn(0x7f01a806bfe0 msgr2=0x7f01a806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 -- 172.21.15.32:0/1841885266 shutdown_connections 2024-02-17T00:37:30.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.027+0000 7f01acea3640 1 -- 172.21.15.32:0/1841885266 wait complete. 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.028+0000 7f01acea3640 1 Processor -- start 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.028+0000 7f01acea3640 1 -- start start 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01acea3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01a80b9250 0x7f01a80cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01acea3640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a815d920 0x7f01a80c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01acea3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 0x7f01a8144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01acea3640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80cd910 con 0x7f01a815dd00 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01acea3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c9cf0 con 0x7f01a80b9250 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01acea3640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c8710 con 0x7f01a815d920 2024-02-17T00:37:30.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 0x7f01a8144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 0x7f01a8144b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49592/0 (socket says 172.21.15.32:49592) 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01a659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01a80b9250 0x7f01a80cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f01a6d9d640 1 -- 172.21.15.32:0/2011244811 learned_addr learned my addr 172.21.15.32:0/2011244811 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.029+0000 7f019ffff640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a815d920 0x7f01a80c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a6d9d640 1 -- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a815d920 msgr2=0x7f01a80c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a6d9d640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a815d920 0x7f01a80c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a6d9d640 1 -- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01a80b9250 msgr2=0x7f01a80cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a6d9d640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01a80b9250 0x7f01a80cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a6d9d640 1 -- 172.21.15.32:0/2011244811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980094d0 con 0x7f01a815dd00 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a659c640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01a80b9250 0x7f01a80cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01a6d9d640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 0x7f01a8144b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c730 tx=0x7f01a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000ce40 con 0x7f01a815dd00 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000a640 con 0x7f01a815dd00 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000a9f0 con 0x7f01a815dd00 2024-02-17T00:37:30.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0190009400 con 0x7f01a815dd00 2024-02-17T00:37:30.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.030+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80c8cd0 con 0x7f01a815dd00 2024-02-17T00:37:30.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.031+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8068fd0 con 0x7f01a815dd00 2024-02-17T00:37:30.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.032+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f01a000ab50 con 0x7f01a815dd00 2024-02-17T00:37:30.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.032+0000 7f019effd640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f018806b810 0x7f018806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.032+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f01a0089c30 con 0x7f01a815dd00 2024-02-17T00:37:30.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.032+0000 7f01a659c640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f018806b810 0x7f018806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.033+0000 7f01a659c640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f018806b810 0x7f018806dcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0198006ca0 tx=0x7f0198009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.036+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01a0054300 con 0x7f01a815dd00 2024-02-17T00:37:30.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.219+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01a80d3250 con 0x7f01a815dd00 2024-02-17T00:37:30.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.220+0000 7f019effd640 1 -- 172.21.15.32:0/2011244811 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f01a0017070 con 0x7f01a815dd00 2024-02-17T00:37:30.223 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:30.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f018806b810 msgr2=0x7f018806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f018806b810 0x7f018806dcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0198006ca0 tx=0x7f0198009240 comp rx=0 tx=0).stop 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 msgr2=0x7f01a8144b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 0x7f01a8144b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c730 tx=0x7f01a000cbf0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 shutdown_connections 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01a815dd00 0x7f01a8144b20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f018806b810 0x7f018806dcd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f01a815d920 0x7f01a80c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 --2- 172.21.15.32:0/2011244811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01a80b9250 0x7f01a80cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 >> 172.21.15.32:0/2011244811 conn(0x7f01a806bfe0 msgr2=0x7f01a80d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 shutdown_connections 2024-02-17T00:37:30.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.222+0000 7f01acea3640 1 -- 172.21.15.32:0/2011244811 wait complete. 2024-02-17T00:37:30.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:30.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:30.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.338+0000 7fa5da513640 1 Processor -- start 2024-02-17T00:37:30.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.338+0000 7fa5da513640 1 -- start start 2024-02-17T00:37:30.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5da513640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa5d415deb0 0x7fa5d40b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5da513640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d40ce030 0x7fa5d40b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5da513640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d40b6f20 0x7fa5d40d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5da513640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d40ce4c0 con 0x7fa5d40ce030 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5da513640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d40d1a40 con 0x7fa5d415deb0 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5da513640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40d1d20 con 0x7fa5d40b6f20 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d40ce030 0x7fa5d40b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d40ce030 0x7fa5d40b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49604/0 (socket says 172.21.15.32:49604) 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 -- 172.21.15.32:0/2397184 learned_addr learned my addr 172.21.15.32:0/2397184 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d3fff640 1 --2- 172.21.15.32:0/2397184 >> v2:172.21.15.39:3300/0 conn(0x7fa5d415deb0 0x7fa5d40b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d8ab0640 1 --2- 172.21.15.32:0/2397184 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d40b6f20 0x7fa5d40d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 -- 172.21.15.32:0/2397184 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d40b6f20 msgr2=0x7fa5d40d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 --2- 172.21.15.32:0/2397184 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d40b6f20 0x7fa5d40d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 -- 172.21.15.32:0/2397184 >> v2:172.21.15.39:3300/0 conn(0x7fa5d415deb0 msgr2=0x7fa5d40b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.339+0000 7fa5d37fe640 1 --2- 172.21.15.32:0/2397184 >> v2:172.21.15.39:3300/0 conn(0x7fa5d415deb0 0x7fa5d40b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.340+0000 7fa5d37fe640 1 -- 172.21.15.32:0/2397184 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40d2000 con 0x7fa5d40ce030 2024-02-17T00:37:30.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.340+0000 7fa5d37fe640 1 --2- 172.21.15.32:0/2397184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b69e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40d43f0 tx=0x7fa5c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c470d73286c06616 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.340+0000 7fa5d2ffd640 1 -- 172.21.15.32:0/2397184 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8031870 con 0x7fa5d40ce030 2024-02-17T00:37:30.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.340+0000 7fa5d2ffd640 1 -- 172.21.15.32:0/2397184 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c80319d0 con 0x7fa5d40ce030 2024-02-17T00:37:30.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.340+0000 7fa5d2ffd640 1 -- 172.21.15.32:0/2397184 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8031d60 con 0x7fa5d40ce030 2024-02-17T00:37:30.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 -- 172.21.15.32:0/2397184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40ce030 msgr2=0x7fa5d40b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 --2- 172.21.15.32:0/2397184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b69e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40d43f0 tx=0x7fa5c802b910 comp rx=0 tx=0).stop 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 -- 172.21.15.32:0/2397184 shutdown_connections 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 --2- 172.21.15.32:0/2397184 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d40b6f20 0x7fa5d40d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 --2- 172.21.15.32:0/2397184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b69e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 --2- 172.21.15.32:0/2397184 >> v2:172.21.15.39:3300/0 conn(0x7fa5d415deb0 0x7fa5d40b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 -- 172.21.15.32:0/2397184 >> 172.21.15.32:0/2397184 conn(0x7fa5d40726b0 msgr2=0x7fa5d4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 -- 172.21.15.32:0/2397184 shutdown_connections 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.341+0000 7fa5da513640 1 -- 172.21.15.32:0/2397184 wait complete. 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.342+0000 7fa5da513640 1 Processor -- start 2024-02-17T00:37:30.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.342+0000 7fa5da513640 1 -- start start 2024-02-17T00:37:30.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5da513640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 0x7fa5d4160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5da513640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5da513640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d415deb0 0x7fa5d40b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5da513640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40aa230 con 0x7fa5d40b6f20 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5da513640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d41567e0 con 0x7fa5d40ce030 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5da513640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40b36c0 con 0x7fa5d415deb0 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 0x7fa5d4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 0x7fa5d4160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49606/0 (socket says 172.21.15.32:49606) 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 -- 172.21.15.32:0/4081604560 learned_addr learned my addr 172.21.15.32:0/4081604560 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d37fe640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d8ab0640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d415deb0 0x7fa5d40b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 -- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d415deb0 msgr2=0x7fa5d40b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d415deb0 0x7fa5d40b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 -- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5d40ce030 msgr2=0x7fa5d40b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.343+0000 7fa5d3fff640 1 -- 172.21.15.32:0/4081604560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80094d0 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.344+0000 7fa5d3fff640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 0x7fa5d4160300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400e870 tx=0x7fa5c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.344+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40094f0 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.344+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c400c8e0 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.344+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400cc90 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.344+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d4160c10 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.344+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d40b3350 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.345+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d40b2ea0 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.345+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa5c4013470 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.346+0000 7fa5d0ff9640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5c006b810 0x7fa5c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.346+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fa5c408a510 con 0x7fa5d40b6f20 2024-02-17T00:37:30.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.346+0000 7fa5d37fe640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5c006b810 0x7fa5c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.346+0000 7fa5d37fe640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5c006b810 0x7fa5c006dcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8036000 tx=0x7fa5c803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.350+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5c4054c70 con 0x7fa5d40b6f20 2024-02-17T00:37:30.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.531+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5d4068f60 con 0x7fa5d40b6f20 2024-02-17T00:37:30.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.531+0000 7fa5d0ff9640 1 -- 172.21.15.32:0/4081604560 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5c4058330 con 0x7fa5d40b6f20 2024-02-17T00:37:30.534 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.533+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5c006b810 msgr2=0x7fa5c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5c006b810 0x7fa5c006dcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8036000 tx=0x7fa5c803c040 comp rx=0 tx=0).stop 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 msgr2=0x7fa5d4160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 0x7fa5d4160300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400e870 tx=0x7fa5c400ed30 comp rx=0 tx=0).stop 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 shutdown_connections 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5c006b810 0x7fa5c006dcd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa5d415deb0 0x7fa5d40b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5d40ce030 0x7fa5d40b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 --2- 172.21.15.32:0/4081604560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40b6f20 0x7fa5d4160300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 >> 172.21.15.32:0/4081604560 conn(0x7fa5d40726b0 msgr2=0x7fa5d40c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 shutdown_connections 2024-02-17T00:37:30.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.534+0000 7fa5da513640 1 -- 172.21.15.32:0/4081604560 wait complete. 2024-02-17T00:37:30.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:30.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.649+0000 7f5dc338a640 1 Processor -- start 2024-02-17T00:37:30.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.649+0000 7f5dc338a640 1 -- start start 2024-02-17T00:37:30.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc338a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc338a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5dbc0b9130 0x7f5dbc0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc338a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5dbc0b9590 0x7f5dbc0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc338a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc0d10a0 con 0x7f5dbc0b9590 2024-02-17T00:37:30.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc338a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc0b7ef0 con 0x7f5dbc0b9130 2024-02-17T00:37:30.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc338a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0b81d0 con 0x7f5dbc0d0780 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5dbc0b9590 0x7f5dbc0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5dbc0b9590 0x7f5dbc0d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49612/0 (socket says 172.21.15.32:49612) 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 -- 172.21.15.32:0/772193879 learned_addr learned my addr 172.21.15.32:0/772193879 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc0925640 1 --2- 172.21.15.32:0/772193879 >> v2:172.21.15.39:3300/0 conn(0x7f5dbc0b9130 0x7f5dbc0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1126640 1 --2- 172.21.15.32:0/772193879 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 -- 172.21.15.32:0/772193879 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 msgr2=0x7f5dbc0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 --2- 172.21.15.32:0/772193879 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc0d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 -- 172.21.15.32:0/772193879 >> v2:172.21.15.39:3300/0 conn(0x7f5dbc0b9130 msgr2=0x7f5dbc0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 --2- 172.21.15.32:0/772193879 >> v2:172.21.15.39:3300/0 conn(0x7f5dbc0b9130 0x7f5dbc0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.650+0000 7f5dc1927640 1 -- 172.21.15.32:0/772193879 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0b84b0 con 0x7f5dbc0b9590 2024-02-17T00:37:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.651+0000 7f5dc1927640 1 --2- 172.21.15.32:0/772193879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc0d2170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0d4830 tx=0x7f5dac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f059a10b5ab673 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.651+0000 7f5dbbfff640 1 -- 172.21.15.32:0/772193879 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac031870 con 0x7f5dbc0b9590 2024-02-17T00:37:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.651+0000 7f5dbbfff640 1 -- 172.21.15.32:0/772193879 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac0319d0 con 0x7f5dbc0b9590 2024-02-17T00:37:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.651+0000 7f5dbbfff640 1 -- 172.21.15.32:0/772193879 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac031d60 con 0x7f5dbc0b9590 2024-02-17T00:37:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 -- 172.21.15.32:0/772193879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9590 msgr2=0x7f5dbc0d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 --2- 172.21.15.32:0/772193879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc0d2170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0d4830 tx=0x7f5dac02b910 comp rx=0 tx=0).stop 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 -- 172.21.15.32:0/772193879 shutdown_connections 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 --2- 172.21.15.32:0/772193879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc0d2170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 --2- 172.21.15.32:0/772193879 >> v2:172.21.15.39:3300/0 conn(0x7f5dbc0b9130 0x7f5dbc0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 --2- 172.21.15.32:0/772193879 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 -- 172.21.15.32:0/772193879 >> 172.21.15.32:0/772193879 conn(0x7f5dbc0726b0 msgr2=0x7f5dbc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 -- 172.21.15.32:0/772193879 shutdown_connections 2024-02-17T00:37:30.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.652+0000 7f5dc338a640 1 -- 172.21.15.32:0/772193879 wait complete. 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.653+0000 7f5dc338a640 1 Processor -- start 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.653+0000 7f5dc338a640 1 -- start start 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc338a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 0x7f5dbc0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc338a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc338a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc1f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc338a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0ca170 con 0x7f5dbc0b9130 2024-02-17T00:37:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc338a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc1f75f0 con 0x7f5dbc0b9590 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc338a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0c76f0 con 0x7f5dbc0d0780 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 0x7f5dbc0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 0x7f5dbc0c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49624/0 (socket says 172.21.15.32:49624) 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 -- 172.21.15.32:0/1073879581 learned_addr learned my addr 172.21.15.32:0/1073879581 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc0925640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1927640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc1f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 -- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 msgr2=0x7f5dbc1f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc1f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 -- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dbc0b9590 msgr2=0x7f5dbc154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1126640 1 -- 172.21.15.32:0/1073879581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0094d0 con 0x7f5dbc0b9130 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.654+0000 7f5dc1927640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.655+0000 7f5dc1126640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 0x7f5dbc0c9c30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5db400d5f0 tx=0x7f5db400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.655+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db40125f0 con 0x7f5dbc0b9130 2024-02-17T00:37:30.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.655+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4012750 con 0x7f5dbc0b9130 2024-02-17T00:37:30.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.655+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc0c79d0 con 0x7f5dbc0b9130 2024-02-17T00:37:30.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.655+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4012b00 con 0x7f5dbc0b9130 2024-02-17T00:37:30.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.655+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc0c7f90 con 0x7f5dbc0b9130 2024-02-17T00:37:30.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.656+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc0685d0 con 0x7f5dbc0b9130 2024-02-17T00:37:30.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.656+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5db4012c60 con 0x7f5dbc0b9130 2024-02-17T00:37:30.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.657+0000 7f5db9ffb640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5da806b810 0x7f5da806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.657+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5db408aa50 con 0x7f5dbc0b9130 2024-02-17T00:37:30.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.657+0000 7f5dc0925640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5da806b810 0x7f5da806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.658+0000 7f5dc0925640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5da806b810 0x7f5da806dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0c6c70 tx=0x7f5db00039f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.661+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5db4055100 con 0x7f5dbc0b9130 2024-02-17T00:37:30.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.843+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5dbc068f60 con 0x7f5dbc0b9130 2024-02-17T00:37:30.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.843+0000 7f5db9ffb640 1 -- 172.21.15.32:0/1073879581 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5db40587c0 con 0x7f5dbc0b9130 2024-02-17T00:37:30.847 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5da806b810 msgr2=0x7f5da806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5da806b810 0x7f5da806dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0c6c70 tx=0x7f5db00039f0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 msgr2=0x7f5dbc0c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 0x7f5dbc0c9c30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5db400d5f0 tx=0x7f5db400dab0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 shutdown_connections 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5da806b810 0x7f5da806dcd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5dbc0d0780 0x7f5dbc1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dbc0b9590 0x7f5dbc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 --2- 172.21.15.32:0/1073879581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dbc0b9130 0x7f5dbc0c9c30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 >> 172.21.15.32:0/1073879581 conn(0x7f5dbc0726b0 msgr2=0x7f5dbc0b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 shutdown_connections 2024-02-17T00:37:30.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.846+0000 7f5dc338a640 1 -- 172.21.15.32:0/1073879581 wait complete. 2024-02-17T00:37:30.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:30.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.961+0000 7fdbc7db9640 1 Processor -- start 2024-02-17T00:37:30.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.961+0000 7fdbc7db9640 1 -- start start 2024-02-17T00:37:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc7db9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdbc0161200 0x7fdbc00cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc7db9640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc01615e0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc7db9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc009add0 con 0x7fdbc009a9a0 2024-02-17T00:37:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc7db9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc006c9f0 con 0x7fdbc0161200 2024-02-17T00:37:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc5354640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdbc00d0a00 0x7fdbc009a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35502/0 (socket says 172.21.15.32:35502) 2024-02-17T00:37:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc5354640 1 -- 172.21.15.32:0/671265719 learned_addr learned my addr 172.21.15.32:0/671265719 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc5b55640 1 --2- 172.21.15.32:0/671265719 >> v2:172.21.15.39:3300/0 conn(0x7fdbc0161200 0x7fdbc00cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517652703 0 0) 0x7fdbc01615e0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbac003520 con 0x7fdbc00d0a00 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255347997 0 0) 0x7fdbc009add0 con 0x7fdbc009a9a0 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc01615e0 con 0x7fdbc009a9a0 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc5b55640 1 -- 172.21.15.32:0/671265719 >> v1:172.21.15.39:6789/0 conn(0x7fdbc009a9a0 legacy=0x7fdbc00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc5b55640 1 -- 172.21.15.32:0/671265719 >> v1:172.21.15.32:6789/0 conn(0x7fdbc00d0a00 legacy=0x7fdbc009a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3269435514 0 0) 0x7fdbac003520 con 0x7fdbc00d0a00 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.962+0000 7fdbc5b55640 1 -- 172.21.15.32:0/671265719 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc006ccd0 con 0x7fdbc0161200 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.963+0000 7fdbc5b55640 1 --2- 172.21.15.32:0/671265719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0161200 0x7fdbc00cbd00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0097a0 tx=0x7fdbbc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74c0abc25797edba server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.963+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc02f050 con 0x7fdbc0161200 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.963+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc031500 con 0x7fdbc0161200 2024-02-17T00:37:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.963+0000 7fdbc4b53640 1 -- 172.21.15.32:0/671265719 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0001670 con 0x7fdbc0161200 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 -- 172.21.15.32:0/671265719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0161200 msgr2=0x7fdbc00cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/671265719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0161200 0x7fdbc00cbd00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0097a0 tx=0x7fdbbc02b820 comp rx=0 tx=0).stop 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 -- 172.21.15.32:0/671265719 shutdown_connections 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/671265719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0161200 0x7fdbc00cbd00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 -- 172.21.15.32:0/671265719 >> 172.21.15.32:0/671265719 conn(0x7fdbc00b31a0 msgr2=0x7fdbc00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 -- 172.21.15.32:0/671265719 shutdown_connections 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.964+0000 7fdbc7db9640 1 -- 172.21.15.32:0/671265719 wait complete. 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.965+0000 7fdbc7db9640 1 Processor -- start 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.965+0000 7fdbc7db9640 1 -- start start 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc7db9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc009a9a0 0x7fdbc00c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc7db9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 0x7fdbc00c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc7db9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdbc0161200 0x7fdbc0150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc7db9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00c60d0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc7db9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00c51e0 con 0x7fdbc009a9a0 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc7db9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00c54c0 con 0x7fdbc0161200 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 0x7fdbc00c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 0x7fdbc00c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49638/0 (socket says 172.21.15.32:49638) 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 -- 172.21.15.32:0/2898767296 learned_addr learned my addr 172.21.15.32:0/2898767296 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5b55640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc009a9a0 0x7fdbc00c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc6356640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdbc0161200 0x7fdbc0150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 -- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdbc0161200 msgr2=0x7fdbc0150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdbc0161200 0x7fdbc0150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 -- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc009a9a0 msgr2=0x7fdbc00c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc009a9a0 0x7fdbc00c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.966+0000 7fdbc5354640 1 -- 172.21.15.32:0/2898767296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc009400 con 0x7fdbc00d0a00 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.967+0000 7fdbc5354640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 0x7fdbc00c7c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000fd0 tx=0x7fdbb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.967+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0005ad0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.967+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0005c30 con 0x7fdbc00d0a00 2024-02-17T00:37:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.967+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc00c57a0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.967+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0007070 con 0x7fdbc00d0a00 2024-02-17T00:37:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.967+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc00c5d60 con 0x7fdbc00d0a00 2024-02-17T00:37:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.968+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc00680c0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.968+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdbb00071d0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.969+0000 7fdbb67fc640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdba406b810 0x7fdba406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.969+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fdbb0089af0 con 0x7fdbc00d0a00 2024-02-17T00:37:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.969+0000 7fdbc5b55640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdba406b810 0x7fdba406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.969+0000 7fdbc5b55640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdba406b810 0x7fdba406dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc035000 tx=0x7fdbbc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:30.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:30.973+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdbb0054250 con 0x7fdbc00d0a00 2024-02-17T00:37:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.151+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbc0068f60 con 0x7fdbc00d0a00 2024-02-17T00:37:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.151+0000 7fdbb67fc640 1 -- 172.21.15.32:0/2898767296 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbb00170a0 con 0x7fdbc00d0a00 2024-02-17T00:37:31.154 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdba406b810 msgr2=0x7fdba406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdba406b810 0x7fdba406dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc035000 tx=0x7fdbbc008030 comp rx=0 tx=0).stop 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 msgr2=0x7fdbc00c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 0x7fdbc00c7c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000fd0 tx=0x7fdbb000cbc0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 shutdown_connections 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fdba406b810 0x7fdba406dcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fdbc0161200 0x7fdbc0150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbc00d0a00 0x7fdbc00c7c80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 --2- 172.21.15.32:0/2898767296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc009a9a0 0x7fdbc00c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 >> 172.21.15.32:0/2898767296 conn(0x7fdbc00b31a0 msgr2=0x7fdbc00ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 shutdown_connections 2024-02-17T00:37:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.153+0000 7fdbc7db9640 1 -- 172.21.15.32:0/2898767296 wait complete. 2024-02-17T00:37:31.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.268+0000 7f62c189a640 1 Processor -- start 2024-02-17T00:37:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.268+0000 7f62c189a640 1 -- start start 2024-02-17T00:37:31.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.269+0000 7f62c189a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0ccf50 0x7f62bc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.269+0000 7f62c189a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62bc0cafb0 0x7f62bc0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.269+0000 7f62c189a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc15bd80 con 0x7f62bc15a850 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.269+0000 7f62c189a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0cd900 con 0x7f62bc0cafb0 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.269+0000 7f62c189a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15ac30 con 0x7f62bc0ccf50 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.269+0000 7f62bb7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62bc0cafb0 0x7f62bc0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62bb7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62bc0cafb0 0x7f62bc0cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:50766/0 (socket says 172.21.15.32:50766) 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62bb7fe640 1 -- 172.21.15.32:0/3470197039 learned_addr learned my addr 172.21.15.32:0/3470197039 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62ba7fc640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0ccf50 0x7f62bc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62bb7fe640 1 -- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0ccf50 msgr2=0x7f62bc0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62bb7fe640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0ccf50 0x7f62bc0cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62bb7fe640 1 -- 172.21.15.32:0/3470197039 >> v1:172.21.15.39:6789/0 conn(0x7f62bc15a850 legacy=0x7f62bc0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62bb7fe640 1 -- 172.21.15.32:0/3470197039 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0ce290 con 0x7f62bc0cafb0 2024-02-17T00:37:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.270+0000 7f62ba7fc640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0ccf50 0x7f62bc0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62bb7fe640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc0cafb0 0x7f62bc0cb420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e50 tx=0x7f62ac02bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d905192c57f9a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62b9ffb640 1 -- 172.21.15.32:0/3470197039 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac02c8d0 con 0x7f62bc0cafb0 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62b9ffb640 1 -- 172.21.15.32:0/3470197039 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac02ca30 con 0x7f62bc0cafb0 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62b9ffb640 1 -- 172.21.15.32:0/3470197039 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac02cdc0 con 0x7f62bc0cafb0 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62c189a640 1 -- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc0cafb0 msgr2=0x7f62bc0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62c189a640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc0cafb0 0x7f62bc0cb420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e50 tx=0x7f62ac02bdb0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62c189a640 1 -- 172.21.15.32:0/3470197039 shutdown_connections 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62c189a640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc0cafb0 0x7f62bc0cb420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62c189a640 1 --2- 172.21.15.32:0/3470197039 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0ccf50 0x7f62bc0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.271+0000 7f62c189a640 1 -- 172.21.15.32:0/3470197039 >> 172.21.15.32:0/3470197039 conn(0x7f62bc0999f0 msgr2=0x7f62bc0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.272+0000 7f62c189a640 1 -- 172.21.15.32:0/3470197039 shutdown_connections 2024-02-17T00:37:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.272+0000 7f62c189a640 1 -- 172.21.15.32:0/3470197039 wait complete. 2024-02-17T00:37:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.273+0000 7f62c189a640 1 Processor -- start 2024-02-17T00:37:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.273+0000 7f62c189a640 1 -- start start 2024-02-17T00:37:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0cafb0 0x7f62bc0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 0x7f62bc0ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc15a850 0x7f62bc150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0ca4b0 con 0x7f62bc0ccf50 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0ad910 con 0x7f62bc15a850 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0c9f30 con 0x7f62bc0cafb0 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 0x7f62bc0ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 0x7f62bc0ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49650/0 (socket says 172.21.15.32:49650) 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 -- 172.21.15.32:0/2529289207 learned_addr learned my addr 172.21.15.32:0/2529289207 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62bb7fe640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc15a850 0x7f62bc150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62baffd640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0cafb0 0x7f62bc0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 -- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0cafb0 msgr2=0x7f62bc0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0cafb0 0x7f62bc0af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 -- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc15a850 msgr2=0x7f62bc150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc15a850 0x7f62bc150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 -- 172.21.15.32:0/2529289207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009400 con 0x7f62bc0ccf50 2024-02-17T00:37:31.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62bb7fe640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc15a850 0x7f62bc150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62ba7fc640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 0x7f62bc0ad3d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f62a400ec10 tx=0x7f62a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4009760 con 0x7f62bc0ccf50 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a400cc30 con 0x7f62bc0ccf50 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4013470 con 0x7f62bc0ccf50 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac009b30 con 0x7f62bc0ccf50 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.274+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc151450 con 0x7f62bc0ccf50 2024-02-17T00:37:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.275+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc0cff60 con 0x7f62bc0ccf50 2024-02-17T00:37:31.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.276+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f62a40135d0 con 0x7f62bc0ccf50 2024-02-17T00:37:31.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.276+0000 7f62b3fff640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f629c06b840 0x7f629c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.276+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f62a408a770 con 0x7f62bc0ccf50 2024-02-17T00:37:31.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.277+0000 7f62baffd640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f629c06b840 0x7f629c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.277+0000 7f62baffd640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f629c06b840 0x7f629c06dd00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f62bc06b270 tx=0x7f62b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:31.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.281+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62a4054eb0 con 0x7f62bc0ccf50 2024-02-17T00:37:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.459+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62bc068f60 con 0x7f62bc0ccf50 2024-02-17T00:37:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.459+0000 7f62b3fff640 1 -- 172.21.15.32:0/2529289207 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62a4058570 con 0x7f62bc0ccf50 2024-02-17T00:37:31.462 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f629c06b840 msgr2=0x7f629c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f629c06b840 0x7f629c06dd00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f62bc06b270 tx=0x7f62b4009040 comp rx=0 tx=0).stop 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 msgr2=0x7f62bc0ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 0x7f62bc0ad3d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f62a400ec10 tx=0x7f62a400c520 comp rx=0 tx=0).stop 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 shutdown_connections 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62bc15a850 0x7f62bc150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62bc0ccf50 0x7f62bc0ad3d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f629c06b840 0x7f629c06dd00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 --2- 172.21.15.32:0/2529289207 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f62bc0cafb0 0x7f62bc0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 >> 172.21.15.32:0/2529289207 conn(0x7f62bc0999f0 msgr2=0x7f62bc06fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 shutdown_connections 2024-02-17T00:37:31.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.461+0000 7f62c189a640 1 -- 172.21.15.32:0/2529289207 wait complete. 2024-02-17T00:37:31.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T00:37:31.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.574+0000 7fc62add0640 1 Processor -- start 2024-02-17T00:37:31.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.574+0000 7fc62add0640 1 -- start start 2024-02-17T00:37:31.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc62add0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc62415da60 0x7fc6240d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc62add0640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62415e8a0 con 0x7fc62415de40 2024-02-17T00:37:31.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc62add0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62415eb80 con 0x7fc62415e2d0 2024-02-17T00:37:31.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc62add0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc624161640 con 0x7fc62415da60 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc628b6c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc62415da60 0x7fc6240d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc623fff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc62415de40 0x7fc624161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35514/0 (socket says 172.21.15.32:35514) 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc623fff640 1 -- 172.21.15.32:0/3031238452 learned_addr learned my addr 172.21.15.32:0/3031238452 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc628b6c640 1 -- 172.21.15.32:0/3031238452 >> v1:172.21.15.39:6789/0 conn(0x7fc62415e2d0 legacy=0x7fc6240ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc628b6c640 1 -- 172.21.15.32:0/3031238452 >> v1:172.21.15.32:6789/0 conn(0x7fc62415de40 legacy=0x7fc624161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc628b6c640 1 -- 172.21.15.32:0/3031238452 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62415ee60 con 0x7fc62415da60 2024-02-17T00:37:31.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.575+0000 7fc6237fe640 1 -- 172.21.15.32:0/3031238452 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892251748 0 0) 0x7fc62415e8a0 con 0x7fc62415de40 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.576+0000 7fc628b6c640 1 --2- 172.21.15.32:0/3031238452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415da60 0x7fc6240d0aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0097a0 tx=0x7fc61c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde1f9c52625659e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.576+0000 7fc6237fe640 1 -- 172.21.15.32:0/3031238452 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031830 con 0x7fc62415da60 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.576+0000 7fc6237fe640 1 -- 172.21.15.32:0/3031238452 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c031990 con 0x7fc62415da60 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.576+0000 7fc6237fe640 1 -- 172.21.15.32:0/3031238452 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031d20 con 0x7fc62415da60 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 -- 172.21.15.32:0/3031238452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415da60 msgr2=0x7fc6240d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 --2- 172.21.15.32:0/3031238452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415da60 0x7fc6240d0aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0097a0 tx=0x7fc61c02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 -- 172.21.15.32:0/3031238452 shutdown_connections 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 --2- 172.21.15.32:0/3031238452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415da60 0x7fc6240d0aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 -- 172.21.15.32:0/3031238452 >> 172.21.15.32:0/3031238452 conn(0x7fc62406bfe0 msgr2=0x7fc62406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 -- 172.21.15.32:0/3031238452 shutdown_connections 2024-02-17T00:37:31.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.577+0000 7fc62add0640 1 -- 172.21.15.32:0/3031238452 wait complete. 2024-02-17T00:37:31.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.578+0000 7fc62add0640 1 Processor -- start 2024-02-17T00:37:31.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.578+0000 7fc62add0640 1 -- start start 2024-02-17T00:37:31.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62add0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62415da60 0x7fc6241f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62add0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 0x7fc6240b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62add0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc62415e2d0 0x7fc6240aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62add0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ad8b0 con 0x7fc62415de40 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62add0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b1ef0 con 0x7fc62415da60 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62add0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240aae70 con 0x7fc62415e2d0 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 0x7fc6240b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 0x7fc6240b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49672/0 (socket says 172.21.15.32:49672) 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 -- 172.21.15.32:0/3521447622 learned_addr learned my addr 172.21.15.32:0/3521447622 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc628b6c640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62415da60 0x7fc6241f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62936d640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc62415e2d0 0x7fc6240aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 -- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc62415e2d0 msgr2=0x7fc6240aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc62415e2d0 0x7fc6240aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 -- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62415da60 msgr2=0x7fc6241f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62415da60 0x7fc6241f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc623fff640 1 -- 172.21.15.32:0/3521447622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c009400 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.579+0000 7fc62936d640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc62415e2d0 0x7fc6240aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.580+0000 7fc623fff640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 0x7fc6240b19b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc61400c7b0 tx=0x7fc61400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.580+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400a640 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.580+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61400a7a0 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.580+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc624162600 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.580+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400ab50 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.580+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6240acf10 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.581+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6240680c0 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.581+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc61400acb0 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.581+0000 7fc6217fa640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc60406b810 0x7fc60406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.582+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fc614089c60 con 0x7fc62415de40 2024-02-17T00:37:31.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.582+0000 7fc628b6c640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc60406b810 0x7fc60406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:31.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.582+0000 7fc628b6c640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc60406b810 0x7fc60406dcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc61c036000 tx=0x7fc61c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:31.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.586+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6140543a0 con 0x7fc62415de40 2024-02-17T00:37:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.781+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6240b81f0 con 0x7fc62415de40 2024-02-17T00:37:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.781+0000 7fc6217fa640 1 -- 172.21.15.32:0/3521447622 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc614018020 con 0x7fc62415de40 2024-02-17T00:37:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T00:37:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc60406b810 msgr2=0x7fc60406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc60406b810 0x7fc60406dcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc61c036000 tx=0x7fc61c03c040 comp rx=0 tx=0).stop 2024-02-17T00:37:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 msgr2=0x7fc6240b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 0x7fc6240b19b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc61400c7b0 tx=0x7fc61400cc70 comp rx=0 tx=0).stop 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 shutdown_connections 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc60406b810 0x7fc60406dcd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc62415e2d0 0x7fc6240aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc62415de40 0x7fc6240b19b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 --2- 172.21.15.32:0/3521447622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62415da60 0x7fc6241f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 >> 172.21.15.32:0/3521447622 conn(0x7fc62406bfe0 msgr2=0x7fc6240ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 shutdown_connections 2024-02-17T00:37:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:31.783+0000 7fc62add0640 1 -- 172.21.15.32:0/3521447622 wait complete. 2024-02-17T00:37:31.797 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T00:37:31.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:31.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-02-17T00:37:31.830 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:37:31.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:31.830 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T00:37:31.893 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:31.893 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:31.908 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:31.908 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:31.963 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:37:31.963 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:32.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.157+0000 7f4c4e7eb640 1 Processor -- start 2024-02-17T00:37:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.157+0000 7f4c4e7eb640 1 -- start start 2024-02-17T00:37:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4e7eb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4815dbb0 0x7f4c480b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4e7eb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4c48161ff0 0x7f4c4806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4e7eb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4806c4e0 con 0x7f4c4806c0b0 2024-02-17T00:37:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4e7eb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c480cc570 con 0x7f4c48161ff0 2024-02-17T00:37:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4e7eb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480cc290 con 0x7f4c4815dbb0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c477fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4c48161ff0 0x7f4c4806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4815dbb0 0x7f4c480b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4cd88640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4c4806c0b0 0x7f4c4806da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:57416/0 (socket says 172.21.15.32:57416) 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.158+0000 7f4c4cd88640 1 -- 172.21.15.32:0/3634061195 learned_addr learned my addr 172.21.15.32:0/3634061195 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c46ffd640 1 -- 172.21.15.32:0/3634061195 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690683399 0 0) 0x7f4c4806c4e0 con 0x7f4c4806c0b0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c46ffd640 1 -- 172.21.15.32:0/3634061195 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c30003520 con 0x7f4c4806c0b0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c47fff640 1 -- 172.21.15.32:0/3634061195 >> v2:172.21.15.39:3300/0 conn(0x7f4c48161ff0 msgr2=0x7f4c4806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c47fff640 1 --2- 172.21.15.32:0/3634061195 >> v2:172.21.15.39:3300/0 conn(0x7f4c48161ff0 0x7f4c4806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c47fff640 1 -- 172.21.15.32:0/3634061195 >> v1:172.21.15.39:6789/0 conn(0x7f4c4806c0b0 legacy=0x7f4c4806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c47fff640 1 -- 172.21.15.32:0/3634061195 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48072650 con 0x7f4c4815dbb0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.159+0000 7f4c477fe640 1 --2- 172.21.15.32:0/3634061195 >> v2:172.21.15.39:3300/0 conn(0x7f4c48161ff0 0x7f4c4806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c47fff640 1 --2- 172.21.15.32:0/3634061195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4815dbb0 0x7f4c480b38b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0097a0 tx=0x7f4c3c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d72d7e80fae6017f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c46ffd640 1 -- 172.21.15.32:0/3634061195 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c031830 con 0x7f4c4815dbb0 2024-02-17T00:37:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c46ffd640 1 -- 172.21.15.32:0/3634061195 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c031990 con 0x7f4c4815dbb0 2024-02-17T00:37:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c46ffd640 1 -- 172.21.15.32:0/3634061195 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c031d00 con 0x7f4c4815dbb0 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/3634061195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4815dbb0 msgr2=0x7f4c480b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/3634061195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4815dbb0 0x7f4c480b38b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0097a0 tx=0x7f4c3c02b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/3634061195 shutdown_connections 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/3634061195 >> v2:172.21.15.39:3300/0 conn(0x7f4c48161ff0 0x7f4c4806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/3634061195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4815dbb0 0x7f4c480b38b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/3634061195 >> 172.21.15.32:0/3634061195 conn(0x7f4c480719c0 msgr2=0x7f4c48071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/3634061195 shutdown_connections 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.160+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/3634061195 wait complete. 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.161+0000 7f4c4e7eb640 1 Processor -- start 2024-02-17T00:37:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 -- start start 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4806c0b0 0x7f4c480cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 0x7f4c481497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c48161ff0 0x7f4c481609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480cf640 con 0x7f4c4815dbb0 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480ce060 con 0x7f4c48161ff0 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.162+0000 7f4c4e7eb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480ce340 con 0x7f4c4806c0b0 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 0x7f4c481497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 0x7f4c481497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49682/0 (socket says 172.21.15.32:49682) 2024-02-17T00:37:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 -- 172.21.15.32:0/74640780 learned_addr learned my addr 172.21.15.32:0/74640780 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c4cd88640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c48161ff0 0x7f4c481609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c47fff640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4806c0b0 0x7f4c480cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 -- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4806c0b0 msgr2=0x7f4c480cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4806c0b0 0x7f4c480cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 -- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c48161ff0 msgr2=0x7f4c481609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c48161ff0 0x7f4c481609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 -- 172.21.15.32:0/74640780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c38009400 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c477fe640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 0x7f4c481497c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800e960 tx=0x7f4c3800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800ca00 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3800cb60 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c009400 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38013470 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.163+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c480ce900 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.164+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c48068fd0 con 0x7f4c4815dbb0 2024-02-17T00:37:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.165+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4c380135d0 con 0x7f4c4815dbb0 2024-02-17T00:37:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.165+0000 7f4c44ff9640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c3406b810 0x7f4c3406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.165+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4c3808a7d0 con 0x7f4c4815dbb0 2024-02-17T00:37:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.165+0000 7f4c47fff640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c3406b810 0x7f4c3406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.166+0000 7f4c47fff640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c3406b810 0x7f4c3406dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c036000 tx=0x7f4c3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.169+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c38054e80 con 0x7f4c4815dbb0 2024-02-17T00:37:32.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.354+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c480cfaa0 con 0x7f4c4815dbb0 2024-02-17T00:37:32.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.355+0000 7f4c44ff9640 1 -- 172.21.15.32:0/74640780 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f4c38058540 con 0x7f4c4815dbb0 2024-02-17T00:37:32.358 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:32.359 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c3406b810 msgr2=0x7f4c3406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c3406b810 0x7f4c3406dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c036000 tx=0x7f4c3c008030 comp rx=0 tx=0).stop 2024-02-17T00:37:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 msgr2=0x7f4c481497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 0x7f4c481497c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800e960 tx=0x7f4c3800ee20 comp rx=0 tx=0).stop 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 shutdown_connections 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c48161ff0 0x7f4c481609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4815dbb0 0x7f4c481497c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c3406b810 0x7f4c3406dcd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 --2- 172.21.15.32:0/74640780 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c4806c0b0 0x7f4c480cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 >> 172.21.15.32:0/74640780 conn(0x7f4c480719c0 msgr2=0x7f4c4806e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 shutdown_connections 2024-02-17T00:37:32.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.357+0000 7f4c4e7eb640 1 -- 172.21.15.32:0/74640780 wait complete. 2024-02-17T00:37:32.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:32.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:32.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.473+0000 7f3b571d7640 1 Processor -- start 2024-02-17T00:37:32.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.473+0000 7f3b571d7640 1 -- start start 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b571d7640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b5006f7d0 0x7f3b501620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b571d7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3b500b2950 0x7f3b5015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b571d7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b50161c10 con 0x7f3b5006ab60 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b571d7640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5006b690 con 0x7f3b5006f7d0 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b571d7640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b501625e0 con 0x7f3b500b2950 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b5006f7d0 0x7f3b501620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b5006f7d0 0x7f3b501620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49690/0 (socket says 172.21.15.32:49690) 2024-02-17T00:37:32.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 -- 172.21.15.32:0/2645969985 learned_addr learned my addr 172.21.15.32:0/2645969985 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b55774640 1 --2- 172.21.15.32:0/2645969985 >> v2:172.21.15.39:3300/0 conn(0x7f3b500b2950 0x7f3b5015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 -- 172.21.15.32:0/2645969985 >> v2:172.21.15.39:3300/0 conn(0x7f3b500b2950 msgr2=0x7f3b5015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 --2- 172.21.15.32:0/2645969985 >> v2:172.21.15.39:3300/0 conn(0x7f3b500b2950 0x7f3b5015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 -- 172.21.15.32:0/2645969985 >> v1:172.21.15.39:6789/0 conn(0x7f3b5006ab60 legacy=0x7f3b5006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.474+0000 7f3b54f73640 1 -- 172.21.15.32:0/2645969985 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5006b0d0 con 0x7f3b5006f7d0 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.475+0000 7f3b54f73640 1 --2- 172.21.15.32:0/2645969985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b501620a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3b5006de60 tx=0x7f3b4802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bf9461944f6fa0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.475+0000 7f3b4f7fe640 1 -- 172.21.15.32:0/2645969985 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4802cbb0 con 0x7f3b5006f7d0 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.475+0000 7f3b4f7fe640 1 -- 172.21.15.32:0/2645969985 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4802cd10 con 0x7f3b5006f7d0 2024-02-17T00:37:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.475+0000 7f3b4f7fe640 1 -- 172.21.15.32:0/2645969985 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48034610 con 0x7f3b5006f7d0 2024-02-17T00:37:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 -- 172.21.15.32:0/2645969985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 msgr2=0x7f3b501620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 --2- 172.21.15.32:0/2645969985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b501620a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3b5006de60 tx=0x7f3b4802c010 comp rx=0 tx=0).stop 2024-02-17T00:37:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 -- 172.21.15.32:0/2645969985 shutdown_connections 2024-02-17T00:37:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 --2- 172.21.15.32:0/2645969985 >> v2:172.21.15.39:3300/0 conn(0x7f3b500b2950 0x7f3b5015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 --2- 172.21.15.32:0/2645969985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b501620a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 -- 172.21.15.32:0/2645969985 >> 172.21.15.32:0/2645969985 conn(0x7f3b500999f0 msgr2=0x7f3b500b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 -- 172.21.15.32:0/2645969985 shutdown_connections 2024-02-17T00:37:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.476+0000 7f3b571d7640 1 -- 172.21.15.32:0/2645969985 wait complete. 2024-02-17T00:37:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.477+0000 7f3b571d7640 1 Processor -- start 2024-02-17T00:37:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.477+0000 7f3b571d7640 1 -- start start 2024-02-17T00:37:32.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b571d7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3b5006ab60 0x7f3b50153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b571d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b50160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b571d7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b500b2950 0x7f3b501605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b571d7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5015cbe0 con 0x7f3b5006f7d0 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b571d7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5015c900 con 0x7f3b500b2950 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b571d7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500b3270 con 0x7f3b5006ab60 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b50160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b50160080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49696/0 (socket says 172.21.15.32:49696) 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 -- 172.21.15.32:0/3795669336 learned_addr learned my addr 172.21.15.32:0/3795669336 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b55774640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b500b2950 0x7f3b501605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b54f73640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3b5006ab60 0x7f3b50153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 -- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3b5006ab60 msgr2=0x7f3b50153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3b5006ab60 0x7f3b50153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 -- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b500b2950 msgr2=0x7f3b501605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b500b2950 0x7f3b501605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b4ffff640 1 -- 172.21.15.32:0/3795669336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009b30 con 0x7f3b5006f7d0 2024-02-17T00:37:32.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.478+0000 7f3b54f73640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3b5006ab60 0x7f3b50153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.479+0000 7f3b4ffff640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b50160080 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000c3c0 tx=0x7f3b4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.479+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b400052d0 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.479+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b40005450 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.479+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40007260 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.479+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b500b3550 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.479+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b50153eb0 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.480+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b500b3a70 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.480+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3b400073c0 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.480+0000 7f3b4d7fa640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3b3006b810 0x7f3b3006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.481+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f3b40089910 con 0x7f3b5006f7d0 2024-02-17T00:37:32.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.481+0000 7f3b54f73640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3b3006b810 0x7f3b3006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.481+0000 7f3b54f73640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3b3006b810 0x7f3b3006dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b48035000 tx=0x7f3b48030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.485+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b500b3a70 con 0x7f3b5006f7d0 2024-02-17T00:37:32.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.663+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b500b3a70 con 0x7f3b5006f7d0 2024-02-17T00:37:32.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.663+0000 7f3b4d7fa640 1 -- 172.21.15.32:0/3795669336 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b500b3a70 con 0x7f3b5006f7d0 2024-02-17T00:37:32.666 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:32.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3b3006b810 msgr2=0x7f3b3006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3b3006b810 0x7f3b3006dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b48035000 tx=0x7f3b48030000 comp rx=0 tx=0).stop 2024-02-17T00:37:32.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 msgr2=0x7f3b50160080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b50160080 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000c3c0 tx=0x7f3b4000c880 comp rx=0 tx=0).stop 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 shutdown_connections 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b500b2950 0x7f3b501605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b5006f7d0 0x7f3b50160080 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3b3006b810 0x7f3b3006dcd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 --2- 172.21.15.32:0/3795669336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3b5006ab60 0x7f3b50153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 >> 172.21.15.32:0/3795669336 conn(0x7f3b500999f0 msgr2=0x7f3b500aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 shutdown_connections 2024-02-17T00:37:32.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.665+0000 7f3b571d7640 1 -- 172.21.15.32:0/3795669336 wait complete. 2024-02-17T00:37:32.679 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:32.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.780+0000 7fcaadb25640 1 Processor -- start 2024-02-17T00:37:32.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.780+0000 7fcaadb25640 1 -- start start 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaadb25640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcaa80d0780 0x7fcaa80d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaadb25640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80b9590 0x7fcaa80b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaadb25640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa80d10a0 con 0x7fcaa80b9130 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaadb25640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa80b7ef0 con 0x7fcaa80d0780 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaadb25640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80b81d0 con 0x7fcaa80b9590 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaa77fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcaa80d0780 0x7fcaa80d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaa77fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcaa80d0780 0x7fcaa80d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49708/0 (socket says 172.21.15.32:49708) 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaa77fe640 1 -- 172.21.15.32:0/3336092066 learned_addr learned my addr 172.21.15.32:0/3336092066 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:32.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.781+0000 7fcaa7fff640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80b9590 0x7fcaa80b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa77fe640 1 -- 172.21.15.32:0/3336092066 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80b9590 msgr2=0x7fcaa80b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa77fe640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80b9590 0x7fcaa80b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa77fe640 1 -- 172.21.15.32:0/3336092066 >> v1:172.21.15.39:6789/0 conn(0x7fcaa80b9130 legacy=0x7fcaa80d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa77fe640 1 -- 172.21.15.32:0/3336092066 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa80b84b0 con 0x7fcaa80d0780 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa7fff640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80b9590 0x7fcaa80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa77fe640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80d0780 0x7fcaa80d0b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca98009870 tx=0x7fca9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df086979c68cb6e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa6ffd640 1 -- 172.21.15.32:0/3336092066 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98031640 con 0x7fcaa80d0780 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.782+0000 7fcaa6ffd640 1 -- 172.21.15.32:0/3336092066 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca980317a0 con 0x7fcaa80d0780 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaa6ffd640 1 -- 172.21.15.32:0/3336092066 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98031b30 con 0x7fcaa80d0780 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 -- 172.21.15.32:0/3336092066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80d0780 msgr2=0x7fcaa80d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80d0780 0x7fcaa80d0b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca98009870 tx=0x7fca9802b8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 -- 172.21.15.32:0/3336092066 shutdown_connections 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80b9590 0x7fcaa80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 --2- 172.21.15.32:0/3336092066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80d0780 0x7fcaa80d0b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 -- 172.21.15.32:0/3336092066 >> 172.21.15.32:0/3336092066 conn(0x7fcaa80726b0 msgr2=0x7fcaa8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:32.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 -- 172.21.15.32:0/3336092066 shutdown_connections 2024-02-17T00:37:32.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.783+0000 7fcaadb25640 1 -- 172.21.15.32:0/3336092066 wait complete. 2024-02-17T00:37:32.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.784+0000 7fcaadb25640 1 Processor -- start 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.784+0000 7fcaadb25640 1 -- start start 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaadb25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaa80b9130 0x7fcaa80ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaadb25640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 0x7fcaa80cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaadb25640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80d0780 0x7fcaa81545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaadb25640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80cbe70 con 0x7fcaa80b9590 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaadb25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80cb1f0 con 0x7fcaa80b9130 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaadb25640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80cb4d0 con 0x7fcaa80d0780 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fca9effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 0x7fcaa80cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fca9effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 0x7fcaa80cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49710/0 (socket says 172.21.15.32:49710) 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fca9effd640 1 -- 172.21.15.32:0/671172188 learned_addr learned my addr 172.21.15.32:0/671172188 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaa7fff640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80d0780 0x7fcaa81545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.785+0000 7fcaa77fe640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaa80b9130 0x7fcaa80ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fca9effd640 1 -- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80d0780 msgr2=0x7fcaa81545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fca9effd640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80d0780 0x7fcaa81545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fca9effd640 1 -- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaa80b9130 msgr2=0x7fcaa80ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fca9effd640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaa80b9130 0x7fcaa80ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fca9effd640 1 -- 172.21.15.32:0/671172188 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980094d0 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fca9effd640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 0x7fcaa80cccc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c430 tx=0x7fca9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011790 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca900118f0 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa80cb7b0 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011ce0 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.786+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa80cae30 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.787+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa80685d0 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.787+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fca9001c460 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.788+0000 7fcaa4ff9640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fca8806b810 0x7fca8806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.788+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fca9008a380 con 0x7fcaa80b9590 2024-02-17T00:37:32.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.788+0000 7fcaa77fe640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fca8806b810 0x7fca8806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:32.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.788+0000 7fcaa77fe640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fca8806b810 0x7fca8806dcd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fca98036000 tx=0x7fca9803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:32.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.792+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca90054ad0 con 0x7fcaa80b9590 2024-02-17T00:37:32.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.971+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcaa80cafc0 con 0x7fcaa80b9590 2024-02-17T00:37:32.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.971+0000 7fcaa4ff9640 1 -- 172.21.15.32:0/671172188 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca90058190 con 0x7fcaa80b9590 2024-02-17T00:37:32.974 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fca8806b810 msgr2=0x7fca8806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fca8806b810 0x7fca8806dcd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fca98036000 tx=0x7fca9803c040 comp rx=0 tx=0).stop 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 msgr2=0x7fcaa80cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 0x7fcaa80cccc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c430 tx=0x7fca9000c8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 shutdown_connections 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fca8806b810 0x7fca8806dcd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcaa80d0780 0x7fcaa81545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcaa80b9590 0x7fcaa80cccc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 --2- 172.21.15.32:0/671172188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaa80b9130 0x7fcaa80ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 >> 172.21.15.32:0/671172188 conn(0x7fcaa80726b0 msgr2=0x7fcaa815e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 shutdown_connections 2024-02-17T00:37:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:32.973+0000 7fcaadb25640 1 -- 172.21.15.32:0/671172188 wait complete. 2024-02-17T00:37:32.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:33.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.090+0000 7f06e4022640 1 Processor -- start 2024-02-17T00:37:33.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.090+0000 7f06e4022640 1 -- start start 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e4022640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06dc06bf10 0x7f06dc0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e4022640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e4022640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cde00 con 0x7f06dc0cda20 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e4022640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0d00e0 con 0x7f06dc06bf10 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e4022640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc09a3a0 con 0x7f06dc099f30 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06dc06bf10 0x7f06dc0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06dc06bf10 0x7f06dc0999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49724/0 (socket says 172.21.15.32:49724) 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 -- 172.21.15.32:0/184551784 learned_addr learned my addr 172.21.15.32:0/184551784 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e25bf640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 -- 172.21.15.32:0/184551784 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 msgr2=0x7f06dc15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc15d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 -- 172.21.15.32:0/184551784 >> v1:172.21.15.39:6789/0 conn(0x7f06dc0cda20 legacy=0x7f06dc0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e15bd640 1 -- 172.21.15.32:0/184551784 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0d02f0 con 0x7f06dc06bf10 2024-02-17T00:37:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.091+0000 7f06e25bf640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e15bd640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0999f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709a0396dc5d0a65 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e0dbc640 1 -- 172.21.15.32:0/184551784 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc030840 con 0x7f06dc06bf10 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e0dbc640 1 -- 172.21.15.32:0/184551784 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc0309a0 con 0x7f06dc06bf10 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e0dbc640 1 -- 172.21.15.32:0/184551784 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc030d30 con 0x7f06dc06bf10 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e4022640 1 -- 172.21.15.32:0/184551784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 msgr2=0x7f06dc0999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e4022640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0999f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc02b980 comp rx=0 tx=0).stop 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e4022640 1 -- 172.21.15.32:0/184551784 shutdown_connections 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e4022640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e4022640 1 --2- 172.21.15.32:0/184551784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0999f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.092+0000 7f06e4022640 1 -- 172.21.15.32:0/184551784 >> 172.21.15.32:0/184551784 conn(0x7f06dc0b3110 msgr2=0x7f06dc0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:33.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.093+0000 7f06e4022640 1 -- 172.21.15.32:0/184551784 shutdown_connections 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.093+0000 7f06e4022640 1 -- 172.21.15.32:0/184551784 wait complete. 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 Processor -- start 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 -- start start 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06dc0cda20 0x7f06dc0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0b0630 con 0x7f06dc06bf10 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc151fe0 con 0x7f06dc0cda20 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e4022640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0ae680 con 0x7f06dc099f30 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e1dbe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.094+0000 7f06e1dbe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49740/0 (socket says 172.21.15.32:49740) 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 -- 172.21.15.32:0/1358312760 learned_addr learned my addr 172.21.15.32:0/1358312760 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:33.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e15bd640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e25bf640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06dc0cda20 0x7f06dc0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 -- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 msgr2=0x7f06dc151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 -- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06dc0cda20 msgr2=0x7f06dc0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06dc0cda20 0x7f06dc0b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 -- 172.21.15.32:0/1358312760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0094d0 con 0x7f06dc06bf10 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e25bf640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06dc0cda20 0x7f06dc0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e1dbe640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0b00f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f06d800c400 tx=0x7f06d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80052d0 con 0x7f06dc06bf10 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d8005450 con 0x7f06dc06bf10 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc0ae960 con 0x7f06dc06bf10 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8007260 con 0x7f06dc06bf10 2024-02-17T00:37:33.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.095+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc0aef20 con 0x7f06dc06bf10 2024-02-17T00:37:33.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.096+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc068f60 con 0x7f06dc06bf10 2024-02-17T00:37:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.097+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f06d80073c0 con 0x7f06dc06bf10 2024-02-17T00:37:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.097+0000 7f06d27fc640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f06c006b810 0x7f06c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.097+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f06d8089990 con 0x7f06dc06bf10 2024-02-17T00:37:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.097+0000 7f06e15bd640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f06c006b810 0x7f06c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.098+0000 7f06e15bd640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f06c006b810 0x7f06c006dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06cc036000 tx=0x7f06cc03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.101+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06d8054040 con 0x7f06dc06bf10 2024-02-17T00:37:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.284+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06dc09a4e0 con 0x7f06dc06bf10 2024-02-17T00:37:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.284+0000 7f06d27fc640 1 -- 172.21.15.32:0/1358312760 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06d8057700 con 0x7f06dc06bf10 2024-02-17T00:37:33.287 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f06c006b810 msgr2=0x7f06c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f06c006b810 0x7f06c006dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06cc036000 tx=0x7f06cc03b040 comp rx=0 tx=0).stop 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 msgr2=0x7f06dc0b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0b00f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f06d800c400 tx=0x7f06d800c8c0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 shutdown_connections 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06dc0cda20 0x7f06dc0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f06c006b810 0x7f06c006dcd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f06dc099f30 0x7f06dc151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 --2- 172.21.15.32:0/1358312760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc06bf10 0x7f06dc0b00f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 >> 172.21.15.32:0/1358312760 conn(0x7f06dc0b3110 msgr2=0x7f06dc0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:33.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 shutdown_connections 2024-02-17T00:37:33.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.287+0000 7f06e4022640 1 -- 172.21.15.32:0/1358312760 wait complete. 2024-02-17T00:37:33.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:33.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.401+0000 7f504d2f2640 1 Processor -- start 2024-02-17T00:37:33.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.401+0000 7f504d2f2640 1 -- start start 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f504d2f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f50480ce680 0x7f50480ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f504d2f2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480b6a70 0x7f50480b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f504d2f2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50480cf050 con 0x7f504815db30 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f504d2f2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480d2400 con 0x7f50480ce680 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f504d2f2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504815df10 con 0x7f50480b6a70 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f50467fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f50480ce680 0x7f50480ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f50477fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480b6a70 0x7f50480b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f5046ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f504815db30 0x7f50480d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:57430/0 (socket says 172.21.15.32:57430) 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f50467fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f50480ce680 0x7f50480ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:50854/0 (socket says 172.21.15.32:50854) 2024-02-17T00:37:33.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.402+0000 7f5046ffd640 1 -- 172.21.15.32:0/1089996034 learned_addr learned my addr 172.21.15.32:0/1089996034 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.403+0000 7f50467fc640 1 -- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480b6a70 msgr2=0x7f50480b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.403+0000 7f50467fc640 1 --2- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480b6a70 0x7f50480b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.403+0000 7f50467fc640 1 -- 172.21.15.32:0/1089996034 >> v1:172.21.15.39:6789/0 conn(0x7f504815db30 legacy=0x7f50480d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.403+0000 7f50467fc640 1 -- 172.21.15.32:0/1089996034 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480d1780 con 0x7f50480ce680 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.403+0000 7f50477fe640 1 --2- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480b6a70 0x7f50480b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.403+0000 7f50467fc640 1 --2- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480ce680 0x7f50480ceb10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f50300097a0 tx=0x7f503002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec86c9435802420 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f5045ffb640 1 -- 172.21.15.32:0/1089996034 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030031830 con 0x7f50480ce680 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f5045ffb640 1 -- 172.21.15.32:0/1089996034 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030031990 con 0x7f50480ce680 2024-02-17T00:37:33.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f5045ffb640 1 -- 172.21.15.32:0/1089996034 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030031d20 con 0x7f50480ce680 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 -- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480ce680 msgr2=0x7f50480ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 --2- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480ce680 0x7f50480ceb10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f50300097a0 tx=0x7f503002b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 -- 172.21.15.32:0/1089996034 shutdown_connections 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 --2- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480b6a70 0x7f50480b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 --2- 172.21.15.32:0/1089996034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480ce680 0x7f50480ceb10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 -- 172.21.15.32:0/1089996034 >> 172.21.15.32:0/1089996034 conn(0x7f50480728c0 msgr2=0x7f504806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 -- 172.21.15.32:0/1089996034 shutdown_connections 2024-02-17T00:37:33.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.404+0000 7f504d2f2640 1 -- 172.21.15.32:0/1089996034 wait complete. 2024-02-17T00:37:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.405+0000 7f504d2f2640 1 Processor -- start 2024-02-17T00:37:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.405+0000 7f504d2f2640 1 -- start start 2024-02-17T00:37:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f504d2f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480b6a70 0x7f50480c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f504d2f2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480ce680 0x7f50480cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f504d2f2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 0x7f5048149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f504d2f2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c8dc0 con 0x7f504815db30 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f504d2f2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480cc860 con 0x7f50480b6a70 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f504d2f2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480cbc50 con 0x7f50480ce680 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f50477fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 0x7f5048149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f50477fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 0x7f5048149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49744/0 (socket says 172.21.15.32:49744) 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f50477fe640 1 -- 172.21.15.32:0/370744032 learned_addr learned my addr 172.21.15.32:0/370744032 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f5046ffd640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480b6a70 0x7f50480c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.406+0000 7f50467fc640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480ce680 0x7f50480cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f50477fe640 1 -- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480ce680 msgr2=0x7f50480cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f50477fe640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480ce680 0x7f50480cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f50477fe640 1 -- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480b6a70 msgr2=0x7f50480c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f50477fe640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480b6a70 0x7f50480c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f50477fe640 1 -- 172.21.15.32:0/370744032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009400 con 0x7f504815db30 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f50477fe640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 0x7f5048149d40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f504000e930 tx=0x7f504000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040009700 con 0x7f504815db30 2024-02-17T00:37:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000ca00 con 0x7f504815db30 2024-02-17T00:37:33.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5030009400 con 0x7f504815db30 2024-02-17T00:37:33.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000cd90 con 0x7f504815db30 2024-02-17T00:37:33.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.407+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50480cc210 con 0x7f504815db30 2024-02-17T00:37:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.408+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480d1d00 con 0x7f504815db30 2024-02-17T00:37:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.409+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5040013470 con 0x7f504815db30 2024-02-17T00:37:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.409+0000 7f503f7fe640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f502806b810 0x7f502806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.409+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f504008a170 con 0x7f504815db30 2024-02-17T00:37:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.409+0000 7f5046ffd640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f502806b810 0x7f502806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.410+0000 7f5046ffd640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f502806b810 0x7f502806dcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f50481f6b20 tx=0x7f5038001990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.413+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5040054910 con 0x7f504815db30 2024-02-17T00:37:33.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.592+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5048068f60 con 0x7f504815db30 2024-02-17T00:37:33.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.593+0000 7f503f7fe640 1 -- 172.21.15.32:0/370744032 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5040057fd0 con 0x7f504815db30 2024-02-17T00:37:33.596 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f502806b810 msgr2=0x7f502806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f502806b810 0x7f502806dcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f50481f6b20 tx=0x7f5038001990 comp rx=0 tx=0).stop 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 msgr2=0x7f5048149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 0x7f5048149d40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f504000e930 tx=0x7f504000edf0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 shutdown_connections 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504815db30 0x7f5048149d40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f502806b810 0x7f502806dcd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f50480ce680 0x7f50480cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 --2- 172.21.15.32:0/370744032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50480b6a70 0x7f50480c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 >> 172.21.15.32:0/370744032 conn(0x7f50480728c0 msgr2=0x7f504815bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:33.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 shutdown_connections 2024-02-17T00:37:33.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.595+0000 7f504d2f2640 1 -- 172.21.15.32:0/370744032 wait complete. 2024-02-17T00:37:33.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T00:37:33.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.708+0000 7fa1e64f2640 1 Processor -- start 2024-02-17T00:37:33.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.708+0000 7fa1e64f2640 1 -- start start 2024-02-17T00:37:33.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1e64f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa1e015dd00 0x7fa1e00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1e64f2640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa1e00b6a40 0x7fa1e00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1e64f2640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e015e0e0 con 0x7fa1e006bfb0 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1e64f2640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e006cfe0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1e64f2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e006cd00 con 0x7fa1e015dd00 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa1e00b6a40 0x7fa1e00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa1e00b6a40 0x7fa1e00b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55456/0 (socket says 172.21.15.32:55456) 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 -- 172.21.15.32:0/845819709 learned_addr learned my addr 172.21.15.32:0/845819709 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1e4a8f640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa1e006bfb0 0x7fa1e006c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40124/0 (socket says 172.21.15.32:40124) 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1dffff640 1 --2- 172.21.15.32:0/845819709 >> v2:172.21.15.39:3300/0 conn(0x7fa1e015dd00 0x7fa1e00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 -- 172.21.15.32:0/845819709 >> v2:172.21.15.39:3300/0 conn(0x7fa1e015dd00 msgr2=0x7fa1e00b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 --2- 172.21.15.32:0/845819709 >> v2:172.21.15.39:3300/0 conn(0x7fa1e015dd00 0x7fa1e00b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 -- 172.21.15.32:0/845819709 >> v1:172.21.15.32:6789/0 conn(0x7fa1e006bfb0 legacy=0x7fa1e006c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1df7fe640 1 -- 172.21.15.32:0/845819709 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00d1ca0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.709+0000 7fa1deffd640 1 -- 172.21.15.32:0/845819709 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537225526 0 0) 0x7fa1d8001490 con 0x7fa1e006bfb0 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.710+0000 7fa1df7fe640 1 --2- 172.21.15.32:0/845819709 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e00b5c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00d4920 tx=0x7fa1d002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a434d1dc7ec6a54 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.710+0000 7fa1deffd640 1 -- 172.21.15.32:0/845819709 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d002f850 con 0x7fa1e00b6a40 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.710+0000 7fa1deffd640 1 -- 172.21.15.32:0/845819709 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d002f9b0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.710+0000 7fa1deffd640 1 -- 172.21.15.32:0/845819709 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d002fd40 con 0x7fa1e00b6a40 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 -- 172.21.15.32:0/845819709 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 msgr2=0x7fa1e00b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/845819709 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e00b5c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00d4920 tx=0x7fa1d002ba30 comp rx=0 tx=0).stop 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 -- 172.21.15.32:0/845819709 shutdown_connections 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/845819709 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e00b5c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/845819709 >> v2:172.21.15.39:3300/0 conn(0x7fa1e015dd00 0x7fa1e00b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 -- 172.21.15.32:0/845819709 >> 172.21.15.32:0/845819709 conn(0x7fa1e00d07b0 msgr2=0x7fa1e00d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 -- 172.21.15.32:0/845819709 shutdown_connections 2024-02-17T00:37:33.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.711+0000 7fa1e64f2640 1 -- 172.21.15.32:0/845819709 wait complete. 2024-02-17T00:37:33.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.712+0000 7fa1e64f2640 1 Processor -- start 2024-02-17T00:37:33.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.712+0000 7fa1e64f2640 1 -- start start 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e64f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e006bfb0 0x7fa1e0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e64f2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e64f2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1e015dd00 0x7fa1e0160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e64f2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e0157d70 con 0x7fa1e00b6a40 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e64f2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e0157fc0 con 0x7fa1e006bfb0 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e64f2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e01582a0 con 0x7fa1e015dd00 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e01574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55460/0 (socket says 172.21.15.32:55460) 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 -- 172.21.15.32:0/3256670028 learned_addr learned my addr 172.21.15.32:0/3256670028 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1dffff640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e006bfb0 0x7fa1e0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 -- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1e015dd00 msgr2=0x7fa1e0160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1e4a8f640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1e015dd00 0x7fa1e0160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1e015dd00 0x7fa1e0160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 -- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e006bfb0 msgr2=0x7fa1e0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e006bfb0 0x7fa1e0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1df7fe640 1 -- 172.21.15.32:0/3256670028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00094d0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.713+0000 7fa1dffff640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e006bfb0 0x7fa1e0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.714+0000 7fa1df7fe640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e01574a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1d002ba70 tx=0x7fa1d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.714+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0037d10 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.714+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0037e90 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.714+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e0158580 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.714+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0041640 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.714+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e0158b40 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.715+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e00680c0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.715+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa1d00417a0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.716+0000 7fa1dcff9640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa1cc06b840 0x7fa1cc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:33.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.716+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fa1d003c070 con 0x7fa1e00b6a40 2024-02-17T00:37:33.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.716+0000 7fa1dffff640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa1cc06b840 0x7fa1cc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:33.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.716+0000 7fa1dffff640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa1cc06b840 0x7fa1cc06dd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006fd0 tx=0x7fa1d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:33.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.720+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa1d0077c00 con 0x7fa1e00b6a40 2024-02-17T00:37:33.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.911+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1e0158d60 con 0x7fa1e00b6a40 2024-02-17T00:37:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.911+0000 7fa1dcff9640 1 -- 172.21.15.32:0/3256670028 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa1d007b2c0 con 0x7fa1e00b6a40 2024-02-17T00:37:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T00:37:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa1cc06b840 msgr2=0x7fa1cc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa1cc06b840 0x7fa1cc06dd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006fd0 tx=0x7fa1d4008040 comp rx=0 tx=0).stop 2024-02-17T00:37:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 msgr2=0x7fa1e01574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e01574a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1d002ba70 tx=0x7fa1d0004730 comp rx=0 tx=0).stop 2024-02-17T00:37:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 shutdown_connections 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa1cc06b840 0x7fa1cc06dd00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1e015dd00 0x7fa1e0160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1e00b6a40 0x7fa1e01574a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 --2- 172.21.15.32:0/3256670028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e006bfb0 0x7fa1e0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 >> 172.21.15.32:0/3256670028 conn(0x7fa1e00d07b0 msgr2=0x7fa1e00b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 shutdown_connections 2024-02-17T00:37:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:33.913+0000 7fa1e64f2640 1 -- 172.21.15.32:0/3256670028 wait complete. 2024-02-17T00:37:33.927 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-02-17T00:37:33.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:33.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-02-17T00:37:33.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T00:37:33.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:33.954 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-02-17T00:37:34.009 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:34.009 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:34.028 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:34.028 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:34.085 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T00:37:34.085 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:37:34.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:34.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.240+0000 7fc8e369d640 1 Processor -- start 2024-02-17T00:37:34.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e369d640 1 -- start start 2024-02-17T00:37:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e369d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc15db00 0x7fc8dc0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e369d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8dc0b53b0 0x7fc8dc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e369d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0d1e80 con 0x7fc8dc0ce2b0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e369d640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc0b5930 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e369d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0b5c10 con 0x7fc8dc15db00 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.241+0000 7fc8e0c38640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8dc0b53b0 0x7fc8dc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e1c3a640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc8dc0ce2b0 0x7fc8dc161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40126/0 (socket says 172.21.15.32:40126) 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e0c38640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8dc0b53b0 0x7fc8dc0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55470/0 (socket says 172.21.15.32:55470) 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e1c3a640 1 -- 172.21.15.32:0/3472927856 learned_addr learned my addr 172.21.15.32:0/3472927856 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e1439640 1 --2- 172.21.15.32:0/3472927856 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc15db00 0x7fc8dc0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e0c38640 1 -- 172.21.15.32:0/3472927856 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc15db00 msgr2=0x7fc8dc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e0c38640 1 --2- 172.21.15.32:0/3472927856 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc15db00 0x7fc8dc0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e0c38640 1 -- 172.21.15.32:0/3472927856 >> v1:172.21.15.32:6789/0 conn(0x7fc8dc0ce2b0 legacy=0x7fc8dc161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8dbfff640 1 -- 172.21.15.32:0/3472927856 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706682857 0 0) 0x7fc8dc0d1e80 con 0x7fc8dc0ce2b0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.242+0000 7fc8e0c38640 1 -- 172.21.15.32:0/3472927856 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0b5ef0 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e0c38640 1 --2- 172.21.15.32:0/3472927856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc0d0880 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00097a0 tx=0x7fc8d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38872cff831a7da3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8dbfff640 1 -- 172.21.15.32:0/3472927856 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0031830 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8dbfff640 1 -- 172.21.15.32:0/3472927856 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0031990 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8dbfff640 1 -- 172.21.15.32:0/3472927856 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0031d20 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 -- 172.21.15.32:0/3472927856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 msgr2=0x7fc8dc0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3472927856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc0d0880 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00097a0 tx=0x7fc8d002b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 -- 172.21.15.32:0/3472927856 shutdown_connections 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3472927856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc0d0880 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3472927856 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc15db00 0x7fc8dc0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 -- 172.21.15.32:0/3472927856 >> 172.21.15.32:0/3472927856 conn(0x7fc8dc072290 msgr2=0x7fc8dc0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 -- 172.21.15.32:0/3472927856 shutdown_connections 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.243+0000 7fc8e369d640 1 -- 172.21.15.32:0/3472927856 wait complete. 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.244+0000 7fc8e369d640 1 Processor -- start 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 -- start start 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc0ce2b0 0x7fc8dc0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8dc15db00 0x7fc8dc0b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c8180 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc156010 con 0x7fc8dc15db00 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e369d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1562b0 con 0x7fc8dc0ce2b0 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e1439640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e1439640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55486/0 (socket says 172.21.15.32:55486) 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e1439640 1 -- 172.21.15.32:0/3228313905 learned_addr learned my addr 172.21.15.32:0/3228313905 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e1c3a640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8dc15db00 0x7fc8dc0b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.245+0000 7fc8e0c38640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc0ce2b0 0x7fc8dc0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e1439640 1 -- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc0ce2b0 msgr2=0x7fc8dc0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e1439640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc0ce2b0 0x7fc8dc0c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e1439640 1 -- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8dc15db00 msgr2=0x7fc8dc0b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e1439640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8dc15db00 0x7fc8dc0b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e1439640 1 -- 172.21.15.32:0/3228313905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0009400 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e0c38640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc0ce2b0 0x7fc8dc0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e1439640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc160b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400d5f0 tx=0x7fc8d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40125f0 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4012750 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc156590 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4012b00 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.246+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc156b50 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.247+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc0739a0 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.247+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc8d4012c60 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.248+0000 7fc8d9ffb640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8c806b810 0x7fc8c806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.248+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fc8d408aa50 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.248+0000 7fc8e0c38640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8c806b810 0x7fc8c806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.248+0000 7fc8e0c38640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8c806b810 0x7fc8c806dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0036000 tx=0x7fc8d003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.252+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8d4055100 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.432+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8dc0cfbb0 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.433+0000 7fc8d9ffb640 1 -- 172.21.15.32:0/3228313905 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7fc8d40587c0 con 0x7fc8dc0b53b0 2024-02-17T00:37:34.437 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:34.437 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.435+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8c806b810 msgr2=0x7fc8c806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.435+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8c806b810 0x7fc8c806dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0036000 tx=0x7fc8d003c040 comp rx=0 tx=0).stop 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.435+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 msgr2=0x7fc8dc160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.435+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc160b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400d5f0 tx=0x7fc8d400dab0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 shutdown_connections 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8dc15db00 0x7fc8dc0b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc8c806b810 0x7fc8c806dcd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc8dc0ce2b0 0x7fc8dc0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 --2- 172.21.15.32:0/3228313905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8dc0b53b0 0x7fc8dc160b20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 >> 172.21.15.32:0/3228313905 conn(0x7fc8dc072290 msgr2=0x7fc8dc15c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 shutdown_connections 2024-02-17T00:37:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.436+0000 7fc8e369d640 1 -- 172.21.15.32:0/3228313905 wait complete. 2024-02-17T00:37:34.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:34.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:34.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.552+0000 7facd026d640 1 Processor -- start 2024-02-17T00:37:34.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.552+0000 7facd026d640 1 -- start start 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7facd026d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7facc80d2c40 0x7facc80b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7facd026d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80b7ef0 con 0x7facc80b68b0 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7facd026d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80b81d0 con 0x7facc80d0780 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7facd026d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80b84b0 con 0x7facc80d2c40 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7facce80a640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7facc80b68b0 0x7facc80b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40142/0 (socket says 172.21.15.32:40142) 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7facce80a640 1 -- 172.21.15.32:0/1361269813 learned_addr learned my addr 172.21.15.32:0/1361269813 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd808640 1 --2- 172.21.15.32:0/1361269813 >> v2:172.21.15.39:3300/0 conn(0x7facc80d2c40 0x7facc80b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931160211 0 0) 0x7facc80b7ef0 con 0x7facc80b68b0 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb4003520 con 0x7facc80b68b0 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586498765 0 0) 0x7facc80b81d0 con 0x7facc80d0780 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc80b7ef0 con 0x7facc80d0780 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2413805771 0 0) 0x7facb4003520 con 0x7facc80b68b0 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd808640 1 -- 172.21.15.32:0/1361269813 >> v1:172.21.15.39:6789/0 conn(0x7facc80d0780 legacy=0x7facc80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd808640 1 -- 172.21.15.32:0/1361269813 >> v1:172.21.15.32:6789/0 conn(0x7facc80b68b0 legacy=0x7facc80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.553+0000 7faccd808640 1 -- 172.21.15.32:0/1361269813 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80b8790 con 0x7facc80d2c40 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.554+0000 7faccd808640 1 --2- 172.21.15.32:0/1361269813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d2c40 0x7facc80b9130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7facb80097a0 tx=0x7facb802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ff999e09820d10 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.554+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb802f050 con 0x7facc80d2c40 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.554+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8031500 con 0x7facc80d2c40 2024-02-17T00:37:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.554+0000 7faccd007640 1 -- 172.21.15.32:0/1361269813 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00019f0 con 0x7facc80d2c40 2024-02-17T00:37:34.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 -- 172.21.15.32:0/1361269813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d2c40 msgr2=0x7facc80b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 --2- 172.21.15.32:0/1361269813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d2c40 0x7facc80b9130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7facb80097a0 tx=0x7facb802b820 comp rx=0 tx=0).stop 2024-02-17T00:37:34.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 -- 172.21.15.32:0/1361269813 shutdown_connections 2024-02-17T00:37:34.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 --2- 172.21.15.32:0/1361269813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d2c40 0x7facc80b9130 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 -- 172.21.15.32:0/1361269813 >> 172.21.15.32:0/1361269813 conn(0x7facc80726b0 msgr2=0x7facc8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 -- 172.21.15.32:0/1361269813 shutdown_connections 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.555+0000 7facd026d640 1 -- 172.21.15.32:0/1361269813 wait complete. 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.556+0000 7facd026d640 1 Processor -- start 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.556+0000 7facd026d640 1 -- start start 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facd026d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7facc80b68b0 0x7facc80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facd026d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d0780 0x7facc80ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facd026d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 0x7facc814bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facd026d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80ca230 con 0x7facc80d2c40 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facd026d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80b3aa0 con 0x7facc80d0780 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facd026d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80b4a40 con 0x7facc80b68b0 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 0x7facc814bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 0x7facc814bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55490/0 (socket says 172.21.15.32:55490) 2024-02-17T00:37:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 -- 172.21.15.32:0/2437451906 learned_addr learned my addr 172.21.15.32:0/2437451906 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7faccd808640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d0780 0x7facc80ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce009640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7facc80b68b0 0x7facc80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 -- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7facc80b68b0 msgr2=0x7facc80b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7facc80b68b0 0x7facc80b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 -- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d0780 msgr2=0x7facc80ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d0780 0x7facc80ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 -- 172.21.15.32:0/2437451906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8009400 con 0x7facc80d2c40 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.557+0000 7facce80a640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 0x7facc814bd20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7facc0001f80 tx=0x7facc000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.558+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0012400 con 0x7facc80d2c40 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.558+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0012560 con 0x7facc80d2c40 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.558+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc80cae30 con 0x7facc80d2c40 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.558+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0012930 con 0x7facc80d2c40 2024-02-17T00:37:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.558+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc80cd930 con 0x7facc80d2c40 2024-02-17T00:37:34.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.559+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80685d0 con 0x7facc80d2c40 2024-02-17T00:37:34.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.559+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7facc0012a90 con 0x7facc80d2c40 2024-02-17T00:37:34.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.559+0000 7facbeffd640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7facac06b810 0x7facac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.559+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7facc008ad10 con 0x7facc80d2c40 2024-02-17T00:37:34.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.560+0000 7facce009640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7facac06b810 0x7facac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.560+0000 7facce009640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7facac06b810 0x7facac06dcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facc40011e0 tx=0x7facc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.564+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7facc0055470 con 0x7facc80d2c40 2024-02-17T00:37:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.744+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facc8068f60 con 0x7facc80d2c40 2024-02-17T00:37:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.745+0000 7facbeffd640 1 -- 172.21.15.32:0/2437451906 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7facc0058b30 con 0x7facc80d2c40 2024-02-17T00:37:34.748 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7facac06b810 msgr2=0x7facac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7facac06b810 0x7facac06dcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facc40011e0 tx=0x7facc4009040 comp rx=0 tx=0).stop 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 msgr2=0x7facc814bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 0x7facc814bd20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7facc0001f80 tx=0x7facc000a430 comp rx=0 tx=0).stop 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 shutdown_connections 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facc80d2c40 0x7facc814bd20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc80d0780 0x7facc80ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7facac06b810 0x7facac06dcd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 --2- 172.21.15.32:0/2437451906 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7facc80b68b0 0x7facc80b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.746+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 >> 172.21.15.32:0/2437451906 conn(0x7facc80726b0 msgr2=0x7facc80b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.747+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 shutdown_connections 2024-02-17T00:37:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.747+0000 7facd026d640 1 -- 172.21.15.32:0/2437451906 wait complete. 2024-02-17T00:37:34.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:34.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.861+0000 7fa6071f4640 1 Processor -- start 2024-02-17T00:37:34.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.861+0000 7fa6071f4640 1 -- start start 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.862+0000 7fa6071f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.862+0000 7fa6071f4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa60006ab60 0x7fa60006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.862+0000 7fa6071f4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa600161b90 con 0x7fa6000cd9c0 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.862+0000 7fa6071f4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60006b530 con 0x7fa60006ab60 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.862+0000 7fa6071f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000b1ea0 con 0x7fa6000d1140 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa5fffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa605791640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa60006ab60 0x7fa60006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa604f90640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa6000cd9c0 0x7fa600162020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:33790/0 (socket says 172.21.15.32:33790) 2024-02-17T00:37:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa604f90640 1 -- 172.21.15.32:0/12162706 learned_addr learned my addr 172.21.15.32:0/12162706 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa5fffff640 1 -- 172.21.15.32:0/12162706 >> v2:172.21.15.39:3300/0 conn(0x7fa60006ab60 msgr2=0x7fa60006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa5fffff640 1 --2- 172.21.15.32:0/12162706 >> v2:172.21.15.39:3300/0 conn(0x7fa60006ab60 0x7fa60006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa5fffff640 1 -- 172.21.15.32:0/12162706 >> v1:172.21.15.39:6789/0 conn(0x7fa6000cd9c0 legacy=0x7fa600162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa5fffff640 1 -- 172.21.15.32:0/12162706 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600161860 con 0x7fa6000d1140 2024-02-17T00:37:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.863+0000 7fa605791640 1 --2- 172.21.15.32:0/12162706 >> v2:172.21.15.39:3300/0 conn(0x7fa60006ab60 0x7fa60006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.864+0000 7fa5fffff640 1 --2- 172.21.15.32:0/12162706 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000b1300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097a0 tx=0x7fa5e802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0df7d235dc75f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.864+0000 7fa5ff7fe640 1 -- 172.21.15.32:0/12162706 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e802e070 con 0x7fa6000d1140 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.864+0000 7fa5ff7fe640 1 -- 172.21.15.32:0/12162706 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e80315a0 con 0x7fa6000d1140 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.864+0000 7fa5ff7fe640 1 -- 172.21.15.32:0/12162706 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8031930 con 0x7fa6000d1140 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 -- 172.21.15.32:0/12162706 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 msgr2=0x7fa6000b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 --2- 172.21.15.32:0/12162706 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000b1300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097a0 tx=0x7fa5e802b840 comp rx=0 tx=0).stop 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 -- 172.21.15.32:0/12162706 shutdown_connections 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 --2- 172.21.15.32:0/12162706 >> v2:172.21.15.39:3300/0 conn(0x7fa60006ab60 0x7fa60006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 --2- 172.21.15.32:0/12162706 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000b1300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 -- 172.21.15.32:0/12162706 >> 172.21.15.32:0/12162706 conn(0x7fa6000999f0 msgr2=0x7fa6000d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 -- 172.21.15.32:0/12162706 shutdown_connections 2024-02-17T00:37:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.865+0000 7fa6071f4640 1 -- 172.21.15.32:0/12162706 wait complete. 2024-02-17T00:37:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.866+0000 7fa6071f4640 1 Processor -- start 2024-02-17T00:37:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.866+0000 7fa6071f4640 1 -- start start 2024-02-17T00:37:34.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa6071f4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 0x7fa600152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa6071f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa6000cd9c0 0x7fa60009b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa6071f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa6071f4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60009a440 con 0x7fa60006ab60 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa6071f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60009aca0 con 0x7fa6000cd9c0 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa6071f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60009b670 con 0x7fa6000d1140 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 0x7fa600152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 0x7fa600152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55500/0 (socket says 172.21.15.32:55500) 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 -- 172.21.15.32:0/3929552007 learned_addr learned my addr 172.21.15.32:0/3929552007 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa605791640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa5fffff640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa6000cd9c0 0x7fa60009b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 -- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 msgr2=0x7fa6000c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 -- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa6000cd9c0 msgr2=0x7fa60009b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa6000cd9c0 0x7fa60009b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 -- 172.21.15.32:0/3929552007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009400 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa604f90640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 0x7fa600152bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800cb10 tx=0x7fa5f800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.867+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800abb0 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.868+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f800ad10 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.868+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e8009400 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.868+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8012620 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.868+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60009a650 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.868+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa600068f60 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.869+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa5f8007070 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.869+0000 7fa5fd7fa640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5e006b810 0x7fa5e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.869+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fa5f808a4e0 con 0x7fa60006ab60 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.869+0000 7fa5fffff640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5e006b810 0x7fa5e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.870+0000 7fa5fffff640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5e006b810 0x7fa5e006dcd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097a0 tx=0x7fa5e803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:34.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:34.873+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5f8054b30 con 0x7fa60006ab60 2024-02-17T00:37:35.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.051+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6000b64e0 con 0x7fa60006ab60 2024-02-17T00:37:35.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.052+0000 7fa5fd7fa640 1 -- 172.21.15.32:0/3929552007 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5f80581f0 con 0x7fa60006ab60 2024-02-17T00:37:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5e006b810 msgr2=0x7fa5e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5e006b810 0x7fa5e006dcd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097a0 tx=0x7fa5e803d040 comp rx=0 tx=0).stop 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 msgr2=0x7fa600152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 0x7fa600152bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800cb10 tx=0x7fa5f800cf10 comp rx=0 tx=0).stop 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 shutdown_connections 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa5e006b810 0x7fa5e006dcd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa6000d1140 0x7fa6000c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa6000cd9c0 0x7fa60009b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 --2- 172.21.15.32:0/3929552007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa60006ab60 0x7fa600152bb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 >> 172.21.15.32:0/3929552007 conn(0x7fa6000999f0 msgr2=0x7fa6000afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:35.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 shutdown_connections 2024-02-17T00:37:35.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.054+0000 7fa6071f4640 1 -- 172.21.15.32:0/3929552007 wait complete. 2024-02-17T00:37:35.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:35.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.170+0000 7f5ccb179640 1 Processor -- start 2024-02-17T00:37:35.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.170+0000 7f5ccb179640 1 -- start start 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.171+0000 7f5ccb179640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5cc40d3760 0x7f5cc415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.171+0000 7f5ccb179640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40ce830 0x7f5cc40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.171+0000 7f5ccb179640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40ce380 con 0x7f5cc415f1c0 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.171+0000 7f5ccb179640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40ceff0 con 0x7f5cc40d3760 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.171+0000 7f5ccb179640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415f000 con 0x7f5cc40ce830 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc9716640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40ce830 0x7f5cc40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc8f15640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5cc40d3760 0x7f5cc415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc3fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5cc415f1c0 0x7f5cc40d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:33794/0 (socket says 172.21.15.32:33794) 2024-02-17T00:37:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc3fff640 1 -- 172.21.15.32:0/76506278 learned_addr learned my addr 172.21.15.32:0/76506278 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc8f15640 1 -- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40ce830 msgr2=0x7f5cc40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc8f15640 1 --2- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40ce830 0x7f5cc40b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc8f15640 1 -- 172.21.15.32:0/76506278 >> v1:172.21.15.39:6789/0 conn(0x7f5cc415f1c0 legacy=0x7f5cc40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc8f15640 1 -- 172.21.15.32:0/76506278 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40d2190 con 0x7f5cc40d3760 2024-02-17T00:37:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.172+0000 7f5cc9716640 1 --2- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40ce830 0x7f5cc40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.173+0000 7f5cc8f15640 1 --2- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40d3760 0x7f5cc415eac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009d90 tx=0x7f5cbc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b664ab0c3ca87ec server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.173+0000 7f5cc37fe640 1 -- 172.21.15.32:0/76506278 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc02cc50 con 0x7f5cc40d3760 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.173+0000 7f5cc37fe640 1 -- 172.21.15.32:0/76506278 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc02cdb0 con 0x7f5cc40d3760 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.173+0000 7f5cc37fe640 1 -- 172.21.15.32:0/76506278 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc034660 con 0x7f5cc40d3760 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 -- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40d3760 msgr2=0x7f5cc415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 --2- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40d3760 0x7f5cc415eac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009d90 tx=0x7f5cbc02bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 -- 172.21.15.32:0/76506278 shutdown_connections 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 --2- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40ce830 0x7f5cc40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 --2- 172.21.15.32:0/76506278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40d3760 0x7f5cc415eac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 -- 172.21.15.32:0/76506278 >> 172.21.15.32:0/76506278 conn(0x7f5cc4072680 msgr2=0x7f5cc4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 -- 172.21.15.32:0/76506278 shutdown_connections 2024-02-17T00:37:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.174+0000 7f5ccb179640 1 -- 172.21.15.32:0/76506278 wait complete. 2024-02-17T00:37:35.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.175+0000 7f5ccb179640 1 Processor -- start 2024-02-17T00:37:35.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.175+0000 7f5ccb179640 1 -- start start 2024-02-17T00:37:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40ce830 0x7f5cc41f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40d3760 0x7f5cc40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 0x7f5cc40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c8d30 con 0x7f5cc415f1c0 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc41463b0 con 0x7f5cc40ce830 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40caa40 con 0x7f5cc40d3760 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 0x7f5cc40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 0x7f5cc40cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55508/0 (socket says 172.21.15.32:55508) 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 -- 172.21.15.32:0/2324710021 learned_addr learned my addr 172.21.15.32:0/2324710021 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc8f15640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40ce830 0x7f5cc41f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc3fff640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40d3760 0x7f5cc40ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 -- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40d3760 msgr2=0x7f5cc40ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40d3760 0x7f5cc40ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 -- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40ce830 msgr2=0x7f5cc41f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40ce830 0x7f5cc41f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 -- 172.21.15.32:0/2324710021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009400 con 0x7f5cc415f1c0 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc3fff640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40d3760 0x7f5cc40ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc9716640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 0x7f5cc40cd080 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400e900 tx=0x7f5cb400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40096e0 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb400ca00 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb400cd70 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.176+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc009a70 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.177+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc40cb000 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.177+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4073ce0 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.178+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5cb4013470 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.178+0000 7f5cc17fa640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5ca406b810 0x7f5ca406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.179+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5cb408a740 con 0x7f5cc415f1c0 2024-02-17T00:37:35.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.179+0000 7f5cc8f15640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5ca406b810 0x7f5ca406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.179+0000 7f5cc8f15640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5ca406b810 0x7f5ca406dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc036000 tx=0x7f5cbc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.183+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5cb4054e80 con 0x7f5cc415f1c0 2024-02-17T00:37:35.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.367+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cc4068f60 con 0x7f5cc415f1c0 2024-02-17T00:37:35.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.368+0000 7f5cc17fa640 1 -- 172.21.15.32:0/2324710021 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cb4058540 con 0x7f5cc415f1c0 2024-02-17T00:37:35.371 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5ca406b810 msgr2=0x7f5ca406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5ca406b810 0x7f5ca406dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc036000 tx=0x7f5cbc030000 comp rx=0 tx=0).stop 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 msgr2=0x7f5cc40cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 0x7f5cc40cd080 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400e900 tx=0x7f5cb400edc0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 shutdown_connections 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc415f1c0 0x7f5cc40cd080 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5ca406b810 0x7f5ca406dcd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5cc40d3760 0x7f5cc40ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 --2- 172.21.15.32:0/2324710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cc40ce830 0x7f5cc41f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 >> 172.21.15.32:0/2324710021 conn(0x7f5cc4072680 msgr2=0x7f5cc40d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:35.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 shutdown_connections 2024-02-17T00:37:35.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.370+0000 7f5ccb179640 1 -- 172.21.15.32:0/2324710021 wait complete. 2024-02-17T00:37:35.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:35.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.485+0000 7f6f988b5640 1 Processor -- start 2024-02-17T00:37:35.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.485+0000 7f6f988b5640 1 -- start start 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f988b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940d0780 0x7f6f940d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f988b5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f940b9590 0x7f6f940b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f988b5640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940d10a0 con 0x7f6f940b9130 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f988b5640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940b7ef0 con 0x7f6f940b9590 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f988b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940b81d0 con 0x7f6f940d0780 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f92d9d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f940b9590 0x7f6f940b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f91d9b640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6f940b9130 0x7f6f940d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40146/0 (socket says 172.21.15.32:40146) 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f91d9b640 1 -- 172.21.15.32:0/1929061477 learned_addr learned my addr 172.21.15.32:0/1929061477 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f92d9d640 1 -- 172.21.15.32:0/1929061477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940d0780 msgr2=0x7f6f940d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f9259c640 1 --2- 172.21.15.32:0/1929061477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940d0780 0x7f6f940d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f9159a640 1 -- 172.21.15.32:0/1929061477 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739072677 0 0) 0x7f6f940d10a0 con 0x7f6f940b9130 2024-02-17T00:37:35.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f92d9d640 1 --2- 172.21.15.32:0/1929061477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940d0780 0x7f6f940d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f92d9d640 1 -- 172.21.15.32:0/1929061477 >> v1:172.21.15.32:6789/0 conn(0x7f6f940b9130 legacy=0x7f6f940d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.486+0000 7f6f92d9d640 1 -- 172.21.15.32:0/1929061477 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940b84b0 con 0x7f6f940b9590 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.487+0000 7f6f92d9d640 1 --2- 172.21.15.32:0/1929061477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940b78c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009d90 tx=0x7f6f8c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7773f548de45be6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.487+0000 7f6f9159a640 1 -- 172.21.15.32:0/1929061477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c02cc50 con 0x7f6f940b9590 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.487+0000 7f6f9159a640 1 -- 172.21.15.32:0/1929061477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c02cdb0 con 0x7f6f940b9590 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.487+0000 7f6f9159a640 1 -- 172.21.15.32:0/1929061477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c034660 con 0x7f6f940b9590 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 -- 172.21.15.32:0/1929061477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 msgr2=0x7f6f940b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1929061477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940b78c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009d90 tx=0x7f6f8c02bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 -- 172.21.15.32:0/1929061477 shutdown_connections 2024-02-17T00:37:35.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1929061477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940b78c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1929061477 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940d0780 0x7f6f940d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 -- 172.21.15.32:0/1929061477 >> 172.21.15.32:0/1929061477 conn(0x7f6f940726b0 msgr2=0x7f6f94072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:35.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 -- 172.21.15.32:0/1929061477 shutdown_connections 2024-02-17T00:37:35.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.488+0000 7f6f988b5640 1 -- 172.21.15.32:0/1929061477 wait complete. 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.489+0000 7f6f988b5640 1 Processor -- start 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.489+0000 7f6f988b5640 1 -- start start 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f988b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940b9130 0x7f6f941540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f988b5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f988b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f940d0780 0x7f6f9415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f988b5640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9415f510 con 0x7f6f940b9590 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f988b5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94155b20 con 0x7f6f940d0780 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f988b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940d37e0 con 0x7f6f940b9130 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55524/0 (socket says 172.21.15.32:55524) 2024-02-17T00:37:35.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 -- 172.21.15.32:0/1135013500 learned_addr learned my addr 172.21.15.32:0/1135013500 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f92d9d640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f940d0780 0x7f6f9415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f9259c640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940b9130 0x7f6f941540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 -- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940b9130 msgr2=0x7f6f941540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940b9130 0x7f6f941540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 -- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f940d0780 msgr2=0x7f6f9415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f940d0780 0x7f6f9415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 -- 172.21.15.32:0/1135013500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c009a70 con 0x7f6f940b9590 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f92d9d640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f940d0780 0x7f6f9415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f9259c640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940b9130 0x7f6f941540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f91d9b640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940c9a20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c4d0 tx=0x7f6f8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.490+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880074e0 con 0x7f6f940b9590 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.491+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88007660 con 0x7f6f940b9590 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.491+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9415ef50 con 0x7f6f940b9590 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.491+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88004a20 con 0x7f6f940b9590 2024-02-17T00:37:35.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.491+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94155dc0 con 0x7f6f940b9590 2024-02-17T00:37:35.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.492+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f94155980 con 0x7f6f940b9590 2024-02-17T00:37:35.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.492+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6f88004b80 con 0x7f6f940b9590 2024-02-17T00:37:35.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.492+0000 7f6f82ffd640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6f7406b810 0x7f6f7406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.493+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f6f880899b0 con 0x7f6f940b9590 2024-02-17T00:37:35.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.493+0000 7f6f9259c640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6f7406b810 0x7f6f7406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.493+0000 7f6f9259c640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6f7406b810 0x7f6f7406dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f84006fd0 tx=0x7f6f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.497+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f94155980 con 0x7f6f940b9590 2024-02-17T00:37:35.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.675+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6f94155980 con 0x7f6f940b9590 2024-02-17T00:37:35.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.676+0000 7f6f82ffd640 1 -- 172.21.15.32:0/1135013500 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6f94155980 con 0x7f6f940b9590 2024-02-17T00:37:35.680 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:35.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6f7406b810 msgr2=0x7f6f7406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6f7406b810 0x7f6f7406dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f84006fd0 tx=0x7f6f84008040 comp rx=0 tx=0).stop 2024-02-17T00:37:35.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 msgr2=0x7f6f940c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940c9a20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c4d0 tx=0x7f6f8800c990 comp rx=0 tx=0).stop 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 shutdown_connections 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f940d0780 0x7f6f9415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f940b9590 0x7f6f940c9a20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6f7406b810 0x7f6f7406dcd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 --2- 172.21.15.32:0/1135013500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6f940b9130 0x7f6f941540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 >> 172.21.15.32:0/1135013500 conn(0x7f6f940726b0 msgr2=0x7f6f940b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 shutdown_connections 2024-02-17T00:37:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.678+0000 7f6f988b5640 1 -- 172.21.15.32:0/1135013500 wait complete. 2024-02-17T00:37:35.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T00:37:35.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.792+0000 7f6a4ad6c640 1 Processor -- start 2024-02-17T00:37:35.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.792+0000 7f6a4ad6c640 1 -- start start 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a4ad6c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a4415b990 0x7f6a4409a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a4ad6c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a440c5950 0x7f6a4415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a4ad6c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4409ad90 con 0x7f6a440ccd10 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a4ad6c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440c5de0 con 0x7f6a440c5950 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a4ad6c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440cd560 con 0x7f6a4415b990 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a440c5950 0x7f6a4415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a440c5950 0x7f6a4415f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55528/0 (socket says 172.21.15.32:55528) 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 -- 172.21.15.32:0/360607416 learned_addr learned my addr 172.21.15.32:0/360607416 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a48b08640 1 --2- 172.21.15.32:0/360607416 >> v2:172.21.15.39:3300/0 conn(0x7f6a4415b990 0x7f6a4409a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 -- 172.21.15.32:0/360607416 >> v2:172.21.15.39:3300/0 conn(0x7f6a4415b990 msgr2=0x7f6a4409a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 --2- 172.21.15.32:0/360607416 >> v2:172.21.15.39:3300/0 conn(0x7f6a4415b990 0x7f6a4409a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 -- 172.21.15.32:0/360607416 >> v1:172.21.15.39:6789/0 conn(0x7f6a440ccd10 legacy=0x7f6a440c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.793+0000 7f6a49309640 1 -- 172.21.15.32:0/360607416 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44099a90 con 0x7f6a440c5950 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.794+0000 7f6a49309640 1 --2- 172.21.15.32:0/360607416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a4415f4d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a440727b0 tx=0x7f6a3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5669a5290c0220 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.794+0000 7f6a437fe640 1 -- 172.21.15.32:0/360607416 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34031870 con 0x7f6a440c5950 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.794+0000 7f6a437fe640 1 -- 172.21.15.32:0/360607416 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a340319d0 con 0x7f6a440c5950 2024-02-17T00:37:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.794+0000 7f6a437fe640 1 -- 172.21.15.32:0/360607416 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34031d60 con 0x7f6a440c5950 2024-02-17T00:37:35.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/360607416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 msgr2=0x7f6a4415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/360607416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a4415f4d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a440727b0 tx=0x7f6a3402b910 comp rx=0 tx=0).stop 2024-02-17T00:37:35.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/360607416 shutdown_connections 2024-02-17T00:37:35.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/360607416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a4415f4d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/360607416 >> v2:172.21.15.39:3300/0 conn(0x7f6a4415b990 0x7f6a4409a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/360607416 >> 172.21.15.32:0/360607416 conn(0x7f6a440d16f0 msgr2=0x7f6a440d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/360607416 shutdown_connections 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.795+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/360607416 wait complete. 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.796+0000 7f6a4ad6c640 1 Processor -- start 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.796+0000 7f6a4ad6c640 1 -- start start 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a441f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a440ccd10 0x7f6a440c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4415b990 0x7f6a440c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f7ef0 con 0x7f6a440c5950 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4409f390 con 0x7f6a4415b990 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4415ee50 con 0x7f6a440ccd10 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a441f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a441f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55544/0 (socket says 172.21.15.32:55544) 2024-02-17T00:37:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 -- 172.21.15.32:0/2569561171 learned_addr learned my addr 172.21.15.32:0/2569561171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a49309640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4415b990 0x7f6a440c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a43fff640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a440ccd10 0x7f6a440c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 -- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a440ccd10 msgr2=0x7f6a440c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a440ccd10 0x7f6a440c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 -- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4415b990 msgr2=0x7f6a440c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4415b990 0x7f6a440c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 -- 172.21.15.32:0/2569561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340094d0 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a48b08640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a441f79b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c007f20 tx=0x7f6a3c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c014620 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c014780 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4415e890 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c014b30 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.797+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4415c770 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.798+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a440d0c50 con 0x7f6a440c5950 2024-02-17T00:37:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.799+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6a3c014c90 con 0x7f6a440c5950 2024-02-17T00:37:35.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.799+0000 7f6a417fa640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a3006b810 0x7f6a3006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:35.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.799+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f6a3c08af20 con 0x7f6a440c5950 2024-02-17T00:37:35.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.799+0000 7f6a43fff640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a3006b810 0x7f6a3006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:35.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.800+0000 7f6a43fff640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a3006b810 0x7f6a3006dcd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6a38007fd0 tx=0x7f6a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.803+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a3c055660 con 0x7f6a440c5950 2024-02-17T00:37:35.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.995+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a44073ce0 con 0x7f6a440c5950 2024-02-17T00:37:35.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.996+0000 7f6a417fa640 1 -- 172.21.15.32:0/2569561171 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a3c058d20 con 0x7f6a440c5950 2024-02-17T00:37:35.999 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.997+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a3006b810 msgr2=0x7f6a3006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.997+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a3006b810 0x7f6a3006dcd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6a38007fd0 tx=0x7f6a38009040 comp rx=0 tx=0).stop 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.997+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 msgr2=0x7f6a441f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.997+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a441f79b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c007f20 tx=0x7f6a3c00e570 comp rx=0 tx=0).stop 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 shutdown_connections 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4415b990 0x7f6a440c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a3006b810 0x7f6a3006dcd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a440ccd10 0x7f6a440c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 --2- 172.21.15.32:0/2569561171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a440c5950 0x7f6a441f79b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 >> 172.21.15.32:0/2569561171 conn(0x7f6a440d16f0 msgr2=0x7f6a440cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:36.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 shutdown_connections 2024-02-17T00:37:36.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:35.998+0000 7f6a4ad6c640 1 -- 172.21.15.32:0/2569561171 wait complete. 2024-02-17T00:37:36.011 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-02-17T00:37:36.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:36.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-02-17T00:37:36.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:37:36.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:37:36.045 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T00:37:36.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:37:36.045 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-02-17T00:37:36.102 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-02-17T00:37:36.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:36.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.201+0000 7f43df33a640 1 Processor -- start 2024-02-17T00:37:36.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.201+0000 7f43df33a640 1 -- start start 2024-02-17T00:37:36.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43df33a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43d815da20 0x7f43d809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43df33a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d80d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43df33a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d80d06e0 con 0x7f43d80d10b0 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43df33a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d809a940 con 0x7f43d815da20 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43df33a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80cfad0 con 0x7f43d806bc70 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd0d6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43d815da20 0x7f43d809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dc8d5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d80d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd8d7640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f43d80d10b0 0x7f43d806c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:33818/0 (socket says 172.21.15.32:33818) 2024-02-17T00:37:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd8d7640 1 -- 172.21.15.32:0/1769036740 learned_addr learned my addr 172.21.15.32:0/1769036740 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd0d6640 1 -- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 msgr2=0x7f43d80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd0d6640 1 --2- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d80d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd0d6640 1 -- 172.21.15.32:0/1769036740 >> v1:172.21.15.39:6789/0 conn(0x7f43d80d10b0 legacy=0x7f43d806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dd0d6640 1 -- 172.21.15.32:0/1769036740 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d80cfdb0 con 0x7f43d815da20 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.202+0000 7f43dc8d5640 1 --2- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.203+0000 7f43dd0d6640 1 --2- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d809a400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43d40097a0 tx=0x7f43d402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d02f92c985e0f0c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.203+0000 7f43cffff640 1 -- 172.21.15.32:0/1769036740 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4031830 con 0x7f43d815da20 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.203+0000 7f43cffff640 1 -- 172.21.15.32:0/1769036740 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4031990 con 0x7f43d815da20 2024-02-17T00:37:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.203+0000 7f43cffff640 1 -- 172.21.15.32:0/1769036740 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4031d20 con 0x7f43d815da20 2024-02-17T00:37:36.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 -- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 msgr2=0x7f43d809a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 --2- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d809a400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43d40097a0 tx=0x7f43d402b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 -- 172.21.15.32:0/1769036740 shutdown_connections 2024-02-17T00:37:36.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 --2- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 --2- 172.21.15.32:0/1769036740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d809a400 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 -- 172.21.15.32:0/1769036740 >> 172.21.15.32:0/1769036740 conn(0x7f43d80d16f0 msgr2=0x7f43d80d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:36.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 -- 172.21.15.32:0/1769036740 shutdown_connections 2024-02-17T00:37:36.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.204+0000 7f43df33a640 1 -- 172.21.15.32:0/1769036740 wait complete. 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.205+0000 7f43df33a640 1 Processor -- start 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.205+0000 7f43df33a640 1 -- start start 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43df33a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d809e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43df33a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 0x7f43d809ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43df33a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d80b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43df33a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d809f510 con 0x7f43d80d10b0 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43df33a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d809ef80 con 0x7f43d815da20 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43df33a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d809f230 con 0x7f43d806bc70 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 0x7f43d809ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 0x7f43d809ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55560/0 (socket says 172.21.15.32:55560) 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 -- 172.21.15.32:0/2891582445 learned_addr learned my addr 172.21.15.32:0/2891582445 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:36.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dd8d7640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d80b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dd0d6640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d809e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 -- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 msgr2=0x7f43d809e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d809e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 -- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 msgr2=0x7f43d80b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d80b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 -- 172.21.15.32:0/2891582445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009400 con 0x7f43d80d10b0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.206+0000 7f43dc8d5640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 0x7f43d809ea40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e910 tx=0x7f43c800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.207+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c800ca00 con 0x7f43d80d10b0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.207+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c800cb60 con 0x7f43d80d10b0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.207+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8013470 con 0x7f43d80d10b0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.207+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d4009400 con 0x7f43d80d10b0 2024-02-17T00:37:36.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.207+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d80b58a0 con 0x7f43d80d10b0 2024-02-17T00:37:36.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.208+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d80d1f70 con 0x7f43d80d10b0 2024-02-17T00:37:36.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.208+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f43c80135d0 con 0x7f43d80d10b0 2024-02-17T00:37:36.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.208+0000 7f43cdffb640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f43bc06b810 0x7f43bc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.209+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f43c808a770 con 0x7f43d80d10b0 2024-02-17T00:37:36.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.209+0000 7f43dd0d6640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f43bc06b810 0x7f43bc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.209+0000 7f43dd0d6640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f43bc06b810 0x7f43bc06dcd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43d4036000 tx=0x7f43d403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.213+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43c8054ec0 con 0x7f43d80d10b0 2024-02-17T00:37:36.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.430+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43d809abe0 con 0x7f43d80d10b0 2024-02-17T00:37:36.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.431+0000 7f43cdffb640 1 -- 172.21.15.32:0/2891582445 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f43c8058580 con 0x7f43d80d10b0 2024-02-17T00:37:36.434 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:36.434 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:36.434 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:36.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f43bc06b810 msgr2=0x7f43bc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f43bc06b810 0x7f43bc06dcd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43d4036000 tx=0x7f43d403c040 comp rx=0 tx=0).stop 2024-02-17T00:37:36.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 msgr2=0x7f43d809ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 0x7f43d809ea40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e910 tx=0x7f43c800edd0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 shutdown_connections 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d815da20 0x7f43d80b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d80d10b0 0x7f43d809ea40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f43bc06b810 0x7f43bc06dcd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 --2- 172.21.15.32:0/2891582445 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43d806bc70 0x7f43d809e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 >> 172.21.15.32:0/2891582445 conn(0x7f43d80d16f0 msgr2=0x7f43d80cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 shutdown_connections 2024-02-17T00:37:36.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.433+0000 7f43df33a640 1 -- 172.21.15.32:0/2891582445 wait complete. 2024-02-17T00:37:36.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:36.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.545+0000 7f69c9ef4640 1 Processor -- start 2024-02-17T00:37:36.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.545+0000 7f69c9ef4640 1 -- start start 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c9ef4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f69c415da60 0x7f69c40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c9ef4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c9ef4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c415e8a0 con 0x7f69c4161d70 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c9ef4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c4161640 con 0x7f69c415da60 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c9ef4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415eb80 con 0x7f69c415de40 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c37fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f69c415da60 0x7f69c40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c3fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f69c4161d70 0x7f69c40ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:33826/0 (socket says 172.21.15.32:33826) 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c3fff640 1 -- 172.21.15.32:0/2334604382 learned_addr learned my addr 172.21.15.32:0/2334604382 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.546+0000 7f69c2ffd640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.547+0000 7f69c37fe640 1 -- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 msgr2=0x7f69c415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.547+0000 7f69c37fe640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.547+0000 7f69c37fe640 1 -- 172.21.15.32:0/2334604382 >> v1:172.21.15.39:6789/0 conn(0x7f69c4161d70 legacy=0x7f69c40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.547+0000 7f69c37fe640 1 -- 172.21.15.32:0/2334604382 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c415ee60 con 0x7f69c415da60 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.547+0000 7f69c2ffd640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.547+0000 7f69c37fe640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40d0aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f69b40097a0 tx=0x7f69b402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c76f6971a9e75b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c27fc640 1 -- 172.21.15.32:0/2334604382 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b402e070 con 0x7f69c415da60 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c27fc640 1 -- 172.21.15.32:0/2334604382 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40315a0 con 0x7f69c415da60 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c27fc640 1 -- 172.21.15.32:0/2334604382 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031930 con 0x7f69c415da60 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 -- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 msgr2=0x7f69c40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40d0aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f69b40097a0 tx=0x7f69b402b840 comp rx=0 tx=0).stop 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 -- 172.21.15.32:0/2334604382 shutdown_connections 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/2334604382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40d0aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 -- 172.21.15.32:0/2334604382 >> 172.21.15.32:0/2334604382 conn(0x7f69c406bfe0 msgr2=0x7f69c406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 -- 172.21.15.32:0/2334604382 shutdown_connections 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.548+0000 7f69c9ef4640 1 -- 172.21.15.32:0/2334604382 wait complete. 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.549+0000 7f69c9ef4640 1 Processor -- start 2024-02-17T00:37:36.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.549+0000 7f69c9ef4640 1 -- start start 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c9ef4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c9ef4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c40aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c9ef4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 0x7f69c414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c9ef4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c40b38a0 con 0x7f69c4161d70 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c9ef4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c414aa00 con 0x7f69c415da60 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c9ef4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4149df0 con 0x7f69c415de40 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 0x7f69c414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 0x7f69c414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55574/0 (socket says 172.21.15.32:55574) 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c3fff640 1 -- 172.21.15.32:0/1509666427 learned_addr learned my addr 172.21.15.32:0/1509666427 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.550+0000 7f69c2ffd640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c40aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c3fff640 1 -- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 msgr2=0x7f69c40aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c3fff640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c40aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c3fff640 1 -- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 msgr2=0x7f69c40b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c3fff640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c3fff640 1 -- 172.21.15.32:0/1509666427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8009400 con 0x7f69c4161d70 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c37fe640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c3fff640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 0x7f69c414bd00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00ca80 tx=0x7f69bc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00ac30 con 0x7f69c4161d70 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc00ad90 con 0x7f69c4161d70 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc012600 con 0x7f69c4161d70 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4009400 con 0x7f69c4161d70 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.551+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c414a3b0 con 0x7f69c4161d70 2024-02-17T00:37:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.552+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c40680c0 con 0x7f69c4161d70 2024-02-17T00:37:36.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.552+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f69bc007070 con 0x7f69c4161d70 2024-02-17T00:37:36.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.553+0000 7f69abfff640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f69b006b810 0x7f69b006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.553+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f69bc08a2e0 con 0x7f69c4161d70 2024-02-17T00:37:36.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.553+0000 7f69c37fe640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f69b006b810 0x7f69b006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.554+0000 7f69c37fe640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f69b006b810 0x7f69b006dcd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69b4036000 tx=0x7f69b403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.557+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69bc054ad0 con 0x7f69c4161d70 2024-02-17T00:37:36.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.740+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69c4068fd0 con 0x7f69c4161d70 2024-02-17T00:37:36.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.742+0000 7f69abfff640 1 -- 172.21.15.32:0/1509666427 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f69bc058190 con 0x7f69c4161d70 2024-02-17T00:37:36.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:36.745 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f69b006b810 msgr2=0x7f69b006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f69b006b810 0x7f69b006dcd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69b4036000 tx=0x7f69b403d040 comp rx=0 tx=0).stop 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 msgr2=0x7f69c414bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 0x7f69c414bd00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00ca80 tx=0x7f69bc00cf40 comp rx=0 tx=0).stop 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 shutdown_connections 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69c4161d70 0x7f69c414bd00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f69b006b810 0x7f69b006dcd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.743+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f69c415de40 0x7f69c40aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.744+0000 7f69c9ef4640 1 --2- 172.21.15.32:0/1509666427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c415da60 0x7f69c40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.744+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 >> 172.21.15.32:0/1509666427 conn(0x7f69c406bfe0 msgr2=0x7f69c4160c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.744+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 shutdown_connections 2024-02-17T00:37:36.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.744+0000 7f69c9ef4640 1 -- 172.21.15.32:0/1509666427 wait complete. 2024-02-17T00:37:36.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:36:35.858192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:36:36.382269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T00:36:40.072301+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T00:37:36.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:36.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.859+0000 7f6d5242e640 1 Processor -- start 2024-02-17T00:37:36.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.859+0000 7f6d5242e640 1 -- start start 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d5242e640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d4c0b78c0 0x7f6d4c1685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d5242e640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c0b7ef0 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d5242e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c0b81d0 con 0x7f6d4c0d0780 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d5242e640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c0b9840 con 0x7f6d4c0b78c0 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d509cb640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d4c0b78c0 0x7f6d4c1685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d4b7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6d4c0d2c40 0x7f6d4c0b9130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40154/0 (socket says 172.21.15.32:40154) 2024-02-17T00:37:36.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d4b7fe640 1 -- 172.21.15.32:0/1273281978 learned_addr learned my addr 172.21.15.32:0/1273281978 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d509cb640 1 -- 172.21.15.32:0/1273281978 >> v1:172.21.15.39:6789/0 conn(0x7f6d4c0d0780 legacy=0x7f6d4c0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d509cb640 1 -- 172.21.15.32:0/1273281978 >> v1:172.21.15.32:6789/0 conn(0x7f6d4c0d2c40 legacy=0x7f6d4c0b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d509cb640 1 -- 172.21.15.32:0/1273281978 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0b84b0 con 0x7f6d4c0b78c0 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.860+0000 7f6d4affd640 1 -- 172.21.15.32:0/1273281978 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679246144 0 0) 0x7f6d4c0b7ef0 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.861+0000 7f6d509cb640 1 --2- 172.21.15.32:0/1273281978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0b78c0 0x7f6d4c1685d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009d90 tx=0x7f6d4402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972c54fae24f682a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.861+0000 7f6d4affd640 1 -- 172.21.15.32:0/1273281978 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4402cd00 con 0x7f6d4c0b78c0 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.861+0000 7f6d4affd640 1 -- 172.21.15.32:0/1273281978 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4402ce60 con 0x7f6d4c0b78c0 2024-02-17T00:37:36.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.861+0000 7f6d4affd640 1 -- 172.21.15.32:0/1273281978 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44034660 con 0x7f6d4c0b78c0 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 -- 172.21.15.32:0/1273281978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0b78c0 msgr2=0x7f6d4c1685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 --2- 172.21.15.32:0/1273281978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0b78c0 0x7f6d4c1685d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009d90 tx=0x7f6d4402bf50 comp rx=0 tx=0).stop 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 -- 172.21.15.32:0/1273281978 shutdown_connections 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 --2- 172.21.15.32:0/1273281978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0b78c0 0x7f6d4c1685d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 -- 172.21.15.32:0/1273281978 >> 172.21.15.32:0/1273281978 conn(0x7f6d4c0726b0 msgr2=0x7f6d4c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 -- 172.21.15.32:0/1273281978 shutdown_connections 2024-02-17T00:37:36.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.862+0000 7f6d5242e640 1 -- 172.21.15.32:0/1273281978 wait complete. 2024-02-17T00:37:36.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.863+0000 7f6d5242e640 1 Processor -- start 2024-02-17T00:37:36.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.863+0000 7f6d5242e640 1 -- start start 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d5242e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6d4c0b78c0 0x7f6d4c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d5242e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c0d0780 0x7f6d4c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d5242e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 0x7f6d4c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d5242e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c152610 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d5242e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c7da0 con 0x7f6d4c0d0780 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d5242e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c8080 con 0x7f6d4c0b78c0 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 0x7f6d4c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 0x7f6d4c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55600/0 (socket says 172.21.15.32:55600) 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 -- 172.21.15.32:0/3303023249 learned_addr learned my addr 172.21.15.32:0/3303023249 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:36.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d4b7fe640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c0d0780 0x7f6d4c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d4bfff640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6d4c0b78c0 0x7f6d4c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 -- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6d4c0b78c0 msgr2=0x7f6d4c1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6d4c0b78c0 0x7f6d4c1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 -- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c0d0780 msgr2=0x7f6d4c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c0d0780 0x7f6d4c0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.864+0000 7f6d509cb640 1 -- 172.21.15.32:0/3303023249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44009a70 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.865+0000 7f6d509cb640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 0x7f6d4c0c97d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009d90 tx=0x7f6d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.865+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4403d600 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.865+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4403d780 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.865+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c0c8360 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.865+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4403db30 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.865+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c0c8920 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.866+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c0b6590 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.866+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6d4403b040 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.867+0000 7f6d48ff9640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6d3806b840 0x7f6d3806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:36.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.867+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f6d440ac150 con 0x7f6d4c0d2c40 2024-02-17T00:37:36.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.867+0000 7f6d4bfff640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6d3806b840 0x7f6d3806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:36.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.867+0000 7f6d4bfff640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6d3806b840 0x7f6d3806dd00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d40000f60 tx=0x7f6d40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:36.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:36.871+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d440768a0 con 0x7f6d4c0d2c40 2024-02-17T00:37:37.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.050+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d4c0685d0 con 0x7f6d4c0d2c40 2024-02-17T00:37:37.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.050+0000 7f6d48ff9640 1 -- 172.21.15.32:0/3303023249 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d44079f60 con 0x7f6d4c0d2c40 2024-02-17T00:37:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:37.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6d3806b840 msgr2=0x7f6d3806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6d3806b840 0x7f6d3806dd00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d40000f60 tx=0x7f6d40009040 comp rx=0 tx=0).stop 2024-02-17T00:37:37.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 msgr2=0x7f6d4c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 0x7f6d4c0c97d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009d90 tx=0x7f6d44004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 shutdown_connections 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d4c0d2c40 0x7f6d4c0c97d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c0d0780 0x7f6d4c0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6d3806b840 0x7f6d3806dd00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 --2- 172.21.15.32:0/3303023249 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6d4c0b78c0 0x7f6d4c1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 >> 172.21.15.32:0/3303023249 conn(0x7f6d4c0726b0 msgr2=0x7f6d4c1604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 shutdown_connections 2024-02-17T00:37:37.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.052+0000 7f6d5242e640 1 -- 172.21.15.32:0/3303023249 wait complete. 2024-02-17T00:37:37.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T00:37:37.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.167+0000 7f9e36a4d640 1 Processor -- start 2024-02-17T00:37:37.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.167+0000 7f9e36a4d640 1 -- start start 2024-02-17T00:37:37.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e36a4d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e300cfc40 0x7f9e300d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e36a4d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9e300cc580 0x7f9e300cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e36a4d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e300b25e0 con 0x7f9e300b1480 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e36a4d640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3015bec0 con 0x7f9e300cc580 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e36a4d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e300d0560 con 0x7f9e300cfc40 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9e300cc580 0x7f9e300cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9e300cc580 0x7f9e300cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55604/0 (socket says 172.21.15.32:55604) 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 -- 172.21.15.32:0/440862737 learned_addr learned my addr 172.21.15.32:0/440862737 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e2ffff640 1 --2- 172.21.15.32:0/440862737 >> v2:172.21.15.39:3300/0 conn(0x7f9e300cfc40 0x7f9e300d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 -- 172.21.15.32:0/440862737 >> v2:172.21.15.39:3300/0 conn(0x7f9e300cfc40 msgr2=0x7f9e300d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 --2- 172.21.15.32:0/440862737 >> v2:172.21.15.39:3300/0 conn(0x7f9e300cfc40 0x7f9e300d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 -- 172.21.15.32:0/440862737 >> v1:172.21.15.39:6789/0 conn(0x7f9e300b1480 legacy=0x7f9e300b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.168+0000 7f9e34fea640 1 -- 172.21.15.32:0/440862737 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300b19d0 con 0x7f9e300cc580 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.169+0000 7f9e34fea640 1 --2- 172.21.15.32:0/440862737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300cc580 0x7f9e300cc9d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e300cf110 tx=0x7f9e2802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ad9e9d5a5d8eb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.169+0000 7f9e2effd640 1 -- 172.21.15.32:0/440862737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2802ca80 con 0x7f9e300cc580 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.169+0000 7f9e2effd640 1 -- 172.21.15.32:0/440862737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2802cbe0 con 0x7f9e300cc580 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.169+0000 7f9e2effd640 1 -- 172.21.15.32:0/440862737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280343f0 con 0x7f9e300cc580 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 -- 172.21.15.32:0/440862737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300cc580 msgr2=0x7f9e300cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/440862737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300cc580 0x7f9e300cc9d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e300cf110 tx=0x7f9e2802bee0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 -- 172.21.15.32:0/440862737 shutdown_connections 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/440862737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300cc580 0x7f9e300cc9d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/440862737 >> v2:172.21.15.39:3300/0 conn(0x7f9e300cfc40 0x7f9e300d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 -- 172.21.15.32:0/440862737 >> 172.21.15.32:0/440862737 conn(0x7f9e3008af80 msgr2=0x7f9e3008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 -- 172.21.15.32:0/440862737 shutdown_connections 2024-02-17T00:37:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.170+0000 7f9e36a4d640 1 -- 172.21.15.32:0/440862737 wait complete. 2024-02-17T00:37:37.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.171+0000 7f9e36a4d640 1 Processor -- start 2024-02-17T00:37:37.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.171+0000 7f9e36a4d640 1 -- start start 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e36a4d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 0x7f9e301e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e36a4d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9e300cc580 0x7f9e301522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e36a4d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e300cfc40 0x7f9e3014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e36a4d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30152830 con 0x7f9e300b1480 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e36a4d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c8730 con 0x7f9e300cfc40 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e36a4d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c8fd0 con 0x7f9e300cc580 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 0x7f9e301e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 0x7f9e301e4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55618/0 (socket says 172.21.15.32:55618) 2024-02-17T00:37:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 -- 172.21.15.32:0/1983112154 learned_addr learned my addr 172.21.15.32:0/1983112154 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e34fea640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e300cfc40 0x7f9e3014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2f7fe640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9e300cc580 0x7f9e301522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 -- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9e300cc580 msgr2=0x7f9e301522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9e300cc580 0x7f9e301522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 -- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e300cfc40 msgr2=0x7f9e3014f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e300cfc40 0x7f9e3014f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.172+0000 7f9e2ffff640 1 -- 172.21.15.32:0/1983112154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28009b30 con 0x7f9e300b1480 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.173+0000 7f9e2ffff640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 0x7f9e301e4ce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400e8a0 tx=0x7f9e2400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.173+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240094f0 con 0x7f9e300b1480 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.173+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2400c940 con 0x7f9e300b1480 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.173+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400ccf0 con 0x7f9e300b1480 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.173+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3014fc60 con 0x7f9e300b1480 2024-02-17T00:37:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.173+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e300c8980 con 0x7f9e300b1480 2024-02-17T00:37:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.174+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e30068f60 con 0x7f9e300b1480 2024-02-17T00:37:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.174+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9e24013470 con 0x7f9e300b1480 2024-02-17T00:37:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.175+0000 7f9e2cff9640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9e1c06b810 0x7f9e1c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.175+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f9e2408a5e0 con 0x7f9e300b1480 2024-02-17T00:37:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.175+0000 7f9e2f7fe640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9e1c06b810 0x7f9e1c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.175+0000 7f9e2f7fe640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9e1c06b810 0x7f9e1c06dcd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e301f4b60 tx=0x7f9e20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.179+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9e24054ca0 con 0x7f9e300b1480 2024-02-17T00:37:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.360+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e300d0960 con 0x7f9e300b1480 2024-02-17T00:37:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.361+0000 7f9e2cff9640 1 -- 172.21.15.32:0/1983112154 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e24058360 con 0x7f9e300b1480 2024-02-17T00:37:37.363 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9e1c06b810 msgr2=0x7f9e1c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9e1c06b810 0x7f9e1c06dcd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e301f4b60 tx=0x7f9e20009040 comp rx=0 tx=0).stop 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 msgr2=0x7f9e301e4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 0x7f9e301e4ce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400e8a0 tx=0x7f9e2400ed60 comp rx=0 tx=0).stop 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 shutdown_connections 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e300cfc40 0x7f9e3014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9e1c06b810 0x7f9e1c06dcd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9e300cc580 0x7f9e301522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 --2- 172.21.15.32:0/1983112154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e300b1480 0x7f9e301e4ce0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 >> 172.21.15.32:0/1983112154 conn(0x7f9e3008af80 msgr2=0x7f9e30153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 shutdown_connections 2024-02-17T00:37:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.363+0000 7f9e36a4d640 1 -- 172.21.15.32:0/1983112154 wait complete. 2024-02-17T00:37:37.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T00:37:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.478+0000 7f5645a49640 1 Processor -- start 2024-02-17T00:37:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f5645a49640 1 -- start start 2024-02-17T00:37:37.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f5645a49640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f564015deb0 0x7f56400b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f5645a49640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f56400d3760 0x7f56400d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f5645a49640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400ce4c0 con 0x7f56400ce030 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f5645a49640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400d4110 con 0x7f564015deb0 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f5645a49640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400d1a40 con 0x7f56400d3760 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f563e7fc640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f56400ce030 0x7f56400b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40160/0 (socket says 172.21.15.32:40160) 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f563effd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f564015deb0 0x7f56400b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.479+0000 7f563e7fc640 1 -- 172.21.15.32:0/1906296387 learned_addr learned my addr 172.21.15.32:0/1906296387 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.480+0000 7f563f7fe640 1 --2- 172.21.15.32:0/1906296387 >> v2:172.21.15.39:3300/0 conn(0x7f56400d3760 0x7f56400d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.480+0000 7f563effd640 1 -- 172.21.15.32:0/1906296387 >> v2:172.21.15.39:3300/0 conn(0x7f56400d3760 msgr2=0x7f56400d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.480+0000 7f563effd640 1 --2- 172.21.15.32:0/1906296387 >> v2:172.21.15.39:3300/0 conn(0x7f56400d3760 0x7f56400d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.480+0000 7f563effd640 1 -- 172.21.15.32:0/1906296387 >> v1:172.21.15.32:6789/0 conn(0x7f56400ce030 legacy=0x7f56400b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.480+0000 7f563effd640 1 -- 172.21.15.32:0/1906296387 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400d1d20 con 0x7f564015deb0 2024-02-17T00:37:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f563effd640 1 --2- 172.21.15.32:0/1906296387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f56400b2c30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f56400b67b0 tx=0x7f563802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a963271233aa3c24 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f563dffb640 1 -- 172.21.15.32:0/1906296387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638031830 con 0x7f564015deb0 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f563dffb640 1 -- 172.21.15.32:0/1906296387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638031990 con 0x7f564015deb0 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f563dffb640 1 -- 172.21.15.32:0/1906296387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638031d20 con 0x7f564015deb0 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 -- 172.21.15.32:0/1906296387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 msgr2=0x7f56400b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 --2- 172.21.15.32:0/1906296387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f56400b2c30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f56400b67b0 tx=0x7f563802b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 -- 172.21.15.32:0/1906296387 shutdown_connections 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 --2- 172.21.15.32:0/1906296387 >> v2:172.21.15.39:3300/0 conn(0x7f56400d3760 0x7f56400d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 --2- 172.21.15.32:0/1906296387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f56400b2c30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 -- 172.21.15.32:0/1906296387 >> 172.21.15.32:0/1906296387 conn(0x7f56400726b0 msgr2=0x7f5640072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 -- 172.21.15.32:0/1906296387 shutdown_connections 2024-02-17T00:37:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.481+0000 7f5645a49640 1 -- 172.21.15.32:0/1906296387 wait complete. 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.482+0000 7f5645a49640 1 Processor -- start 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 -- start start 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56400ce030 0x7f5640154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56400d3760 0x7f56401602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f5640160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400b4f90 con 0x7f564015deb0 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400b5270 con 0x7f56400ce030 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f5645a49640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400b5550 con 0x7f56400d3760 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f5640160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f5640160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55636/0 (socket says 172.21.15.32:55636) 2024-02-17T00:37:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.483+0000 7f563f7fe640 1 -- 172.21.15.32:0/782291610 learned_addr learned my addr 172.21.15.32:0/782291610 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563effd640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56400ce030 0x7f5640154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563e7fc640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56400d3760 0x7f56401602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563f7fe640 1 -- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56400d3760 msgr2=0x7f56401602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563f7fe640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56400d3760 0x7f56401602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563f7fe640 1 -- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56400ce030 msgr2=0x7f5640154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563f7fe640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56400ce030 0x7f5640154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563f7fe640 1 -- 172.21.15.32:0/782291610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009400 con 0x7f564015deb0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f563f7fe640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f5640160820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f563000efc0 tx=0x7f563000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630014480 con 0x7f564015deb0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563000f040 con 0x7f564015deb0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56400b5830 con 0x7f564015deb0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630014820 con 0x7f564015deb0 2024-02-17T00:37:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.484+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56400b4c60 con 0x7f564015deb0 2024-02-17T00:37:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.485+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5640068f60 con 0x7f564015deb0 2024-02-17T00:37:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.485+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5630014980 con 0x7f564015deb0 2024-02-17T00:37:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.486+0000 7f5637fff640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f562006b810 0x7f562006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.486+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f563008b130 con 0x7f564015deb0 2024-02-17T00:37:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.486+0000 7f563effd640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f562006b810 0x7f562006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.486+0000 7f563effd640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f562006b810 0x7f562006dcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5638036000 tx=0x7f563803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.490+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5630055760 con 0x7f564015deb0 2024-02-17T00:37:37.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.670+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56400c8420 con 0x7f564015deb0 2024-02-17T00:37:37.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.671+0000 7f5637fff640 1 -- 172.21.15.32:0/782291610 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56300180a0 con 0x7f564015deb0 2024-02-17T00:37:37.674 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f562006b810 msgr2=0x7f562006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f562006b810 0x7f562006dcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5638036000 tx=0x7f563803c040 comp rx=0 tx=0).stop 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 msgr2=0x7f5640160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f5640160820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f563000efc0 tx=0x7f563000c490 comp rx=0 tx=0).stop 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 shutdown_connections 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f564015deb0 0x7f5640160820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f562006b810 0x7f562006dcd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f56400d3760 0x7f56401602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 --2- 172.21.15.32:0/782291610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56400ce030 0x7f5640154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 >> 172.21.15.32:0/782291610 conn(0x7f56400726b0 msgr2=0x7f56400c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 shutdown_connections 2024-02-17T00:37:37.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.673+0000 7f5645a49640 1 -- 172.21.15.32:0/782291610 wait complete. 2024-02-17T00:37:37.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T00:37:37.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.788+0000 7f3f5d61c640 1 Processor -- start 2024-02-17T00:37:37.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.788+0000 7f3f5d61c640 1 -- start start 2024-02-17T00:37:37.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f5d61c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f580b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f5d61c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f580ce610 0x7f3f580cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f5d61c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f580b2ee0 con 0x7f3f58143fb0 2024-02-17T00:37:37.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f5d61c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580b4750 con 0x7f3f580ce610 2024-02-17T00:37:37.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f5d61c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580b3150 con 0x7f3f5806e950 2024-02-17T00:37:37.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f580ce610 0x7f3f580cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f580ce610 0x7f3f580cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55650/0 (socket says 172.21.15.32:55650) 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 -- 172.21.15.32:0/3553367274 learned_addr learned my addr 172.21.15.32:0/3553367274 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f4ffff640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f580b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 -- 172.21.15.32:0/3553367274 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 msgr2=0x7f3f580b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f580b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 -- 172.21.15.32:0/3553367274 >> v1:172.21.15.39:6789/0 conn(0x7f3f58143fb0 legacy=0x7f3f5806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f577fe640 1 -- 172.21.15.32:0/3553367274 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580b3430 con 0x7f3f580ce610 2024-02-17T00:37:37.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.789+0000 7f3f4ffff640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f580b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:37.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.790+0000 7f3f577fe640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f580ce610 0x7f3f580cea60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009e50 tx=0x7f3f5002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496c4dc6251c1f25 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.790+0000 7f3f567fc640 1 -- 172.21.15.32:0/3553367274 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5002cb00 con 0x7f3f580ce610 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.790+0000 7f3f567fc640 1 -- 172.21.15.32:0/3553367274 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5002cc60 con 0x7f3f580ce610 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.790+0000 7f3f567fc640 1 -- 172.21.15.32:0/3553367274 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500343f0 con 0x7f3f580ce610 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 -- 172.21.15.32:0/3553367274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f580ce610 msgr2=0x7f3f580cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f580ce610 0x7f3f580cea60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009e50 tx=0x7f3f5002bf60 comp rx=0 tx=0).stop 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 -- 172.21.15.32:0/3553367274 shutdown_connections 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f580ce610 0x7f3f580cea60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/3553367274 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f580b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 -- 172.21.15.32:0/3553367274 >> 172.21.15.32:0/3553367274 conn(0x7f3f5806ab60 msgr2=0x7f3f5806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 -- 172.21.15.32:0/3553367274 shutdown_connections 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.791+0000 7f3f5d61c640 1 -- 172.21.15.32:0/3553367274 wait complete. 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.792+0000 7f3f5d61c640 1 Processor -- start 2024-02-17T00:37:37.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.792+0000 7f3f5d61c640 1 -- start start 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f5d61c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f5813c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f5d61c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f580ce610 0x7f3f581e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f5d61c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 0x7f3f58140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f5d61c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581f1210 con 0x7f3f58143fb0 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f5d61c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5813ce70 con 0x7f3f580ce610 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f5d61c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5813d150 con 0x7f3f5806e950 2024-02-17T00:37:37.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 0x7f3f58140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 0x7f3f58140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55658/0 (socket says 172.21.15.32:55658) 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 -- 172.21.15.32:0/4087121673 learned_addr learned my addr 172.21.15.32:0/4087121673 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f4ffff640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f580ce610 0x7f3f581e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f56ffd640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f5813c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 -- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 msgr2=0x7f3f5813c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f5813c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 -- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f580ce610 msgr2=0x7f3f581e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f580ce610 0x7f3f581e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 -- 172.21.15.32:0/4087121673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50009b30 con 0x7f3f58143fb0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f577fe640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 0x7f3f58140d10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009e50 tx=0x7f3f50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.793+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50009510 con 0x7f3f58143fb0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.794+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5003e450 con 0x7f3f58143fb0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.794+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5813d430 con 0x7f3f58143fb0 2024-02-17T00:37:37.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.794+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5003e800 con 0x7f3f58143fb0 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.794+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f58141250 con 0x7f3f58143fb0 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.795+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f58067c90 con 0x7f3f58143fb0 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.795+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3f5003e960 con 0x7f3f58143fb0 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.795+0000 7f3f4f7fe640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f3806b840 0x7f3f3806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.795+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f3f500ad270 con 0x7f3f58143fb0 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.796+0000 7f3f56ffd640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f3806b840 0x7f3f3806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:37.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.796+0000 7f3f56ffd640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f3806b840 0x7f3f3806dd00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3f480016e0 tx=0x7f3f48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:37.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.800+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f500778a0 con 0x7f3f58143fb0 2024-02-17T00:37:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.978+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f58068f60 con 0x7f3f58143fb0 2024-02-17T00:37:37.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.979+0000 7f3f4f7fe640 1 -- 172.21.15.32:0/4087121673 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f5007af60 con 0x7f3f58143fb0 2024-02-17T00:37:37.982 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T00:37:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.980+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f3806b840 msgr2=0x7f3f3806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.980+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f3806b840 0x7f3f3806dd00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3f480016e0 tx=0x7f3f48009040 comp rx=0 tx=0).stop 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.980+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 msgr2=0x7f3f58140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.980+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 0x7f3f58140d10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009e50 tx=0x7f3f50004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 shutdown_connections 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f58143fb0 0x7f3f58140d10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f580ce610 0x7f3f581e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f3806b840 0x7f3f3806dd00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 --2- 172.21.15.32:0/4087121673 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f5806e950 0x7f3f5813c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 >> 172.21.15.32:0/4087121673 conn(0x7f3f5806ab60 msgr2=0x7f3f5806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 shutdown_connections 2024-02-17T00:37:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:37.981+0000 7f3f5d61c640 1 -- 172.21.15.32:0/4087121673 wait complete. 2024-02-17T00:37:37.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:38.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.093+0000 7ffa64f65640 1 Processor -- start 2024-02-17T00:37:38.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.093+0000 7ffa64f65640 1 -- start start 2024-02-17T00:37:38.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa64f65640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffa6015d7b0 0x7ffa6006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa64f65640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa64f65640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa601618f0 con 0x7ffa6006ab60 2024-02-17T00:37:38.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa64f65640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa60161bd0 con 0x7ffa6015d7b0 2024-02-17T00:37:38.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa64f65640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60161eb0 con 0x7ffa600b53c0 2024-02-17T00:37:38.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5ed9d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ffa6006ab60 0x7ffa600b3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40172/0 (socket says 172.21.15.32:40172) 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5ed9d640 1 -- 172.21.15.32:0/1469669569 learned_addr learned my addr 172.21.15.32:0/1469669569 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5e59c640 1 --2- 172.21.15.32:0/1469669569 >> v2:172.21.15.39:3300/0 conn(0x7ffa6015d7b0 0x7ffa6006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa57fff640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5dd9b640 1 -- 172.21.15.32:0/1469669569 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162405358 0 0) 0x7ffa601618f0 con 0x7ffa6006ab60 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5dd9b640 1 -- 172.21.15.32:0/1469669569 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa4c003520 con 0x7ffa6006ab60 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5e59c640 1 -- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 msgr2=0x7ffa600b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5e59c640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5e59c640 1 -- 172.21.15.32:0/1469669569 >> v1:172.21.15.32:6789/0 conn(0x7ffa6006ab60 legacy=0x7ffa600b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5dd9b640 1 -- 172.21.15.32:0/1469669569 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1515533428 0 0) 0x7ffa4c003520 con 0x7ffa6006ab60 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa5e59c640 1 -- 172.21.15.32:0/1469669569 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60162190 con 0x7ffa6015d7b0 2024-02-17T00:37:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.094+0000 7ffa57fff640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:38.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.095+0000 7ffa5e59c640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 0x7ffa6006fa00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa500097a0 tx=0x7ffa5002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b42b7107cf688a50 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.095+0000 7ffa5dd9b640 1 -- 172.21.15.32:0/1469669569 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580019f0 con 0x7ffa6015d7b0 2024-02-17T00:37:38.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.095+0000 7ffa5dd9b640 1 -- 172.21.15.32:0/1469669569 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5002e050 con 0x7ffa6015d7b0 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.095+0000 7ffa5dd9b640 1 -- 172.21.15.32:0/1469669569 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50030730 con 0x7ffa6015d7b0 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 -- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 msgr2=0x7ffa6006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 0x7ffa6006fa00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa500097a0 tx=0x7ffa5002b790 comp rx=0 tx=0).stop 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 -- 172.21.15.32:0/1469669569 shutdown_connections 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 --2- 172.21.15.32:0/1469669569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 0x7ffa6006fa00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 -- 172.21.15.32:0/1469669569 >> 172.21.15.32:0/1469669569 conn(0x7ffa600b2390 msgr2=0x7ffa600b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 -- 172.21.15.32:0/1469669569 shutdown_connections 2024-02-17T00:37:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.096+0000 7ffa64f65640 1 -- 172.21.15.32:0/1469669569 wait complete. 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.097+0000 7ffa64f65640 1 Processor -- start 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.097+0000 7ffa64f65640 1 -- start start 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa64f65640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 0x7ffa6014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa64f65640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa64f65640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 0x7ffa600cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa64f65640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6014f950 con 0x7ffa6006ab60 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa64f65640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600adde0 con 0x7ffa6015d7b0 2024-02-17T00:37:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa64f65640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6014f670 con 0x7ffa600b53c0 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 0x7ffa6014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 0x7ffa6014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55660/0 (socket says 172.21.15.32:55660) 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 -- 172.21.15.32:0/2966987963 learned_addr learned my addr 172.21.15.32:0/2966987963 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa57fff640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 -- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 msgr2=0x7ffa600aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 -- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 msgr2=0x7ffa600cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 0x7ffa600cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 -- 172.21.15.32:0/2966987963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009400 con 0x7ffa6006ab60 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.098+0000 7ffa5e59c640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 0x7ffa6014bf80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa50000c00 tx=0x7ffa500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.099+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5003b810 con 0x7ffa6006ab60 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.099+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5003b970 con 0x7ffa6006ab60 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.099+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa50009400 con 0x7ffa6006ab60 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.099+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5003bd20 con 0x7ffa6006ab60 2024-02-17T00:37:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.099+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa600ae360 con 0x7ffa6006ab60 2024-02-17T00:37:38.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.100+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa60068fd0 con 0x7ffa6006ab60 2024-02-17T00:37:38.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.100+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ffa50039040 con 0x7ffa6006ab60 2024-02-17T00:37:38.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.100+0000 7ffa56ffd640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffa4006b840 0x7ffa4006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.101+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7ffa500abba0 con 0x7ffa6006ab60 2024-02-17T00:37:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.101+0000 7ffa57fff640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffa4006b840 0x7ffa4006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.101+0000 7ffa57fff640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffa4006b840 0x7ffa4006dd00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa600abdc0 tx=0x7ffa48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.106+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa500762e0 con 0x7ffa6006ab60 2024-02-17T00:37:38.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.325+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa600af4c0 con 0x7ffa6006ab60 2024-02-17T00:37:38.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.325+0000 7ffa56ffd640 1 -- 172.21.15.32:0/2966987963 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7ffa500799a0 con 0x7ffa6006ab60 2024-02-17T00:37:38.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:38.328 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:38.328 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:38.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffa4006b840 msgr2=0x7ffa4006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffa4006b840 0x7ffa4006dd00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa600abdc0 tx=0x7ffa48008040 comp rx=0 tx=0).stop 2024-02-17T00:37:38.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 msgr2=0x7ffa6014bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 0x7ffa6014bf80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa50000c00 tx=0x7ffa500046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 shutdown_connections 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa6015d7b0 0x7ffa600cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ffa4006b840 0x7ffa4006dd00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ffa600b53c0 0x7ffa600aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 --2- 172.21.15.32:0/2966987963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6006ab60 0x7ffa6014bf80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 >> 172.21.15.32:0/2966987963 conn(0x7ffa600b2390 msgr2=0x7ffa6015f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 shutdown_connections 2024-02-17T00:37:38.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.327+0000 7ffa64f65640 1 -- 172.21.15.32:0/2966987963 wait complete. 2024-02-17T00:37:38.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:38.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.440+0000 7fcf9a8ae640 1 Processor -- start 2024-02-17T00:37:38.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.440+0000 7fcf9a8ae640 1 -- start start 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf9a8ae640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf9415dd00 0x7fcf940b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf9a8ae640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcf9406c6c0 0x7fcf940b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf9a8ae640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9415e0e0 con 0x7fcf940b6a40 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf9a8ae640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9406cfe0 con 0x7fcf9406c6c0 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf9a8ae640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9406cd00 con 0x7fcf9415dd00 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcf9406c6c0 0x7fcf940b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcf9406c6c0 0x7fcf940b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55672/0 (socket says 172.21.15.32:55672) 2024-02-17T00:37:38.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 -- 172.21.15.32:0/3169506363 learned_addr learned my addr 172.21.15.32:0/3169506363 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:38.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf93fff640 1 --2- 172.21.15.32:0/3169506363 >> v2:172.21.15.39:3300/0 conn(0x7fcf9415dd00 0x7fcf940b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 -- 172.21.15.32:0/3169506363 >> v2:172.21.15.39:3300/0 conn(0x7fcf9415dd00 msgr2=0x7fcf940b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:38.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 --2- 172.21.15.32:0/3169506363 >> v2:172.21.15.39:3300/0 conn(0x7fcf9415dd00 0x7fcf940b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 -- 172.21.15.32:0/3169506363 >> v1:172.21.15.39:6789/0 conn(0x7fcf940b6a40 legacy=0x7fcf9406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:38.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.441+0000 7fcf98e4b640 1 -- 172.21.15.32:0/3169506363 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940d1ca0 con 0x7fcf9406c6c0 2024-02-17T00:37:38.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf98e4b640 1 --2- 172.21.15.32:0/3169506363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf9406c6c0 0x7fcf940b5c90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcf940d4920 tx=0x7fcf8c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3636f609cc04ec6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf92ffd640 1 -- 172.21.15.32:0/3169506363 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c02cb20 con 0x7fcf9406c6c0 2024-02-17T00:37:38.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf92ffd640 1 -- 172.21.15.32:0/3169506363 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c02cc80 con 0x7fcf9406c6c0 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf92ffd640 1 -- 172.21.15.32:0/3169506363 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0343f0 con 0x7fcf9406c6c0 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/3169506363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf9406c6c0 msgr2=0x7fcf940b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/3169506363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf9406c6c0 0x7fcf940b5c90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcf940d4920 tx=0x7fcf8c02bf80 comp rx=0 tx=0).stop 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/3169506363 shutdown_connections 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/3169506363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf9406c6c0 0x7fcf940b5c90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/3169506363 >> v2:172.21.15.39:3300/0 conn(0x7fcf9415dd00 0x7fcf940b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.442+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/3169506363 >> 172.21.15.32:0/3169506363 conn(0x7fcf940d07b0 msgr2=0x7fcf940d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.443+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/3169506363 shutdown_connections 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.443+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/3169506363 wait complete. 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.444+0000 7fcf9a8ae640 1 Processor -- start 2024-02-17T00:37:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.444+0000 7fcf9a8ae640 1 -- start start 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.444+0000 7fcf9a8ae640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf9406c6c0 0x7fcf941f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.444+0000 7fcf9a8ae640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 0x7fcf940c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.444+0000 7fcf9a8ae640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf9415dd00 0x7fcf94157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf9a8ae640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9415f2d0 con 0x7fcf940b6a40 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf9a8ae640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940ca360 con 0x7fcf9415dd00 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf9a8ae640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941f4360 con 0x7fcf9406c6c0 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 0x7fcf940c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 0x7fcf940c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55684/0 (socket says 172.21.15.32:55684) 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 -- 172.21.15.32:0/697042461 learned_addr learned my addr 172.21.15.32:0/697042461 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf93fff640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf9406c6c0 0x7fcf941f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf98e4b640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf9415dd00 0x7fcf94157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 -- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf9406c6c0 msgr2=0x7fcf941f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf9406c6c0 0x7fcf941f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 -- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf9415dd00 msgr2=0x7fcf94157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf9415dd00 0x7fcf94157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 -- 172.21.15.32:0/697042461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c009b30 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf937fe640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 0x7fcf940c9e20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c460 tx=0x7fcf8400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84011790 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84011930 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9415f4e0 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84011ce0 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.445+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9415faa0 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.446+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf940680c0 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.447+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcf8401c460 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.447+0000 7fcf90ff9640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcf8006b840 0x7fcf8006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.447+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fcf8408a260 con 0x7fcf940b6a40 2024-02-17T00:37:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.447+0000 7fcf93fff640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcf8006b840 0x7fcf8006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.448+0000 7fcf93fff640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcf8006b840 0x7fcf8006dd00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf94159b90 tx=0x7fcf88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.451+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf84054a50 con 0x7fcf940b6a40 2024-02-17T00:37:38.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.632+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf94068fd0 con 0x7fcf940b6a40 2024-02-17T00:37:38.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.633+0000 7fcf90ff9640 1 -- 172.21.15.32:0/697042461 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7fcf84058110 con 0x7fcf940b6a40 2024-02-17T00:37:38.636 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:38.636 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcf8006b840 msgr2=0x7fcf8006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcf8006b840 0x7fcf8006dd00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf94159b90 tx=0x7fcf88008040 comp rx=0 tx=0).stop 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 msgr2=0x7fcf940c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 0x7fcf940c9e20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c460 tx=0x7fcf8400c920 comp rx=0 tx=0).stop 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 shutdown_connections 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf9415dd00 0x7fcf94157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf940b6a40 0x7fcf940c9e20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcf8006b840 0x7fcf8006dd00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 --2- 172.21.15.32:0/697042461 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf9406c6c0 0x7fcf941f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 >> 172.21.15.32:0/697042461 conn(0x7fcf940d07b0 msgr2=0x7fcf9415bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:38.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 shutdown_connections 2024-02-17T00:37:38.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.635+0000 7fcf9a8ae640 1 -- 172.21.15.32:0/697042461 wait complete. 2024-02-17T00:37:38.649 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T00:37:38.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:38.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.747+0000 7fa84ff65640 1 Processor -- start 2024-02-17T00:37:38.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.748+0000 7fa84ff65640 1 -- start start 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.748+0000 7fa84ff65640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815da60 0x7fa8480d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.748+0000 7fa84ff65640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa84815de40 0x7fa84815e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.748+0000 7fa84ff65640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84815e8a0 con 0x7fa848161d70 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.748+0000 7fa84ff65640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa848161640 con 0x7fa84815de40 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.748+0000 7fa84ff65640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84815eb80 con 0x7fa84815da60 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84d500640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa84815de40 0x7fa84815e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84e502640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa848161d70 0x7fa8480ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40180/0 (socket says 172.21.15.32:40180) 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84e502640 1 -- 172.21.15.32:0/738818139 learned_addr learned my addr 172.21.15.32:0/738818139 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84d500640 1 --2- 172.21.15.32:0/738818139 >> v2:172.21.15.32:3300/0 conn(0x7fa84815de40 0x7fa84815e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55696/0 (socket says 172.21.15.32:55696) 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84dd01640 1 --2- 172.21.15.32:0/738818139 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815da60 0x7fa8480d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84d500640 1 -- 172.21.15.32:0/738818139 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815da60 msgr2=0x7fa8480d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84d500640 1 --2- 172.21.15.32:0/738818139 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815da60 0x7fa8480d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84d500640 1 -- 172.21.15.32:0/738818139 >> v1:172.21.15.32:6789/0 conn(0x7fa848161d70 legacy=0x7fa8480ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84d500640 1 -- 172.21.15.32:0/738818139 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84815ee60 con 0x7fa84815de40 2024-02-17T00:37:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.749+0000 7fa84ccff640 1 -- 172.21.15.32:0/738818139 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810123221 0 0) 0x7fa84815e8a0 con 0x7fa848161d70 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84d500640 1 --2- 172.21.15.32:0/738818139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815de40 0x7fa84815e2a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0097a0 tx=0x7fa83c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed43e450d37937ed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ccff640 1 -- 172.21.15.32:0/738818139 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02e070 con 0x7fa84815de40 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ccff640 1 -- 172.21.15.32:0/738818139 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c0315a0 con 0x7fa84815de40 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ccff640 1 -- 172.21.15.32:0/738818139 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c031930 con 0x7fa84815de40 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ff65640 1 -- 172.21.15.32:0/738818139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815de40 msgr2=0x7fa84815e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ff65640 1 --2- 172.21.15.32:0/738818139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815de40 0x7fa84815e2a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0097a0 tx=0x7fa83c02b840 comp rx=0 tx=0).stop 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ff65640 1 -- 172.21.15.32:0/738818139 shutdown_connections 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ff65640 1 --2- 172.21.15.32:0/738818139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815de40 0x7fa84815e2a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ff65640 1 --2- 172.21.15.32:0/738818139 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815da60 0x7fa8480d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.750+0000 7fa84ff65640 1 -- 172.21.15.32:0/738818139 >> 172.21.15.32:0/738818139 conn(0x7fa84806bfe0 msgr2=0x7fa84806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.751+0000 7fa84ff65640 1 -- 172.21.15.32:0/738818139 shutdown_connections 2024-02-17T00:37:38.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.751+0000 7fa84ff65640 1 -- 172.21.15.32:0/738818139 wait complete. 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 Processor -- start 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 -- start start 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 0x7fa848155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815de40 0x7fa848158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa848161d70 0x7fa8480cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480cb8f0 con 0x7fa84815da60 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480cace0 con 0x7fa848161d70 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.752+0000 7fa84ff65640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480cafc0 con 0x7fa84815de40 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 0x7fa848155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 0x7fa848155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55702/0 (socket says 172.21.15.32:55702) 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 -- 172.21.15.32:0/3565729141 learned_addr learned my addr 172.21.15.32:0/3565729141 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84d500640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815de40 0x7fa848158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84e502640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa848161d70 0x7fa8480cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 -- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815de40 msgr2=0x7fa848158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815de40 0x7fa848158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 -- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa848161d70 msgr2=0x7fa8480cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa848161d70 0x7fa8480cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 -- 172.21.15.32:0/3565729141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009400 con 0x7fa84815da60 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84dd01640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 0x7fa848155000 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa83800ce10 tx=0x7fa83800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838003b90 con 0x7fa84815da60 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838003cf0 con 0x7fa84815da60 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480cb2a0 con 0x7fa84815da60 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838003ea0 con 0x7fa84815da60 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.753+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480ca920 con 0x7fa84815da60 2024-02-17T00:37:38.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.754+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8480680c0 con 0x7fa84815da60 2024-02-17T00:37:38.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.755+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa838004240 con 0x7fa84815da60 2024-02-17T00:37:38.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.755+0000 7fa8467fc640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa83406b840 0x7fa83406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:38.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.755+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fa838012070 con 0x7fa84815da60 2024-02-17T00:37:38.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.755+0000 7fa84d500640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa83406b840 0x7fa83406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:38.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.756+0000 7fa84d500640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa83406b840 0x7fa83406dd00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa83c036000 tx=0x7fa83c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:38.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.759+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa838055670 con 0x7fa84815da60 2024-02-17T00:37:38.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.974+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa848068fd0 con 0x7fa84815da60 2024-02-17T00:37:38.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.975+0000 7fa8467fc640 1 -- 172.21.15.32:0/3565729141 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fa838058d30 con 0x7fa84815da60 2024-02-17T00:37:38.978 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:38.978 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:38.978 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa83406b840 msgr2=0x7fa83406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa83406b840 0x7fa83406dd00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa83c036000 tx=0x7fa83c03d040 comp rx=0 tx=0).stop 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 msgr2=0x7fa848155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 0x7fa848155000 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa83800ce10 tx=0x7fa83800a660 comp rx=0 tx=0).stop 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 shutdown_connections 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa848161d70 0x7fa8480cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fa83406b840 0x7fa83406dd00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa84815de40 0x7fa848158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 --2- 172.21.15.32:0/3565729141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa84815da60 0x7fa848155000 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 >> 172.21.15.32:0/3565729141 conn(0x7fa84806bfe0 msgr2=0x7fa848160900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:38.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 shutdown_connections 2024-02-17T00:37:38.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:38.977+0000 7fa84ff65640 1 -- 172.21.15.32:0/3565729141 wait complete. 2024-02-17T00:37:38.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:39.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.089+0000 7f9065d8a640 1 Processor -- start 2024-02-17T00:37:39.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.089+0000 7f9065d8a640 1 -- start start 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.089+0000 7f9065d8a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f906006c250 0x7f906009a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.089+0000 7f9065d8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 0x7f906006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f9065d8a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906009a450 con 0x7f90600d0360 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f9065d8a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906009ae20 con 0x7f906006c250 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f9065d8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90600d0c60 con 0x7f906006bce0 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905ffff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f90600d0360 0x7f90600cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40184/0 (socket says 172.21.15.32:40184) 2024-02-17T00:37:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905ffff640 1 -- 172.21.15.32:0/4030490242 learned_addr learned my addr 172.21.15.32:0/4030490242 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250125099 0 0) 0x7f906009a450 con 0x7f90600d0360 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9048003520 con 0x7f90600d0360 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905f7fe640 1 --2- 172.21.15.32:0/4030490242 >> v2:172.21.15.39:3300/0 conn(0x7f906006c250 0x7f906009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905effd640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 0x7f906006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752738034 0 0) 0x7f9048003520 con 0x7f90600d0360 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 msgr2=0x7f906006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 0x7f906006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 >> v2:172.21.15.39:3300/0 conn(0x7f906006c250 msgr2=0x7f906009a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 --2- 172.21.15.32:0/4030490242 >> v2:172.21.15.39:3300/0 conn(0x7f906006c250 0x7f906009a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906006cb70 con 0x7f90600d0360 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f90580019f0 con 0x7f90600d0360 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 >> v1:172.21.15.32:6789/0 conn(0x7f90600d0360 legacy=0x7f90600cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048003970 0x7f9048003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90480047c0 0x7f9048004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 0x7f9048005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906009ae20 con 0x7f90480047c0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600d0c60 con 0x7f9048003970 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904800ba00 con 0x7f906006bce0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905effd640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90480047c0 0x7f9048004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.090+0000 7f905f7fe640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048003970 0x7f9048003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.091+0000 7f905ffff640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 0x7f9048005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.091+0000 7f905effd640 1 -- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 msgr2=0x7f9048005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.091+0000 7f905effd640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906006bce0 0x7f9048005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.091+0000 7f905effd640 1 -- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048003970 msgr2=0x7f9048003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.091+0000 7f905effd640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048003970 0x7f9048003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.091+0000 7f905effd640 1 -- 172.21.15.32:0/4030490242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048003520 con 0x7f90480047c0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f905effd640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90480047c0 0x7f9048004c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9050009a90 tx=0x7f90480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc704f1670f5425 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905002c680 con 0x7f90480047c0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905002c7e0 con 0x7f90480047c0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f905e7fc640 1 -- 172.21.15.32:0/4030490242 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905002cb70 con 0x7f90480047c0 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f9065d8a640 1 -- 172.21.15.32:0/4030490242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90480047c0 msgr2=0x7f9048004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f9065d8a640 1 --2- 172.21.15.32:0/4030490242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90480047c0 0x7f9048004c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9050009a90 tx=0x7f90480057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f905ffff640 1 -- 172.21.15.32:0/4030490242 reap_dead start 2024-02-17T00:37:39.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f9065d8a640 1 -- 172.21.15.32:0/4030490242 shutdown_connections 2024-02-17T00:37:39.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f9065d8a640 1 -- 172.21.15.32:0/4030490242 >> 172.21.15.32:0/4030490242 conn(0x7f90600d16e0 msgr2=0x7f90600d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:39.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f9065d8a640 1 -- 172.21.15.32:0/4030490242 shutdown_connections 2024-02-17T00:37:39.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.092+0000 7f9065d8a640 1 -- 172.21.15.32:0/4030490242 wait complete. 2024-02-17T00:37:39.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.093+0000 7f9065d8a640 1 Processor -- start 2024-02-17T00:37:39.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 -- start start 2024-02-17T00:37:39.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90480047c0 0x7f90600c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906009bb20 0x7f906009eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 0x7f906015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600cc5c0 con 0x7f906009c2a0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600cbcf0 con 0x7f906009bb20 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f9065d8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906009f3d0 con 0x7f90480047c0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f905ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 0x7f906015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f905ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 0x7f906015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55724/0 (socket says 172.21.15.32:55724) 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.094+0000 7f905ffff640 1 -- 172.21.15.32:0/3433158277 learned_addr learned my addr 172.21.15.32:0/3433158277 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905effd640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906009bb20 0x7f906009eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905f7fe640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90480047c0 0x7f90600c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905ffff640 1 -- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90480047c0 msgr2=0x7f90600c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905ffff640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90480047c0 0x7f90600c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905ffff640 1 -- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906009bb20 msgr2=0x7f906009eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905ffff640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906009bb20 0x7f906009eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905ffff640 1 -- 172.21.15.32:0/3433158277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600cbf00 con 0x7f906009c2a0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f905ffff640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 0x7f906015bbd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f90600cbcc0 tx=0x7f9058007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905800ac20 con 0x7f906009c2a0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905800ad80 con 0x7f906009c2a0 2024-02-17T00:37:39.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90600cc1e0 con 0x7f906009c2a0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058013630 con 0x7f906009c2a0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.095+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906009c720 con 0x7f906009c2a0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.096+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90600cc700 con 0x7f906009c2a0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.096+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9058013790 con 0x7f906009c2a0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.097+0000 7f9047fff640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.097+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f905808ae20 con 0x7f906009c2a0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.097+0000 7f905f7fe640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.098+0000 7f905f7fe640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9054009c40 tx=0x7f9054009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.101+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90600cc700 con 0x7f906009c2a0 2024-02-17T00:37:39.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.318+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90600cc700 con 0x7f906009c2a0 2024-02-17T00:37:39.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.318+0000 7f9047fff640 1 -- 172.21.15.32:0/3433158277 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f90600cc700 con 0x7f906009c2a0 2024-02-17T00:37:39.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:39.321 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1784760605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":1784760605},{"type":"v1","addr":"172.21.15.39:6836","nonce":1784760605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/378594614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":378594614},{"type":"v1","addr":"172.21.15.32:6834","nonce":378594614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3324964660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3324964660},{"type":"v1","addr":"172.21.15.32:6835","nonce":3324964660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:36:37.380132+0000","modified":"2024-02-17T00:36:59.479309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/268609901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":268609901},{"type":"v1","addr":"172.21.15.39:6837","nonce":268609901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T00:37:39.321 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-02-17T00:37:39.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 msgr2=0x7f904c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9054009c40 tx=0x7f9054009190 comp rx=0 tx=0).stop 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 msgr2=0x7f906015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 0x7f906015bbd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f90600cbcc0 tx=0x7f9058007a40 comp rx=0 tx=0).stop 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 shutdown_connections 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906009c2a0 0x7f906015bbd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906009bb20 0x7f906009eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 --2- 172.21.15.32:0/3433158277 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90480047c0 0x7f90600c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 >> 172.21.15.32:0/3433158277 conn(0x7f90600d16e0 msgr2=0x7f9060070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 shutdown_connections 2024-02-17T00:37:39.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.320+0000 7f9065d8a640 1 -- 172.21.15.32:0/3433158277 wait complete. 2024-02-17T00:37:39.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:39.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.432+0000 7ff0c413a640 1 Processor -- start 2024-02-17T00:37:39.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.432+0000 7ff0c413a640 1 -- start start 2024-02-17T00:37:39.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c413a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff0bc0b6a40 0x7ff0bc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c413a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc15e0e0 con 0x7ff0bc0b5e60 2024-02-17T00:37:39.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c413a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc06cfe0 con 0x7ff0bc15dd00 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c413a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc06cd00 con 0x7ff0bc0b6a40 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c16d5640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff0bc0b5e60 0x7ff0bc06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40200/0 (socket says 172.21.15.32:40200) 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c16d5640 1 -- 172.21.15.32:0/1257594440 learned_addr learned my addr 172.21.15.32:0/1257594440 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642090755 0 0) 0x7ff0ac001110 con 0x7ff0bc0b5e60 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a8003520 con 0x7ff0bc0b5e60 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c26d7640 1 --2- 172.21.15.32:0/1257594440 >> v2:172.21.15.39:3300/0 conn(0x7ff0bc0b6a40 0x7ff0bc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222318609 0 0) 0x7ff0a8003520 con 0x7ff0bc0b5e60 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 >> v2:172.21.15.39:3300/0 conn(0x7ff0bc0b6a40 msgr2=0x7ff0bc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 --2- 172.21.15.32:0/1257594440 >> v2:172.21.15.39:3300/0 conn(0x7ff0bc0b6a40 0x7ff0bc06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 >> v1:172.21.15.39:6789/0 conn(0x7ff0bc15dd00 legacy=0x7ff0bc0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0d1ca0 con 0x7ff0bc0b5e60 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7ff0ac001800 con 0x7ff0bc0b5e60 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 >> v1:172.21.15.32:6789/0 conn(0x7ff0bc0b5e60 legacy=0x7ff0bc06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a8003970 0x7ff0a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0a80047c0 0x7ff0a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8005180 0x7ff0a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc06cd00 con 0x7ff0a8003970 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a800c020 con 0x7ff0a80047c0 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.433+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a800c1e0 con 0x7ff0a8005180 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a8003970 0x7ff0a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c16d5640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0a80047c0 0x7ff0a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c26d7640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8005180 0x7ff0a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c1ed6640 1 -- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8005180 msgr2=0x7ff0a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8005180 0x7ff0a800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c1ed6640 1 -- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0a80047c0 msgr2=0x7ff0a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0a80047c0 0x7ff0a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c26d7640 1 -- 172.21.15.32:0/1257594440 reap_dead start 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c1ed6640 1 -- 172.21.15.32:0/1257594440 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8003520 con 0x7ff0a8003970 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.434+0000 7ff0c16d5640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0a80047c0 0x7ff0a8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a8003970 0x7ff0a8003d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80015b0 tx=0x7ff0a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bab1460eb16e9f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80052d0 con 0x7ff0a8003970 2024-02-17T00:37:39.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b802e050 con 0x7ff0a8003970 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c0ed4640 1 -- 172.21.15.32:0/1257594440 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8003830 con 0x7ff0a8003970 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 -- 172.21.15.32:0/1257594440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a8003970 msgr2=0x7ff0a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a8003970 0x7ff0a8003d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80015b0 tx=0x7ff0a80057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 -- 172.21.15.32:0/1257594440 shutdown_connections 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 --2- 172.21.15.32:0/1257594440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a8003970 0x7ff0a8003d90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 -- 172.21.15.32:0/1257594440 >> 172.21.15.32:0/1257594440 conn(0x7ff0bc0d07b0 msgr2=0x7ff0bc0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 -- 172.21.15.32:0/1257594440 shutdown_connections 2024-02-17T00:37:39.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.435+0000 7ff0c413a640 1 -- 172.21.15.32:0/1257594440 wait complete. 2024-02-17T00:37:39.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.436+0000 7ff0c413a640 1 Processor -- start 2024-02-17T00:37:39.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 -- start start 2024-02-17T00:37:39.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8003970 0x7ff0bc0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0bc156170 0x7ff0bc160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 0x7ff0bc0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0cc6c0 con 0x7ff0bc160990 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc160e10 con 0x7ff0bc156170 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c413a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1553b0 con 0x7ff0a8003970 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c26d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 0x7ff0bc0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c26d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 0x7ff0bc0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55754/0 (socket says 172.21.15.32:55754) 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.437+0000 7ff0c26d7640 1 -- 172.21.15.32:0/2978775813 learned_addr learned my addr 172.21.15.32:0/2978775813 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8003970 0x7ff0bc0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c16d5640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0bc156170 0x7ff0bc160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c26d7640 1 -- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8003970 msgr2=0x7ff0bc0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c26d7640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8003970 0x7ff0bc0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c26d7640 1 -- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0bc156170 msgr2=0x7ff0bc160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c26d7640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0bc156170 0x7ff0bc160450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c26d7640 1 -- 172.21.15.32:0/2978775813 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc155690 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c16d5640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0bc156170 0x7ff0bc160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c26d7640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 0x7ff0bc0caa50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ce440 tx=0x7ff0b400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400e040 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b400f040 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc155970 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4015430 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.438+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc0c9a40 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.439+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc0680c0 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.439+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff0b4015590 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.440+0000 7ff0b27fc640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff0a006b840 0x7ff0a006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.440+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7ff0b408af20 con 0x7ff0bc160990 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.440+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff0a006b840 0x7ff0a006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.440+0000 7ff0c1ed6640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff0a006b840 0x7ff0a006dd00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8033000 tx=0x7ff0b8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.444+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0b40555d0 con 0x7ff0bc160990 2024-02-17T00:37:39.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.624+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0bc0b9920 con 0x7ff0bc160990 2024-02-17T00:37:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.625+0000 7ff0b27fc640 1 -- 172.21.15.32:0/2978775813 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18566 (secure 0 0 0) 0x7ff0b4058c90 con 0x7ff0bc160990 2024-02-17T00:37:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:39.628 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:19.207607+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:36:35.858192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T00:36:36.382269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T00:36:40.072301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:39.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff0a006b840 msgr2=0x7ff0a006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff0a006b840 0x7ff0a006dd00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8033000 tx=0x7ff0b8009030 comp rx=0 tx=0).stop 2024-02-17T00:37:39.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 msgr2=0x7ff0bc0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 0x7ff0bc0caa50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ce440 tx=0x7ff0b400f1b0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 shutdown_connections 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0bc160990 0x7ff0bc0caa50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0bc156170 0x7ff0bc160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7ff0a006b840 0x7ff0a006dd00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 --2- 172.21.15.32:0/2978775813 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff0a8003970 0x7ff0bc0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 >> 172.21.15.32:0/2978775813 conn(0x7ff0bc0d07b0 msgr2=0x7ff0bc0b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 shutdown_connections 2024-02-17T00:37:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.627+0000 7ff0c413a640 1 -- 172.21.15.32:0/2978775813 wait complete. 2024-02-17T00:37:39.641 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T00:37:39.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.740+0000 7fd30d977640 1 Processor -- start 2024-02-17T00:37:39.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.740+0000 7fd30d977640 1 -- start start 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd30d977640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd3080b5e60 0x7fd30806bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd30d977640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd30806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd30d977640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30815e0e0 con 0x7fd30815dd00 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd30d977640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30806cfe0 con 0x7fd3080b5e60 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd30d977640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30806ca30 con 0x7fd3080b6a40 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd306ffd640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd30815dd00 0x7fd3080b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40214/0 (socket says 172.21.15.32:40214) 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd306ffd640 1 -- 172.21.15.32:0/879855917 learned_addr learned my addr 172.21.15.32:0/879855917 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092724638 0 0) 0x7fd300001110 con 0x7fd30815dd00 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f4003520 con 0x7fd30815dd00 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd3077fe640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd30806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.741+0000 7fd3067fc640 1 --2- 172.21.15.32:0/879855917 >> v2:172.21.15.39:3300/0 conn(0x7fd3080b5e60 0x7fd30806bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953479698 0 0) 0x7fd2f4003520 con 0x7fd30815dd00 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 msgr2=0x7fd30806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd30806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 >> v2:172.21.15.39:3300/0 conn(0x7fd3080b5e60 msgr2=0x7fd30806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 --2- 172.21.15.32:0/879855917 >> v2:172.21.15.39:3300/0 conn(0x7fd3080b5e60 0x7fd30806bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30806cd00 con 0x7fd30815dd00 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fd300001800 con 0x7fd30815dd00 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 >> v1:172.21.15.32:6789/0 conn(0x7fd30815dd00 legacy=0x7fd3080b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd2f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f4003ef0 0x7fd2f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30806cfe0 con 0x7fd2f4004d00 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30806ca30 con 0x7fd2f4003ef0 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f400ba60 con 0x7fd3080b6a40 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3077fe640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3067fc640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f4003ef0 0x7fd2f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd306ffd640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd2f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3077fe640 1 -- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 msgr2=0x7fd2f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3077fe640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd2f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3077fe640 1 -- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f4003ef0 msgr2=0x7fd2f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3077fe640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f4003ef0 0x7fd2f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd3077fe640 1 -- 172.21.15.32:0/879855917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4003520 con 0x7fd2f4004d00 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.742+0000 7fd306ffd640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd3080b6a40 0x7fd2f4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.743+0000 7fd3077fe640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8007360 tx=0x7fd2f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ef3f750ca4f8ea server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.743+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f802ccd0 con 0x7fd2f4004d00 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.743+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f802ce30 con 0x7fd2f4004d00 2024-02-17T00:37:39.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.743+0000 7fd305ffb640 1 -- 172.21.15.32:0/879855917 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8034660 con 0x7fd2f4004d00 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.743+0000 7fd30d977640 1 -- 172.21.15.32:0/879855917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2f4004d00 msgr2=0x7fd2f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.743+0000 7fd30d977640 1 --2- 172.21.15.32:0/879855917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8007360 tx=0x7fd2f40057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.744+0000 7fd3077fe640 1 -- 172.21.15.32:0/879855917 reap_dead start 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.744+0000 7fd30d977640 1 -- 172.21.15.32:0/879855917 shutdown_connections 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.744+0000 7fd30d977640 1 -- 172.21.15.32:0/879855917 >> 172.21.15.32:0/879855917 conn(0x7fd3080d07b0 msgr2=0x7fd3080d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.744+0000 7fd30d977640 1 -- 172.21.15.32:0/879855917 shutdown_connections 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.744+0000 7fd30d977640 1 -- 172.21.15.32:0/879855917 wait complete. 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.745+0000 7fd30d977640 1 Processor -- start 2024-02-17T00:37:39.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.745+0000 7fd30d977640 1 -- start start 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3080c9500 0x7fd3080cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 0x7fd30815f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd308159d30 0x7fd30815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815a840 con 0x7fd30815b3c0 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815af30 con 0x7fd3080c9500 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815a280 con 0x7fd308159d30 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 0x7fd30815f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 0x7fd30815f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55782/0 (socket says 172.21.15.32:55782) 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 -- 172.21.15.32:0/1916124806 learned_addr learned my addr 172.21.15.32:0/1916124806 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3077fe640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd308159d30 0x7fd30815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd306ffd640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3080c9500 0x7fd3080cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 -- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd308159d30 msgr2=0x7fd30815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd308159d30 0x7fd30815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 -- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3080c9500 msgr2=0x7fd3080cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3080c9500 0x7fd3080cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 -- 172.21.15.32:0/1916124806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30815a560 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3077fe640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd308159d30 0x7fd30815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd306ffd640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3080c9500 0x7fd3080cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd3067fc640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 0x7fd30815f2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0011910 tx=0x7fd2f0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000fa90 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f000fbf0 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30815abc0 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0014440 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.746+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3080cc4c0 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.748+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080680c0 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.748+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd2f00145a0 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.748+0000 7fd2fffff640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd2e806b840 0x7fd2e806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.748+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fd2f008ac30 con 0x7fd30815b3c0 2024-02-17T00:37:39.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.749+0000 7fd306ffd640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd2e806b840 0x7fd2e806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:39.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.749+0000 7fd306ffd640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd2e806b840 0x7fd2e806dd00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd300001930 tx=0x7fd300000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:39.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.753+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2f0055370 con 0x7fd30815b3c0 2024-02-17T00:37:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.968+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd3080b9920 con 0x7fd30815b3c0 2024-02-17T00:37:39.971 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-02-17T00:37:39.969+0000 7fd4c5811640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T00:37:39.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.970+0000 7fd2fffff640 1 -- 172.21.15.32:0/1916124806 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd2f0058a30 con 0x7fd30815b3c0 2024-02-17T00:37:39.973 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T00:37:39.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.972+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd2e806b840 msgr2=0x7fd2e806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.972+0000 7fd30d977640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd2e806b840 0x7fd2e806dd00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd300001930 tx=0x7fd300000ed0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.972+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 msgr2=0x7fd30815f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.972+0000 7fd30d977640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 0x7fd30815f2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0011910 tx=0x7fd2f0011dd0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 shutdown_connections 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fd2e806b840 0x7fd2e806dd00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd308159d30 0x7fd30815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30815b3c0 0x7fd30815f2d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 --2- 172.21.15.32:0/1916124806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3080c9500 0x7fd3080cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 >> 172.21.15.32:0/1916124806 conn(0x7fd3080d07b0 msgr2=0x7fd3080d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 shutdown_connections 2024-02-17T00:37:39.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:39.973+0000 7fd30d977640 1 -- 172.21.15.32:0/1916124806 wait complete. 2024-02-17T00:37:39.979 INFO:tasks.ceph.mds.b.smithi039.stderr: -5016> 2024-02-17T00:36:42.382+0000 7fcb0f356640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T00:37:39.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T00:37:40.012 INFO:tasks.ceph.mds.b.smithi039.stdout:starting mds.b at 2024-02-17T00:37:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.087+0000 7f829039a640 1 Processor -- start 2024-02-17T00:37:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.087+0000 7f829039a640 1 -- start start 2024-02-17T00:37:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f829039a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f829039a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f82880ce830 0x7f82880b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f829039a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82880ce380 con 0x7f82880d3760 2024-02-17T00:37:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f829039a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82880ceff0 con 0x7f82880ce830 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f829039a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828815f000 con 0x7f828815f1c0 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f828e136640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f82880d3760 0x7f82880d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40220/0 (socket says 172.21.15.32:40220) 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f828e136640 1 -- 172.21.15.32:0/3971295188 learned_addr learned my addr 172.21.15.32:0/3971295188 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f828d935640 1 --2- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f828e937640 1 --2- 172.21.15.32:0/3971295188 >> v2:172.21.15.39:3300/0 conn(0x7f82880ce830 0x7f82880b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.088+0000 7f828d134640 1 -- 172.21.15.32:0/3971295188 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795690784 0 0) 0x7f82880ce380 con 0x7f82880d3760 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.089+0000 7f828d134640 1 -- 172.21.15.32:0/3971295188 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8270003520 con 0x7f82880d3760 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.089+0000 7f828e937640 1 -- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 msgr2=0x7f828815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.089+0000 7f828e937640 1 --2- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.089+0000 7f828e937640 1 -- 172.21.15.32:0/3971295188 >> v1:172.21.15.32:6789/0 conn(0x7f82880d3760 legacy=0x7f82880d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.089+0000 7f828e937640 1 -- 172.21.15.32:0/3971295188 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880d2190 con 0x7f82880ce830 2024-02-17T00:37:40.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.089+0000 7f828e937640 1 --2- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880b2240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8278009d90 tx=0x7f827802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360c4720e7f32d47 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:40.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f828d134640 1 -- 172.21.15.32:0/3971295188 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827802cc50 con 0x7f82880ce830 2024-02-17T00:37:40.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f828d134640 1 -- 172.21.15.32:0/3971295188 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827802cdb0 con 0x7f82880ce830 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f828d134640 1 -- 172.21.15.32:0/3971295188 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278034660 con 0x7f82880ce830 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 -- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 msgr2=0x7f82880b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 --2- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880b2240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8278009d90 tx=0x7f827802bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 -- 172.21.15.32:0/3971295188 shutdown_connections 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 --2- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880b2240 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 --2- 172.21.15.32:0/3971295188 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 -- 172.21.15.32:0/3971295188 >> 172.21.15.32:0/3971295188 conn(0x7f8288072680 msgr2=0x7f8288072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 -- 172.21.15.32:0/3971295188 shutdown_connections 2024-02-17T00:37:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.090+0000 7f829039a640 1 -- 172.21.15.32:0/3971295188 wait complete. 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.091+0000 7f829039a640 1 Processor -- start 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.091+0000 7f829039a640 1 -- start start 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f829039a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f829039a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 0x7f828815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f829039a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f829039a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880cb790 con 0x7f82880d3760 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f829039a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82881e6450 con 0x7f82880ce830 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f829039a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82881e6ad0 con 0x7f828815f1c0 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f828d935640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 0x7f828815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f828d935640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 0x7f828815b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55794/0 (socket says 172.21.15.32:55794) 2024-02-17T00:37:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f828d935640 1 -- 172.21.15.32:0/1704047792 learned_addr learned my addr 172.21.15.32:0/1704047792 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f828e136640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.092+0000 7f828e937640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f828d935640 1 -- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 msgr2=0x7f828815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f828d935640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f828d935640 1 -- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 msgr2=0x7f82880cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f828d935640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f828d935640 1 -- 172.21.15.32:0/1704047792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278009a70 con 0x7f82880d3760 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f828d935640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 0x7f828815b900 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e840 tx=0x7f827c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0094f0 con 0x7f82880d3760 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00c940 con 0x7f82880d3760 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82881e6db0 con 0x7f82880d3760 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00ccd0 con 0x7f82880d3760 2024-02-17T00:37:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.093+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82881e8aa0 con 0x7f82880d3760 2024-02-17T00:37:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.094+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8288068f60 con 0x7f82880d3760 2024-02-17T00:37:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.094+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f827c013470 con 0x7f82880d3760 2024-02-17T00:37:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.095+0000 7f8286ffd640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f827406b810 0x7f827406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.095+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f827c08a5d0 con 0x7f82880d3760 2024-02-17T00:37:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.095+0000 7f828e136640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f827406b810 0x7f827406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.096+0000 7f828e136640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f827406b810 0x7f827406dcd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8280005880 tx=0x7f8280009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:40.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.099+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f827c054cd0 con 0x7f82880d3760 2024-02-17T00:37:40.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.318+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82880ce610 con 0x7f82880d3760 2024-02-17T00:37:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.972+0000 7f8286ffd640 1 -- 172.21.15.32:0/1704047792 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f827c058390 con 0x7f82880d3760 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f827406b810 msgr2=0x7f827406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f827406b810 0x7f827406dcd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8280005880 tx=0x7f8280009040 comp rx=0 tx=0).stop 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 msgr2=0x7f828815b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 0x7f828815b900 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e840 tx=0x7f827c00ed00 comp rx=0 tx=0).stop 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 shutdown_connections 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f827406b810 0x7f827406dcd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f828815f1c0 0x7f828815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82880d3760 0x7f828815b900 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 --2- 172.21.15.32:0/1704047792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82880ce830 0x7f82880cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 >> 172.21.15.32:0/1704047792 conn(0x7f8288072680 msgr2=0x7f82880b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 shutdown_connections 2024-02-17T00:37:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:40.975+0000 7f829039a640 1 -- 172.21.15.32:0/1704047792 wait complete. 2024-02-17T00:37:40.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T00:37:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.102+0000 7f6af746d640 1 Processor -- start 2024-02-17T00:37:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.102+0000 7f6af746d640 1 -- start start 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af746d640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6af00aeae0 0x7f6af00b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af746d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6af00b2a60 0x7f6af00b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af746d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af00cd440 con 0x7f6af015a8e0 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af746d640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af015acc0 con 0x7f6af00aeae0 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af746d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af00cd670 con 0x7f6af00b2a60 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af4a08640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6af00aeae0 0x7f6af00b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af5209640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6af015a8e0 0x7f6af015ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40228/0 (socket says 172.21.15.32:40228) 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af4a08640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6af00aeae0 0x7f6af00b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55798/0 (socket says 172.21.15.32:55798) 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af5209640 1 -- 172.21.15.32:0/1953707444 learned_addr learned my addr 172.21.15.32:0/1953707444 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af5a0a640 1 --2- 172.21.15.32:0/1953707444 >> v2:172.21.15.39:3300/0 conn(0x7f6af00b2a60 0x7f6af00b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af4a08640 1 -- 172.21.15.32:0/1953707444 >> v2:172.21.15.39:3300/0 conn(0x7f6af00b2a60 msgr2=0x7f6af00b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af4a08640 1 --2- 172.21.15.32:0/1953707444 >> v2:172.21.15.39:3300/0 conn(0x7f6af00b2a60 0x7f6af00b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af4a08640 1 -- 172.21.15.32:0/1953707444 >> v1:172.21.15.32:6789/0 conn(0x7f6af015a8e0 legacy=0x7f6af015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6af4a08640 1 -- 172.21.15.32:0/1953707444 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00cd950 con 0x7f6af00aeae0 2024-02-17T00:37:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.103+0000 7f6ae7fff640 1 -- 172.21.15.32:0/1953707444 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412282422 0 0) 0x7f6af00cd440 con 0x7f6af015a8e0 2024-02-17T00:37:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.104+0000 7f6af4a08640 1 --2- 172.21.15.32:0/1953707444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af00b2520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6af00710e0 tx=0x7f6ae002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302e1c6a05df295c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.104+0000 7f6ae7fff640 1 -- 172.21.15.32:0/1953707444 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0031830 con 0x7f6af00aeae0 2024-02-17T00:37:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.104+0000 7f6ae7fff640 1 -- 172.21.15.32:0/1953707444 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0031990 con 0x7f6af00aeae0 2024-02-17T00:37:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.104+0000 7f6ae7fff640 1 -- 172.21.15.32:0/1953707444 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0031d20 con 0x7f6af00aeae0 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 -- 172.21.15.32:0/1953707444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 msgr2=0x7f6af00b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 --2- 172.21.15.32:0/1953707444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af00b2520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6af00710e0 tx=0x7f6ae002b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 -- 172.21.15.32:0/1953707444 shutdown_connections 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 --2- 172.21.15.32:0/1953707444 >> v2:172.21.15.39:3300/0 conn(0x7f6af00b2a60 0x7f6af00b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 --2- 172.21.15.32:0/1953707444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af00b2520 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 -- 172.21.15.32:0/1953707444 >> 172.21.15.32:0/1953707444 conn(0x7f6af0066f80 msgr2=0x7f6af006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 -- 172.21.15.32:0/1953707444 shutdown_connections 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.105+0000 7f6af746d640 1 -- 172.21.15.32:0/1953707444 wait complete. 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.106+0000 7f6af746d640 1 Processor -- start 2024-02-17T00:37:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.106+0000 7f6af746d640 1 -- start start 2024-02-17T00:37:41.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af746d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:41.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af746d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6af015a8e0 0x7f6af0150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:41.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af746d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6af0156a20 0x7f6af0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:41.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af746d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00ad800 con 0x7f6af00aeae0 2024-02-17T00:37:41.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af746d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00acc80 con 0x7f6af0156a20 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af746d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00acf60 con 0x7f6af015a8e0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af015bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55810/0 (socket says 172.21.15.32:55810) 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 -- 172.21.15.32:0/782489374 learned_addr learned my addr 172.21.15.32:0/782489374 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5a0a640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6af0156a20 0x7f6af0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af4a08640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6af015a8e0 0x7f6af0150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 -- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6af015a8e0 msgr2=0x7f6af0150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6af015a8e0 0x7f6af0150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 -- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6af0156a20 msgr2=0x7f6af0156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6af0156a20 0x7f6af0156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 -- 172.21.15.32:0/782489374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009400 con 0x7f6af00aeae0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5a0a640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6af0156a20 0x7f6af0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6af5209640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af015bed0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c430 tx=0x7f6aec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0074e0 con 0x7f6af00aeae0 2024-02-17T00:37:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.107+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec007660 con 0x7f6af00aeae0 2024-02-17T00:37:41.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.108+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af00ad240 con 0x7f6af00aeae0 2024-02-17T00:37:41.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.108+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec004a20 con 0x7f6af00aeae0 2024-02-17T00:37:41.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.108+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af0150f90 con 0x7f6af00aeae0 2024-02-17T00:37:41.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.109+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af0154950 con 0x7f6af00aeae0 2024-02-17T00:37:41.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.109+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6aec004b80 con 0x7f6af00aeae0 2024-02-17T00:37:41.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.109+0000 7f6ae5ffb640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6ad406b810 0x7f6ad406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:41.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.109+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f6aec08a4a0 con 0x7f6af00aeae0 2024-02-17T00:37:41.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.110+0000 7f6af4a08640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6ad406b810 0x7f6ad406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:41.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.110+0000 7f6af4a08640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6ad406b810 0x7f6ad406dcd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0036000 tx=0x7f6ae0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:41.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.114+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6af0154950 con 0x7f6af00aeae0 2024-02-17T00:37:41.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.294+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6af0154950 con 0x7f6af00aeae0 2024-02-17T00:37:41.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.973+0000 7f6ae5ffb640 1 -- 172.21.15.32:0/782489374 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6af0154950 con 0x7f6af00aeae0 2024-02-17T00:37:41.976 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-02-17T00:37:41.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6ad406b810 msgr2=0x7f6ad406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:41.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6ad406b810 0x7f6ad406dcd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0036000 tx=0x7f6ae0008030 comp rx=0 tx=0).stop 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 msgr2=0x7f6af015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af015bed0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c430 tx=0x7f6aec00c8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 shutdown_connections 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6af0156a20 0x7f6af0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6ad406b810 0x7f6ad406dcd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6af015a8e0 0x7f6af0150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 --2- 172.21.15.32:0/782489374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af00aeae0 0x7f6af015bed0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.976+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 >> 172.21.15.32:0/782489374 conn(0x7f6af0066f80 msgr2=0x7f6af00cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.977+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 shutdown_connections 2024-02-17T00:37:41.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:41.977+0000 7f6af746d640 1 -- 172.21.15.32:0/782489374 wait complete. 2024-02-17T00:37:41.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T00:37:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.102+0000 7fb266348640 1 Processor -- start 2024-02-17T00:37:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.102+0000 7fb266348640 1 -- start start 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb266348640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb26015b940 0x7fb2600cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb266348640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2600cfbe0 con 0x7fb2600cf760 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb266348640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2600cfec0 con 0x7fb2600ce750 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb266348640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600d01a0 con 0x7fb26015b940 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25ffff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb26015b940 0x7fb2600cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25f7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb2600cf760 0x7fb2600ce040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40230/0 (socket says 172.21.15.32:40230) 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25ffff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb26015b940 0x7fb2600cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55816/0 (socket says 172.21.15.32:55816) 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25f7fe640 1 -- 172.21.15.32:0/3326000873 learned_addr learned my addr 172.21.15.32:0/3326000873 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25ffff640 1 -- 172.21.15.32:0/3326000873 >> v1:172.21.15.39:6789/0 conn(0x7fb2600ce750 legacy=0x7fb2600cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25ffff640 1 -- 172.21.15.32:0/3326000873 >> v1:172.21.15.32:6789/0 conn(0x7fb2600cf760 legacy=0x7fb2600ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25effd640 1 -- 172.21.15.32:0/3326000873 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389279188 0 0) 0x7fb2600cfbe0 con 0x7fb2600cf760 2024-02-17T00:37:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.103+0000 7fb25ffff640 1 -- 172.21.15.32:0/3326000873 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600d0480 con 0x7fb26015b940 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.104+0000 7fb25ffff640 1 --2- 172.21.15.32:0/3326000873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb26015b940 0x7fb2600cf220 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb2480097a0 tx=0x7fb24802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9156b185601fe28 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.104+0000 7fb25effd640 1 -- 172.21.15.32:0/3326000873 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248030610 con 0x7fb26015b940 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.104+0000 7fb25effd640 1 -- 172.21.15.32:0/3326000873 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248030770 con 0x7fb26015b940 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.104+0000 7fb25effd640 1 -- 172.21.15.32:0/3326000873 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248030b00 con 0x7fb26015b940 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 -- 172.21.15.32:0/3326000873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb26015b940 msgr2=0x7fb2600cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 --2- 172.21.15.32:0/3326000873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb26015b940 0x7fb2600cf220 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb2480097a0 tx=0x7fb24802b960 comp rx=0 tx=0).stop 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 -- 172.21.15.32:0/3326000873 shutdown_connections 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 --2- 172.21.15.32:0/3326000873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb26015b940 0x7fb2600cf220 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 -- 172.21.15.32:0/3326000873 >> 172.21.15.32:0/3326000873 conn(0x7fb2600d1650 msgr2=0x7fb2600d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 -- 172.21.15.32:0/3326000873 shutdown_connections 2024-02-17T00:37:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.105+0000 7fb266348640 1 -- 172.21.15.32:0/3326000873 wait complete. 2024-02-17T00:37:42.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.106+0000 7fb266348640 1 Processor -- start 2024-02-17T00:37:42.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.106+0000 7fb266348640 1 -- start start 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb266348640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 0x7fb2601f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb266348640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2600cf760 0x7fb26006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb266348640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb26015b940 0x7fb26006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb266348640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26006c790 con 0x7fb2600ce750 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb266348640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26006dd20 con 0x7fb26015b940 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb266348640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26006bdf0 con 0x7fb2600cf760 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 0x7fb2601f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 0x7fb2601f3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55820/0 (socket says 172.21.15.32:55820) 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 -- 172.21.15.32:0/374610572 learned_addr learned my addr 172.21.15.32:0/374610572 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25f7fe640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2600cf760 0x7fb26006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb2648e5640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb26015b940 0x7fb26006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 -- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2600cf760 msgr2=0x7fb26006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2600cf760 0x7fb26006d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 -- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb26015b940 msgr2=0x7fb26006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb26015b940 0x7fb26006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb25ffff640 1 -- 172.21.15.32:0/374610572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb248009400 con 0x7fb2600ce750 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.107+0000 7fb2648e5640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb26015b940 0x7fb26006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.108+0000 7fb25ffff640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 0x7fb2601f3d60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb248000c00 tx=0x7fb2480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.108+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248039c90 con 0x7fb2600ce750 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.108+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24803f040 con 0x7fb2600ce750 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.108+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26006c0d0 con 0x7fb2600ce750 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.108+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248004030 con 0x7fb2600ce750 2024-02-17T00:37:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.108+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2601f42a0 con 0x7fb2600ce750 2024-02-17T00:37:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.109+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600b0e20 con 0x7fb2600ce750 2024-02-17T00:37:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.109+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb248004190 con 0x7fb2600ce750 2024-02-17T00:37:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.110+0000 7fb25cff9640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb24006b810 0x7fb24006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.110+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fb2480ac4f0 con 0x7fb2600ce750 2024-02-17T00:37:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.110+0000 7fb25f7fe640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb24006b810 0x7fb24006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.110+0000 7fb25f7fe640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb24006b810 0x7fb24006dcd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2600c7aa0 tx=0x7fb250007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.114+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb248076e20 con 0x7fb2600ce750 2024-02-17T00:37:42.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.298+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb26006bf30 con 0x7fb2600ce750 2024-02-17T00:37:42.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.975+0000 7fb25cff9640 1 -- 172.21.15.32:0/374610572 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb26006bf30 con 0x7fb2600ce750 2024-02-17T00:37:42.978 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb24006b810 msgr2=0x7fb24006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb24006b810 0x7fb24006dcd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2600c7aa0 tx=0x7fb250007b90 comp rx=0 tx=0).stop 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 msgr2=0x7fb2601f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 0x7fb2601f3d60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb248000c00 tx=0x7fb2480046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 shutdown_connections 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb26015b940 0x7fb26006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb24006b810 0x7fb24006dcd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2600cf760 0x7fb26006d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 --2- 172.21.15.32:0/374610572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2600ce750 0x7fb2601f3d60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:42.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 >> 172.21.15.32:0/374610572 conn(0x7fb2600d1650 msgr2=0x7fb26015a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:42.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 shutdown_connections 2024-02-17T00:37:42.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:42.978+0000 7fb266348640 1 -- 172.21.15.32:0/374610572 wait complete. 2024-02-17T00:37:42.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-02-17T00:37:43.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.101+0000 7fef6cf0c640 1 Processor -- start 2024-02-17T00:37:43.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.101+0000 7fef6cf0c640 1 -- start start 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6cf0c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef6815dba0 0x7fef680ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6cf0c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef680cd460 0x7fef680999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6cf0c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6806c180 con 0x7fef68099f30 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6cf0c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680cdf60 con 0x7fef6815dba0 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6cf0c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6809a3c0 con 0x7fef680cd460 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6659c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef6815dba0 0x7fef680ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef66d9d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fef68099f30 0x7fef680cfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40236/0 (socket says 172.21.15.32:40236) 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef66d9d640 1 -- 172.21.15.32:0/90790850 learned_addr learned my addr 172.21.15.32:0/90790850 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef5dd9b640 1 --2- 172.21.15.32:0/90790850 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef680cd460 0x7fef680999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6659c640 1 -- 172.21.15.32:0/90790850 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef680cd460 msgr2=0x7fef680999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6659c640 1 --2- 172.21.15.32:0/90790850 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef680cd460 0x7fef680999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6659c640 1 -- 172.21.15.32:0/90790850 >> v1:172.21.15.32:6789/0 conn(0x7fef68099f30 legacy=0x7fef680cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef6659c640 1 -- 172.21.15.32:0/90790850 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680cd9a0 con 0x7fef6815dba0 2024-02-17T00:37:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.102+0000 7fef65d9b640 1 -- 172.21.15.32:0/90790850 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517332744 0 0) 0x7fef6806c180 con 0x7fef68099f30 2024-02-17T00:37:43.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.103+0000 7fef6659c640 1 --2- 172.21.15.32:0/90790850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef6815dba0 0x7fef680ccf20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef580097a0 tx=0x7fef5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a97b94493ab614b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:43.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.103+0000 7fef65d9b640 1 -- 172.21.15.32:0/90790850 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58031830 con 0x7fef6815dba0 2024-02-17T00:37:43.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.103+0000 7fef65d9b640 1 -- 172.21.15.32:0/90790850 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58031990 con 0x7fef6815dba0 2024-02-17T00:37:43.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.103+0000 7fef65d9b640 1 -- 172.21.15.32:0/90790850 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58031d20 con 0x7fef6815dba0 2024-02-17T00:37:43.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 -- 172.21.15.32:0/90790850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef6815dba0 msgr2=0x7fef680ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:43.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/90790850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef6815dba0 0x7fef680ccf20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef580097a0 tx=0x7fef5802b8d0 comp rx=0 tx=0).stop 2024-02-17T00:37:43.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 -- 172.21.15.32:0/90790850 shutdown_connections 2024-02-17T00:37:43.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/90790850 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef680cd460 0x7fef680999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:43.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/90790850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef6815dba0 0x7fef680ccf20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:43.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 -- 172.21.15.32:0/90790850 >> 172.21.15.32:0/90790850 conn(0x7fef680b3130 msgr2=0x7fef680b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:43.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 -- 172.21.15.32:0/90790850 shutdown_connections 2024-02-17T00:37:43.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.104+0000 7fef6cf0c640 1 -- 172.21.15.32:0/90790850 wait complete. 2024-02-17T00:37:43.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.105+0000 7fef6cf0c640 1 Processor -- start 2024-02-17T00:37:43.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.105+0000 7fef6cf0c640 1 -- start start 2024-02-17T00:37:43.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6cf0c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef68099f30 0x7fef6815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:43.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6cf0c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 0x7fef6814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:43.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6cf0c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6815dba0 0x7fef6815fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6cf0c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681611e0 con 0x7fef680cd460 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6cf0c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6814c950 con 0x7fef6815dba0 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6cf0c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef68160660 con 0x7fef68099f30 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 0x7fef6814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 0x7fef6814c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55846/0 (socket says 172.21.15.32:55846) 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 -- 172.21.15.32:0/4151040798 learned_addr learned my addr 172.21.15.32:0/4151040798 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef6659c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef68099f30 0x7fef6815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 -- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef68099f30 msgr2=0x7fef6815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef66d9d640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6815dba0 0x7fef6815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef68099f30 0x7fef6815e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 -- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6815dba0 msgr2=0x7fef6815fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6815dba0 0x7fef6815fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 -- 172.21.15.32:0/4151040798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58009400 con 0x7fef680cd460 2024-02-17T00:37:43.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.106+0000 7fef5dd9b640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 0x7fef6814c410 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fef5000e9b0 tx=0x7fef5000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.107+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50009670 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.107+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000c9a0 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.107+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef68160940 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.107+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000cd50 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.107+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef68160f00 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.108+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef68069040 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.108+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fef50013470 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.108+0000 7fef5f7fe640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fef4806b840 0x7fef4806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.109+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fef5008a400 con 0x7fef680cd460 2024-02-17T00:37:43.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.109+0000 7fef6659c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fef4806b840 0x7fef4806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:43.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.109+0000 7fef6659c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fef4806b840 0x7fef4806dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef58036000 tx=0x7fef58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:43.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.113+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef50054dd0 con 0x7fef680cd460 2024-02-17T00:37:43.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.293+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef680c61c0 con 0x7fef680cd460 2024-02-17T00:37:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:43.994+0000 7fef5f7fe640 1 -- 172.21.15.32:0/4151040798 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7fef50058490 con 0x7fef680cd460 2024-02-17T00:37:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data_ec' removed 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.000+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fef4806b840 msgr2=0x7fef4806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.000+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fef4806b840 0x7fef4806dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef58036000 tx=0x7fef58008030 comp rx=0 tx=0).stop 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.000+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 msgr2=0x7fef6814c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.000+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 0x7fef6814c410 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fef5000e9b0 tx=0x7fef5000ee70 comp rx=0 tx=0).stop 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.001+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 shutdown_connections 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6815dba0 0x7fef6815fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef680cd460 0x7fef6814c410 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fef4806b840 0x7fef4806dd00 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef58036000 tx=0x7fef58008030 comp rx=0 tx=0).stop 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 --2- 172.21.15.32:0/4151040798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fef68099f30 0x7fef6815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 >> 172.21.15.32:0/4151040798 conn(0x7fef680b3130 msgr2=0x7fef680b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 shutdown_connections 2024-02-17T00:37:44.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.002+0000 7fef6cf0c640 1 -- 172.21.15.32:0/4151040798 wait complete. 2024-02-17T00:37:44.024 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T00:37:44.025 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-17T00:37:44.025 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T00:37:44.025 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T00:37:44.025 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T00:37:44.025 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-17T00:37:44.025 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-17T00:37:44.025 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T00:37:44.026 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T00:37:44.026 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-17T00:37:44.026 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T00:37:44.026 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T00:37:44.026 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T00:37:44.026 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-17T00:37:44.026 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-17T00:37:44.026 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T00:37:44.035 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T00:37:44.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T00:37:44.036 INFO:tasks.ceph.mds.c:Stopped 2024-02-17T00:37:44.037 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-17T00:37:44.038 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T00:37:44.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T00:37:44.038 INFO:tasks.ceph.mds.d:Stopped 2024-02-17T00:37:44.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-17T00:37:44.078 INFO:tasks.ceph.mds.a:Started 2024-02-17T00:37:44.078 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:44.079 INFO:tasks.ceph.mds.c:Started 2024-02-17T00:37:44.079 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:44.080 INFO:tasks.ceph.mds.b:Started 2024-02-17T00:37:44.081 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:44.081 INFO:tasks.ceph.mds.d:Started 2024-02-17T00:37:44.081 DEBUG:teuthology.parallel:result is None 2024-02-17T00:37:44.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-17T00:37:44.160 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-02-17T00:37:44.161 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-02-17T00:37:44.164 INFO:tasks.ceph.mds.d.smithi039.stdout:starting mds.d at 2024-02-17T00:37:44.164 INFO:tasks.ceph.mds.b.smithi039.stdout:starting mds.b at 2024-02-17T00:37:44.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.189+0000 7fc9847e2640 1 Processor -- start 2024-02-17T00:37:44.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.189+0000 7fc9847e2640 1 -- start start 2024-02-17T00:37:44.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc9847e2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 0x7fc97c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc9847e2640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0d1e80 con 0x7fc97c0b53b0 2024-02-17T00:37:44.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc9847e2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c162490 con 0x7fc97c0ce2b0 2024-02-17T00:37:44.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc9847e2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0b5930 con 0x7fc97c15db00 2024-02-17T00:37:44.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc981d7d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc97c0b53b0 0x7fc97c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60952/0 (socket says 172.21.15.32:60952) 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc981d7d640 1 -- 172.21.15.32:0/2201791876 learned_addr learned my addr 172.21.15.32:0/2201791876 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc98257e640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 0x7fc97c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559246407 0 0) 0x7fc97c0d1e80 con 0x7fc97c0b53b0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.190+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc968003520 con 0x7fc97c0b53b0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3955022853 0 0) 0x7fc968003520 con 0x7fc97c0b53b0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 msgr2=0x7fc97c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 0x7fc97c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 >> v1:172.21.15.39:6789/0 conn(0x7fc97c0ce2b0 legacy=0x7fc97c161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0b5c10 con 0x7fc97c0b53b0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fc978001670 con 0x7fc97c0b53b0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 >> v1:172.21.15.32:6789/0 conn(0x7fc97c0b53b0 legacy=0x7fc97c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9680039a0 0x7fc968003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc968004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 0x7fc968005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0b5930 con 0x7fc9680047c0 2024-02-17T00:37:44.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96800ba30 con 0x7fc9680039a0 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96800bbf0 con 0x7fc97c15db00 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc981d7d640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc968004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc98257e640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9680039a0 0x7fc968003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc982d7f640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 0x7fc968005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc981d7d640 1 -- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 msgr2=0x7fc968005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc981d7d640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c15db00 0x7fc968005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc981d7d640 1 -- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9680039a0 msgr2=0x7fc968003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc981d7d640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9680039a0 0x7fc968003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.191+0000 7fc981d7d640 1 -- 172.21.15.32:0/2201791876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968003520 con 0x7fc9680047c0 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.192+0000 7fc981d7d640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc968004c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc978001eb0 tx=0x7fc9680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f894ca50fe8dbf88 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.192+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978005ad0 con 0x7fc9680047c0 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.192+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc978005c30 con 0x7fc9680047c0 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.192+0000 7fc98157c640 1 -- 172.21.15.32:0/2201791876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97802c850 con 0x7fc9680047c0 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc9847e2640 1 -- 172.21.15.32:0/2201791876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 msgr2=0x7fc968004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc9847e2640 1 --2- 172.21.15.32:0/2201791876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc968004c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc978001eb0 tx=0x7fc9680057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc982d7f640 1 -- 172.21.15.32:0/2201791876 reap_dead start 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc9847e2640 1 -- 172.21.15.32:0/2201791876 shutdown_connections 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc9847e2640 1 -- 172.21.15.32:0/2201791876 >> 172.21.15.32:0/2201791876 conn(0x7fc97c072290 msgr2=0x7fc97c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc9847e2640 1 -- 172.21.15.32:0/2201791876 shutdown_connections 2024-02-17T00:37:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.193+0000 7fc9847e2640 1 -- 172.21.15.32:0/2201791876 wait complete. 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.194+0000 7fc9847e2640 1 Processor -- start 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.194+0000 7fc9847e2640 1 -- start start 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc97c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c1e7390 0x7fc97c1e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc97c0cc490 0x7fc97c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c152eb0 con 0x7fc9680047c0 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c15f220 con 0x7fc97c0cc490 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c15f500 con 0x7fc97c1e7390 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc97c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc97c152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38062/0 (socket says 172.21.15.32:38062) 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 -- 172.21.15.32:0/1495731372 learned_addr learned my addr 172.21.15.32:0/1495731372 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc981d7d640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c1e7390 0x7fc97c1e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc982d7f640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc97c0cc490 0x7fc97c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 -- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c1e7390 msgr2=0x7fc97c1e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c1e7390 0x7fc97c1e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 -- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc97c0cc490 msgr2=0x7fc97c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc97c0cc490 0x7fc97c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 -- 172.21.15.32:0/1495731372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0cbc90 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc981d7d640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c1e7390 0x7fc97c1e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc982d7f640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc97c0cc490 0x7fc97c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc98257e640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc97c152970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0119a0 tx=0x7fc96c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00faf0 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00fc50 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c0cbf70 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c014440 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.195+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c15fe90 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.197+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c068fd0 con 0x7fc9680047c0 2024-02-17T00:37:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.197+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc96c0145a0 con 0x7fc9680047c0 2024-02-17T00:37:44.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.197+0000 7fc972ffd640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc96006b810 0x7fc96006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:44.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.197+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc96c08a970 con 0x7fc9680047c0 2024-02-17T00:37:44.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.197+0000 7fc981d7d640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc96006b810 0x7fc96006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:44.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.198+0000 7fc981d7d640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc96006b810 0x7fc96006dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc978034000 tx=0x7fc978037040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:44.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.202+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc96c055500 con 0x7fc9680047c0 2024-02-17T00:37:44.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:44.398+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc97c15f6c0 con 0x7fc9680047c0 2024-02-17T00:37:45.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.018+0000 7fc972ffd640 1 -- 172.21.15.32:0/1495731372 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc96c058bc0 con 0x7fc9680047c0 2024-02-17T00:37:45.021 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc96006b810 msgr2=0x7fc96006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc96006b810 0x7fc96006dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc978034000 tx=0x7fc978037040 comp rx=0 tx=0).stop 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 msgr2=0x7fc97c152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc97c152970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0119a0 tx=0x7fc96c011e60 comp rx=0 tx=0).stop 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 shutdown_connections 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc97c0cc490 0x7fc97c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc96006b810 0x7fc96006dcd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc97c1e7390 0x7fc97c1e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 --2- 172.21.15.32:0/1495731372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9680047c0 0x7fc97c152970 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 >> 172.21.15.32:0/1495731372 conn(0x7fc97c072290 msgr2=0x7fc97c0b7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:45.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 shutdown_connections 2024-02-17T00:37:45.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.021+0000 7fc9847e2640 1 -- 172.21.15.32:0/1495731372 wait complete. 2024-02-17T00:37:45.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-17T00:37:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.143+0000 7f1cea8df640 1 Processor -- start 2024-02-17T00:37:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.143+0000 7f1cea8df640 1 -- start start 2024-02-17T00:37:45.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1cea8df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 0x7f1ce40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1cea8df640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce415e8a0 con 0x7f1ce415e2a0 2024-02-17T00:37:45.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1cea8df640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce415eb80 con 0x7f1ce415de40 2024-02-17T00:37:45.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1cea8df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4161640 con 0x7f1ce415da60 2024-02-17T00:37:45.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce8e7c640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1ce415e2a0 0x7f1ce40ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60968/0 (socket says 172.21.15.32:60968) 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce8e7c640 1 -- 172.21.15.32:0/702343157 learned_addr learned my addr 172.21.15.32:0/702343157 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce3fff640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 0x7f1ce40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89950497 0 0) 0x7f1ce415e8a0 con 0x7f1ce415e2a0 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ccc003520 con 0x7f1ce415e2a0 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588420608 0 0) 0x7f1ccc003520 con 0x7f1ce415e2a0 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 msgr2=0x7f1ce40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 0x7f1ce40d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 >> v1:172.21.15.39:6789/0 conn(0x7f1ce415de40 legacy=0x7f1ce4161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce415ee60 con 0x7f1ce415e2a0 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f1cdc0019f0 con 0x7f1ce415e2a0 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 >> v1:172.21.15.32:6789/0 conn(0x7f1ce415e2a0 legacy=0x7f1ce40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 0x7f1ccc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc003f20 0x7f1ccc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.144+0000 7f1ce2ffd640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc004d00 0x7f1ccc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4161640 con 0x7f1ccc003f20 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc00bb10 con 0x7f1ccc004d00 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc00bcd0 con 0x7f1ce415da60 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce37fe640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc003f20 0x7f1ccc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce3fff640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 0x7f1ccc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce8e7c640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc004d00 0x7f1ccc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce37fe640 1 -- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 msgr2=0x7f1ccc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce37fe640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ce415da60 0x7f1ccc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce37fe640 1 -- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc004d00 msgr2=0x7f1ccc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce37fe640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc004d00 0x7f1ccc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.145+0000 7f1ce37fe640 1 -- 172.21.15.32:0/702343157 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc003520 con 0x7f1ccc003f20 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1ce37fe640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc003f20 0x7f1ccc0047c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4001750 tx=0x7f1ccc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a20e94244e28c4e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40052d0 con 0x7f1ccc003f20 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd402e050 con 0x7f1ccc003f20 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1ce2ffd640 1 -- 172.21.15.32:0/702343157 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40035f0 con 0x7f1ccc003f20 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1cea8df640 1 -- 172.21.15.32:0/702343157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc003f20 msgr2=0x7f1ccc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1cea8df640 1 --2- 172.21.15.32:0/702343157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc003f20 0x7f1ccc0047c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4001750 tx=0x7f1ccc0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1ce8e7c640 1 -- 172.21.15.32:0/702343157 reap_dead start 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1cea8df640 1 -- 172.21.15.32:0/702343157 shutdown_connections 2024-02-17T00:37:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1cea8df640 1 -- 172.21.15.32:0/702343157 >> 172.21.15.32:0/702343157 conn(0x7f1ce406bfe0 msgr2=0x7f1ce406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:45.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1cea8df640 1 -- 172.21.15.32:0/702343157 shutdown_connections 2024-02-17T00:37:45.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.146+0000 7f1cea8df640 1 -- 172.21.15.32:0/702343157 wait complete. 2024-02-17T00:37:45.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.147+0000 7f1cea8df640 1 Processor -- start 2024-02-17T00:37:45.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 -- start start 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ccc003f20 0x7f1ce40b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ce40b4840 0x7f1ce40b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 0x7f1ce41f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40b1c30 con 0x7f1ce40b17b0 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40b4d50 con 0x7f1ce40b4840 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1cea8df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40b5030 con 0x7f1ccc003f20 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.148+0000 7f1ce8e7c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 0x7f1ce41f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 0x7f1ce41f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38080/0 (socket says 172.21.15.32:38080) 2024-02-17T00:37:45.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 -- 172.21.15.32:0/316162321 learned_addr learned my addr 172.21.15.32:0/316162321 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce3fff640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ccc003f20 0x7f1ce40b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce37fe640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ce40b4840 0x7f1ce40b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 -- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ccc003f20 msgr2=0x7f1ce40b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ccc003f20 0x7f1ce40b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 -- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ce40b4840 msgr2=0x7f1ce40b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ce40b4840 0x7f1ce40b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 -- 172.21.15.32:0/316162321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4162600 con 0x7f1ce40b17b0 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce8e7c640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 0x7f1ce41f6840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1ce415e680 tx=0x7f1cdc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00abd0 con 0x7f1ce40b17b0 2024-02-17T00:37:45.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00ad70 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc013630 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40b5310 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.149+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce40b58d0 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.150+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40680c0 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.151+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1cdc013790 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.151+0000 7f1ce0ff9640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1cd006b810 0x7f1cd006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.151+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1cdc08a6f0 con 0x7f1ce40b17b0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.151+0000 7f1ce3fff640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1cd006b810 0x7f1cd006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.152+0000 7f1ce3fff640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1cd006b810 0x7f1cd006dcd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ce415cfa0 tx=0x7f1cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.155+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1cdc0552d0 con 0x7f1ce40b17b0 2024-02-17T00:37:45.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.403+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1ce4068fd0 con 0x7f1ce40b17b0 2024-02-17T00:37:45.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.404+0000 7f1ce0ff9640 1 -- 172.21.15.32:0/316162321 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1cdc058990 con 0x7f1ce40b17b0 2024-02-17T00:37:45.406 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89luT60FBAACthasFjhnFChyKMSS3MskA==", 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.407 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89lHQfuIBAATo9oNCL+tXMzDXjatp213Q==", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89ld438GxAAqW6CSaY9UcKfq38q28NKUg==", 2024-02-17T00:37:45.408 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89lu1FJKBAAb9SXwFLj5s6pwx9oXtutaQ==", 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.409 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBc/89ltvzDExAACpG/oEDrCrL0/5HkzTt5fQ==", 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBf/89lXoNsEhAAfd2thZPGsLN+lfJtUXB5EQ==", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBi/89lTZ/AEBAAOAphY2NxD8gEPkpPlUQ5HQ==", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.411 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBl/89ld9TlDhAAJURgbg8EzrWugIZ3+t3/xA==", 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBu/89lV1LRJxAASoWYGuHHUbTMJ0pifcA6vg==", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBx/89lWMuFJxAAEl+b5NJDQL4e/yZF0L6QYw==", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.413 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB0/89ltXtQJxAAN3dwJgmA9VyxB0X7+8VqHA==", 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2024-02-17T00:37:45.414 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB3/89lYQr3JRAAXb58aelKNQ5x9LseH/cBrw==", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89lSZN9LBAAKBrV6Z7gz+HGueThsfRO3A==", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-02-17T00:37:45.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89liUqxNRAAZbwGTF9WriqsSyimJ3gV6g==", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.2", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89l8cA8MhAAmLEjJVHu/rnY5NGLkqkeaw==", 2024-02-17T00:37:45.416 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.3", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89ljs1sOxAAhLdK2gxRAkddsZAKcJdMXQ==", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg==", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mds", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9/89lkoBDJRAAsD6PFyEnTNbPjlV7CR8JsQ==", 2024-02-17T00:37:45.418 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mds" 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mgr", 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9/89lKYpDJRAA7RvdmypORQVh8vl+e0B8jQ==", 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-osd", 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9/89lzZBDJRAAPSr9jr5nkV+4FkEr140O0w==", 2024-02-17T00:37:45.419 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-osd" 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd", 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9/89lLJdDJRAAnyr/NxZhbX5NBvW4z48SlA==", 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9/89lyp1DJRAAO+9sViq0fEJ6ky0L3w+d8w==", 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.420 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rgw", 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9/89l1qRDJRAAEZ9IC8i/QrIlQTRs0nhw9Q==", 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89lNL1TERAApfb2c4j6nVv+jnjqqjy/zg==", 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-02-17T00:37:45.421 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBa/89lvUxrDRAAGRnH8exeUjS90x4Dw/NxWA==", 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-02-17T00:37:45.422 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-02-17T00:37:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1cd006b810 msgr2=0x7f1cd006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1cd006b810 0x7f1cd006dcd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ce415cfa0 tx=0x7f1cd8008040 comp rx=0 tx=0).stop 2024-02-17T00:37:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 msgr2=0x7f1ce41f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 0x7f1ce41f6840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1ce415e680 tx=0x7f1cdc007bd0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 shutdown_connections 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce40b17b0 0x7f1ce41f6840 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ce40b4840 0x7f1ce40b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1cd006b810 0x7f1cd006dcd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 --2- 172.21.15.32:0/316162321 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1ccc003f20 0x7f1ce40b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.405+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 >> 172.21.15.32:0/316162321 conn(0x7f1ce406bfe0 msgr2=0x7f1ce406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.406+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 shutdown_connections 2024-02-17T00:37:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.406+0000 7f1cea8df640 1 -- 172.21.15.32:0/316162321 wait complete. 2024-02-17T00:37:45.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-17T00:37:45.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.524+0000 7fc9a1b77640 1 Processor -- start 2024-02-17T00:37:45.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.524+0000 7fc9a1b77640 1 -- start start 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc9a1b77640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc99c15db00 0x7fc99c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc9a1b77640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc9a1b77640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0d1e80 con 0x7fc99c0b53b0 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc9a1b77640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0b5930 con 0x7fc99c15db00 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc9a1b77640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0b5c10 con 0x7fc99c0ce2b0 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc99b7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc99c15db00 0x7fc99c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc99b7fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc99c15db00 0x7fc99c0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38096/0 (socket says 172.21.15.32:38096) 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.525+0000 7fc99b7fe640 1 -- 172.21.15.32:0/2051756765 learned_addr learned my addr 172.21.15.32:0/2051756765 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99bfff640 1 --2- 172.21.15.32:0/2051756765 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99b7fe640 1 -- 172.21.15.32:0/2051756765 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 msgr2=0x7fc99c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99b7fe640 1 --2- 172.21.15.32:0/2051756765 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99b7fe640 1 -- 172.21.15.32:0/2051756765 >> v1:172.21.15.32:6789/0 conn(0x7fc99c0b53b0 legacy=0x7fc99c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99b7fe640 1 -- 172.21.15.32:0/2051756765 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0b5ef0 con 0x7fc99c15db00 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99b7fe640 1 --2- 172.21.15.32:0/2051756765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0d0340 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009870 tx=0x7fc98c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81ba04cbb073bd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.526+0000 7fc99a7fc640 1 -- 172.21.15.32:0/2051756765 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c030840 con 0x7fc99c15db00 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc99a7fc640 1 -- 172.21.15.32:0/2051756765 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0309a0 con 0x7fc99c15db00 2024-02-17T00:37:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc99a7fc640 1 -- 172.21.15.32:0/2051756765 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c030d30 con 0x7fc99c15db00 2024-02-17T00:37:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 -- 172.21.15.32:0/2051756765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 msgr2=0x7fc99c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/2051756765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0d0340 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009870 tx=0x7fc98c02b980 comp rx=0 tx=0).stop 2024-02-17T00:37:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 -- 172.21.15.32:0/2051756765 shutdown_connections 2024-02-17T00:37:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/2051756765 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/2051756765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0d0340 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 -- 172.21.15.32:0/2051756765 >> 172.21.15.32:0/2051756765 conn(0x7fc99c072290 msgr2=0x7fc99c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 -- 172.21.15.32:0/2051756765 shutdown_connections 2024-02-17T00:37:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.527+0000 7fc9a1b77640 1 -- 172.21.15.32:0/2051756765 wait complete. 2024-02-17T00:37:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.528+0000 7fc9a1b77640 1 Processor -- start 2024-02-17T00:37:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.528+0000 7fc9a1b77640 1 -- start start 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc9a1b77640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc99c0b53b0 0x7fc99c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc9a1b77640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc9a1b77640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc9a1b77640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c1552a0 con 0x7fc99c15db00 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc9a1b77640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c154690 con 0x7fc99c0b53b0 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc9a1b77640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c154970 con 0x7fc99c0ce2b0 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc99bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc99bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0b81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38112/0 (socket says 172.21.15.32:38112) 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc99bfff640 1 -- 172.21.15.32:0/4187662135 learned_addr learned my addr 172.21.15.32:0/4187662135 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc99affd640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.529+0000 7fc99b7fe640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc99c0b53b0 0x7fc99c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc99bfff640 1 -- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 msgr2=0x7fc99c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc99bfff640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc99bfff640 1 -- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc99c0b53b0 msgr2=0x7fc99c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc99bfff640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc99c0b53b0 0x7fc99c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc99bfff640 1 -- 172.21.15.32:0/4187662135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0094d0 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc99bfff640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0b81c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc99400cd70 tx=0x7fc99400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994003b90 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994003cf0 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c154c50 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994004240 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.530+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c155c70 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.531+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c068fd0 con 0x7fc99c15db00 2024-02-17T00:37:45.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.531+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc9940043a0 con 0x7fc99c15db00 2024-02-17T00:37:45.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.532+0000 7fc983fff640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc98806b810 0x7fc98806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.532+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc994012070 con 0x7fc99c15db00 2024-02-17T00:37:45.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.532+0000 7fc99b7fe640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc98806b810 0x7fc98806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.532+0000 7fc99b7fe640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc98806b810 0x7fc98806dcd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc98c036000 tx=0x7fc98c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.536+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc994055550 con 0x7fc99c15db00 2024-02-17T00:37:45.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.784+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc99c0d3630 con 0x7fc99c15db00 2024-02-17T00:37:45.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.786+0000 7fc983fff640 1 -- 172.21.15.32:0/4187662135 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc994058c10 con 0x7fc99c15db00 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc98806b810 msgr2=0x7fc98806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc98806b810 0x7fc98806dcd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc98c036000 tx=0x7fc98c008030 comp rx=0 tx=0).stop 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 msgr2=0x7fc99c0b81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0b81c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc99400cd70 tx=0x7fc99400a660 comp rx=0 tx=0).stop 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 shutdown_connections 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc99c15db00 0x7fc99c0b81c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc98806b810 0x7fc98806dcd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc99c0ce2b0 0x7fc99c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 --2- 172.21.15.32:0/4187662135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc99c0b53b0 0x7fc99c155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 >> 172.21.15.32:0/4187662135 conn(0x7fc99c072290 msgr2=0x7fc99c15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:45.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 shutdown_connections 2024-02-17T00:37:45.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.788+0000 7fc9a1b77640 1 -- 172.21.15.32:0/4187662135 wait complete. 2024-02-17T00:37:45.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-17T00:37:45.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.900+0000 7f15eb281640 1 Processor -- start 2024-02-17T00:37:45.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.901+0000 7f15eb281640 1 -- start start 2024-02-17T00:37:45.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.901+0000 7f15eb281640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15e415da60 0x7f15e40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.901+0000 7f15eb281640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e415de40 0x7f15e415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.901+0000 7f15eb281640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e415e8a0 con 0x7f15e4161d70 2024-02-17T00:37:45.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.901+0000 7f15eb281640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e4161640 con 0x7f15e415da60 2024-02-17T00:37:45.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.901+0000 7f15eb281640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e415eb80 con 0x7f15e415de40 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e901d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15e415da60 0x7f15e40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e881c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e415de40 0x7f15e415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e981e640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f15e4161d70 0x7f15e40ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:44898/0 (socket says 172.21.15.32:44898) 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e901d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15e415da60 0x7f15e40d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45774/0 (socket says 172.21.15.32:45774) 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e981e640 1 -- 172.21.15.32:0/1029425769 learned_addr learned my addr 172.21.15.32:0/1029425769 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e901d640 1 -- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e415de40 msgr2=0x7f15e415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e901d640 1 --2- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e415de40 0x7f15e415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e901d640 1 -- 172.21.15.32:0/1029425769 >> v1:172.21.15.39:6789/0 conn(0x7f15e4161d70 legacy=0x7f15e40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.902+0000 7f15e901d640 1 -- 172.21.15.32:0/1029425769 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e415ee60 con 0x7f15e415da60 2024-02-17T00:37:45.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.903+0000 7f15e901d640 1 --2- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415da60 0x7f15e40d0aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0097a0 tx=0x7f15dc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eb1c4ca97188de2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.903+0000 7f15e3fff640 1 -- 172.21.15.32:0/1029425769 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc02e070 con 0x7f15e415da60 2024-02-17T00:37:45.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.903+0000 7f15e3fff640 1 -- 172.21.15.32:0/1029425769 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc0315a0 con 0x7f15e415da60 2024-02-17T00:37:45.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.903+0000 7f15e3fff640 1 -- 172.21.15.32:0/1029425769 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc031930 con 0x7f15e415da60 2024-02-17T00:37:45.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 -- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415da60 msgr2=0x7f15e40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 --2- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415da60 0x7f15e40d0aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0097a0 tx=0x7f15dc02b840 comp rx=0 tx=0).stop 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 -- 172.21.15.32:0/1029425769 shutdown_connections 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 --2- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e415de40 0x7f15e415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 --2- 172.21.15.32:0/1029425769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415da60 0x7f15e40d0aa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 -- 172.21.15.32:0/1029425769 >> 172.21.15.32:0/1029425769 conn(0x7f15e406bfe0 msgr2=0x7f15e406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 -- 172.21.15.32:0/1029425769 shutdown_connections 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.904+0000 7f15eb281640 1 -- 172.21.15.32:0/1029425769 wait complete. 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.905+0000 7f15eb281640 1 Processor -- start 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.905+0000 7f15eb281640 1 -- start start 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 0x7f15e40cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415de40 0x7f15e41e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e4161d70 0x7f15e40c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4149b90 con 0x7f15e415da60 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4149840 con 0x7f15e415de40 2024-02-17T00:37:45.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41e9290 con 0x7f15e4161d70 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 0x7f15e40cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 0x7f15e40cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38116/0 (socket says 172.21.15.32:38116) 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 -- 172.21.15.32:0/751413565 learned_addr learned my addr 172.21.15.32:0/751413565 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e981e640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e4161d70 0x7f15e40c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e881c640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415de40 0x7f15e41e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 -- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e4161d70 msgr2=0x7f15e40c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e4161d70 0x7f15e40c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 -- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415de40 msgr2=0x7f15e41e8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415de40 0x7f15e41e8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 -- 172.21.15.32:0/751413565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc009400 con 0x7f15e415da60 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e881c640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415de40 0x7f15e41e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e981e640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e4161d70 0x7f15e40c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e901d640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 0x7f15e40cb720 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f15dc034040 tx=0x7f15dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc032840 con 0x7f15e415da60 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc031f00 con 0x7f15e415da60 2024-02-17T00:37:45.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40c9b30 con 0x7f15e415da60 2024-02-17T00:37:45.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.906+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc032be0 con 0x7f15e415da60 2024-02-17T00:37:45.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.907+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e41e97d0 con 0x7f15e415da60 2024-02-17T00:37:45.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.908+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e40680c0 con 0x7f15e415da60 2024-02-17T00:37:45.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.908+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f15dc032d40 con 0x7f15e415da60 2024-02-17T00:37:45.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.908+0000 7f15e1ffb640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f15d006b810 0x7f15d006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:45.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.909+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f15dc0abf30 con 0x7f15e415da60 2024-02-17T00:37:45.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.909+0000 7f15e881c640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f15d006b810 0x7f15d006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:45.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.909+0000 7f15e881c640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f15d006b810 0x7f15d006dcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f15e40b7ee0 tx=0x7f15d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:45.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:45.913+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15dc076c50 con 0x7f15e415da60 2024-02-17T00:37:46.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.164+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f15e4149cd0 con 0x7f15e415da60 2024-02-17T00:37:46.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.166+0000 7f15e1ffb640 1 -- 172.21.15.32:0/751413565 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f15e4149cd0 con 0x7f15e415da60 2024-02-17T00:37:46.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f15d006b810 msgr2=0x7f15d006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f15d006b810 0x7f15d006dcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f15e40b7ee0 tx=0x7f15d8008040 comp rx=0 tx=0).stop 2024-02-17T00:37:46.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 msgr2=0x7f15e40cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 0x7f15e40cb720 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f15dc034040 tx=0x7f15dc0046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 shutdown_connections 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f15d006b810 0x7f15d006dcd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f15e4161d70 0x7f15e40c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e415de40 0x7f15e41e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 --2- 172.21.15.32:0/751413565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15e415da60 0x7f15e40cb720 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 >> 172.21.15.32:0/751413565 conn(0x7f15e406bfe0 msgr2=0x7f15e415f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 shutdown_connections 2024-02-17T00:37:46.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.168+0000 7f15eb281640 1 -- 172.21.15.32:0/751413565 wait complete. 2024-02-17T00:37:46.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-17T00:37:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.280+0000 7fb42c3f4640 1 Processor -- start 2024-02-17T00:37:46.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.280+0000 7fb42c3f4640 1 -- start start 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.281+0000 7fb42c3f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb42415db00 0x7fb4240d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.281+0000 7fb42c3f4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4240b53b0 0x7fb4240d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.281+0000 7fb42c3f4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240d1e80 con 0x7fb4240ce2b0 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.281+0000 7fb42c3f4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240b5930 con 0x7fb4240b53b0 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.281+0000 7fb42c3f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b5c10 con 0x7fb42415db00 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.281+0000 7fb42998f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4240b53b0 0x7fb4240d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42998f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4240b53b0 0x7fb4240d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38118/0 (socket says 172.21.15.32:38118) 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42998f640 1 -- 172.21.15.32:0/3339460278 learned_addr learned my addr 172.21.15.32:0/3339460278 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42a190640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb42415db00 0x7fb4240d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42998f640 1 -- 172.21.15.32:0/3339460278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb42415db00 msgr2=0x7fb4240d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42998f640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb42415db00 0x7fb4240d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42998f640 1 -- 172.21.15.32:0/3339460278 >> v1:172.21.15.39:6789/0 conn(0x7fb4240ce2b0 legacy=0x7fb424161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42998f640 1 -- 172.21.15.32:0/3339460278 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240b5ef0 con 0x7fb4240b53b0 2024-02-17T00:37:46.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.282+0000 7fb42a190640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb42415db00 0x7fb4240d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:46.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42998f640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb4240d0880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb414009870 tx=0x7fb41402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657a4f746c054583 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:46.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42918e640 1 -- 172.21.15.32:0/3339460278 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414030840 con 0x7fb4240b53b0 2024-02-17T00:37:46.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42918e640 1 -- 172.21.15.32:0/3339460278 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4140309a0 con 0x7fb4240b53b0 2024-02-17T00:37:46.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42918e640 1 -- 172.21.15.32:0/3339460278 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414030d30 con 0x7fb4240b53b0 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3339460278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 msgr2=0x7fb4240d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb4240d0880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb414009870 tx=0x7fb41402b980 comp rx=0 tx=0).stop 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3339460278 shutdown_connections 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb4240d0880 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3339460278 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb42415db00 0x7fb4240d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3339460278 >> 172.21.15.32:0/3339460278 conn(0x7fb424072290 msgr2=0x7fb4240726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3339460278 shutdown_connections 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.283+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3339460278 wait complete. 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.284+0000 7fb42c3f4640 1 Processor -- start 2024-02-17T00:37:46.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 -- start start 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb42414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4240ce2b0 0x7fb4240b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb42415db00 0x7fb4240b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424155520 con 0x7fb4240b53b0 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424155800 con 0x7fb42415db00 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42c3f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424155ae0 con 0x7fb4240ce2b0 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42a190640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb42414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42a190640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb42414d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38122/0 (socket says 172.21.15.32:38122) 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.285+0000 7fb42a190640 1 -- 172.21.15.32:0/3826973267 learned_addr learned my addr 172.21.15.32:0/3826973267 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42998f640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4240ce2b0 0x7fb4240b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a991640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb42415db00 0x7fb4240b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a190640 1 -- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4240ce2b0 msgr2=0x7fb4240b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a190640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4240ce2b0 0x7fb4240b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a190640 1 -- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb42415db00 msgr2=0x7fb4240b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a190640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb42415db00 0x7fb4240b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a190640 1 -- 172.21.15.32:0/3826973267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140094d0 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42a190640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb42414d2b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb42000d7d0 tx=0x7fb42000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420004030 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420004190 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42415f520 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420004520 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.286+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb424155dc0 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.287+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424068fd0 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.287+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb42000b6c0 con 0x7fb4240b53b0 2024-02-17T00:37:46.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.288+0000 7fb41affd640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb40806b810 0x7fb40806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.288+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb42008a280 con 0x7fb4240b53b0 2024-02-17T00:37:46.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.288+0000 7fb42998f640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb40806b810 0x7fb40806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.288+0000 7fb42998f640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb40806b810 0x7fb40806dcd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb414036000 tx=0x7fb414008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:46.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.292+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb420054de0 con 0x7fb4240b53b0 2024-02-17T00:37:46.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.540+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb424159da0 con 0x7fb4240b53b0 2024-02-17T00:37:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.542+0000 7fb41affd640 1 -- 172.21.15.32:0/3826973267 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb4200584a0 con 0x7fb4240b53b0 2024-02-17T00:37:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb40806b810 msgr2=0x7fb40806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb40806b810 0x7fb40806dcd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb414036000 tx=0x7fb414008030 comp rx=0 tx=0).stop 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 msgr2=0x7fb42414d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb42414d2b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb42000d7d0 tx=0x7fb42000dc90 comp rx=0 tx=0).stop 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 shutdown_connections 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb42415db00 0x7fb4240b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb40806b810 0x7fb40806dcd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4240ce2b0 0x7fb4240b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 --2- 172.21.15.32:0/3826973267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4240b53b0 0x7fb42414d2b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 >> 172.21.15.32:0/3826973267 conn(0x7fb424072290 msgr2=0x7fb4240d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 shutdown_connections 2024-02-17T00:37:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.544+0000 7fb42c3f4640 1 -- 172.21.15.32:0/3826973267 wait complete. 2024-02-17T00:37:46.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-17T00:37:46.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.657+0000 7f4abf37a640 1 Processor -- start 2024-02-17T00:37:46.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.658+0000 7f4abf37a640 1 -- start start 2024-02-17T00:37:46.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.658+0000 7f4abf37a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4ab80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.658+0000 7f4abf37a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ab806c280 0x7f4ab806da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.658+0000 7f4abf37a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80cc290 con 0x7f4ab8161ff0 2024-02-17T00:37:46.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.658+0000 7f4abf37a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80cc570 con 0x7f4ab806c280 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.658+0000 7f4abf37a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8072650 con 0x7f4ab815dbb0 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abc915640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4ab8161ff0 0x7f4ab806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60990/0 (socket says 172.21.15.32:60990) 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abc915640 1 -- 172.21.15.32:0/2587572887 learned_addr learned my addr 172.21.15.32:0/2587572887 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082180513 0 0) 0x7f4ab80cc290 con 0x7f4ab8161ff0 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa4003520 con 0x7f4ab8161ff0 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abd116640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4ab80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abd917640 1 --2- 172.21.15.32:0/2587572887 >> v2:172.21.15.39:3300/0 conn(0x7f4ab806c280 0x7f4ab806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550243012 0 0) 0x7f4aa4003520 con 0x7f4ab8161ff0 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 msgr2=0x7f4ab80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4ab80b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 >> v2:172.21.15.39:3300/0 conn(0x7f4ab806c280 msgr2=0x7f4ab806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 --2- 172.21.15.32:0/2587572887 >> v2:172.21.15.39:3300/0 conn(0x7f4ab806c280 0x7f4ab806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8072930 con 0x7f4ab8161ff0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f4ab4001670 con 0x7f4ab8161ff0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abd917640 1 --2- 172.21.15.32:0/2587572887 >> v2:172.21.15.39:3300/0 conn(0x7f4ab806c280 0x7f4ab806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 >> v1:172.21.15.32:6789/0 conn(0x7f4ab8161ff0 legacy=0x7f4ab806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4aa4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa4003ef0 0x7f4aa40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4aa4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80cc570 con 0x7f4aa4004d00 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8072650 con 0x7f4aa4003ef0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa400b9d0 con 0x7f4ab815dbb0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abd917640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4aa4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abc915640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa4003ef0 0x7f4aa40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.659+0000 7f4abd116640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4aa4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd917640 1 -- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 msgr2=0x7f4aa4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd917640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4aa4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd917640 1 -- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa4003ef0 msgr2=0x7f4aa40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd917640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa4003ef0 0x7f4aa40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd917640 1 -- 172.21.15.32:0/2587572887 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4003520 con 0x7f4aa4004d00 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd116640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab815dbb0 0x7f4aa4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abc915640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa4003ef0 0x7f4aa40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4abd917640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4aa4005180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00073b0 tx=0x7f4aa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e43838a0bd5af4c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab002cd90 con 0x7f4aa4004d00 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.660+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0003990 con 0x7f4aa4004d00 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4aabfff640 1 -- 172.21.15.32:0/2587572887 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0003d40 con 0x7f4aa4004d00 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abf37a640 1 -- 172.21.15.32:0/2587572887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 msgr2=0x7f4aa4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abf37a640 1 --2- 172.21.15.32:0/2587572887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4aa4005180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00073b0 tx=0x7f4aa40057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abd917640 1 -- 172.21.15.32:0/2587572887 reap_dead start 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abf37a640 1 -- 172.21.15.32:0/2587572887 shutdown_connections 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abf37a640 1 -- 172.21.15.32:0/2587572887 >> 172.21.15.32:0/2587572887 conn(0x7f4ab80719c0 msgr2=0x7f4ab8071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abf37a640 1 -- 172.21.15.32:0/2587572887 shutdown_connections 2024-02-17T00:37:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.661+0000 7f4abf37a640 1 -- 172.21.15.32:0/2587572887 wait complete. 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.662+0000 7f4abf37a640 1 Processor -- start 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.662+0000 7f4abf37a640 1 -- start start 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abf37a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4ab81453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abf37a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab81420b0 0x7f4ab80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abf37a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab80ade70 0x7f4ab80ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abf37a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80ae830 con 0x7f4aa4004d00 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abf37a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8143880 con 0x7f4ab81420b0 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abf37a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8145920 con 0x7f4ab80ade70 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abd116640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4ab81453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abd116640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4ab81453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38126/0 (socket says 172.21.15.32:38126) 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abd116640 1 -- 172.21.15.32:0/3544824367 learned_addr learned my addr 172.21.15.32:0/3544824367 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abd917640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab80ade70 0x7f4ab80ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.663+0000 7f4abc915640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab81420b0 0x7f4ab80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd116640 1 -- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab80ade70 msgr2=0x7f4ab80ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd116640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab80ade70 0x7f4ab80ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd116640 1 -- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab81420b0 msgr2=0x7f4ab80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd116640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab81420b0 0x7f4ab80ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd116640 1 -- 172.21.15.32:0/3544824367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8142c70 con 0x7f4aa4004d00 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abc915640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab81420b0 0x7f4ab80ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd917640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab80ade70 0x7f4ab80ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abd116640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4ab81453e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0116d0 tx=0x7f4aac011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00f9c0 con 0x7f4aa4004d00 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00fb20 con 0x7f4aa4004d00 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab8142f50 con 0x7f4aa4004d00 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00fed0 con 0x7f4aa4004d00 2024-02-17T00:37:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.664+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab8143510 con 0x7f4aa4004d00 2024-02-17T00:37:46.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.665+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab8068fd0 con 0x7f4aa4004d00 2024-02-17T00:37:46.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.666+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4aac015460 con 0x7f4aa4004d00 2024-02-17T00:37:46.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.666+0000 7f4aa9ffb640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4a9c06b810 0x7f4a9c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:46.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.666+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4aac08a8b0 con 0x7f4aa4004d00 2024-02-17T00:37:46.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.666+0000 7f4abc915640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4a9c06b810 0x7f4a9c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:46.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.667+0000 7f4abc915640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4a9c06b810 0x7f4a9c06dcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4001eb0 tx=0x7f4ab4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:46.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.670+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4aac0555d0 con 0x7f4aa4004d00 2024-02-17T00:37:46.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.920+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4ab806bc50 con 0x7f4aa4004d00 2024-02-17T00:37:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.922+0000 7f4aa9ffb640 1 -- 172.21.15.32:0/3544824367 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4aac058c90 con 0x7f4aa4004d00 2024-02-17T00:37:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4a9c06b810 msgr2=0x7f4a9c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4a9c06b810 0x7f4a9c06dcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4001eb0 tx=0x7f4ab4009040 comp rx=0 tx=0).stop 2024-02-17T00:37:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 msgr2=0x7f4ab81453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4ab81453e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0116d0 tx=0x7f4aac011b90 comp rx=0 tx=0).stop 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 shutdown_connections 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4a9c06b810 0x7f4a9c06dcd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4ab80ade70 0x7f4ab80ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab81420b0 0x7f4ab80ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 --2- 172.21.15.32:0/3544824367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4aa4004d00 0x7f4ab81453e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 >> 172.21.15.32:0/3544824367 conn(0x7f4ab80719c0 msgr2=0x7f4ab806e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 shutdown_connections 2024-02-17T00:37:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:46.924+0000 7f4abf37a640 1 -- 172.21.15.32:0/3544824367 wait complete. 2024-02-17T00:37:46.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-17T00:37:47.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.037+0000 7feec804d640 1 Processor -- start 2024-02-17T00:37:47.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec804d640 1 -- start start 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec804d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7feec015eb70 0x7feec00af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec804d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00afa30 con 0x7feec015a900 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec804d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00b02d0 con 0x7feec00ae710 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec804d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec00aeb40 con 0x7feec015eb70 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec5de9640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7feec015a900 0x7feec015e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32768/0 (socket says 172.21.15.32:32768) 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.038+0000 7feec5de9640 1 -- 172.21.15.32:0/1579527599 learned_addr learned my addr 172.21.15.32:0/1579527599 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec55e8640 1 --2- 172.21.15.32:0/1579527599 >> v2:172.21.15.39:3300/0 conn(0x7feec015eb70 0x7feec00af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830841894 0 0) 0x7feec00afa30 con 0x7feec015a900 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeac003520 con 0x7feec015a900 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820853931 0 0) 0x7feec00b02d0 con 0x7feec00ae710 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec00afa30 con 0x7feec00ae710 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113265409 0 0) 0x7feeac003520 con 0x7feec015a900 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec55e8640 1 -- 172.21.15.32:0/1579527599 >> v1:172.21.15.39:6789/0 conn(0x7feec00ae710 legacy=0x7feec00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec55e8640 1 -- 172.21.15.32:0/1579527599 >> v1:172.21.15.32:6789/0 conn(0x7feec015a900 legacy=0x7feec015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.039+0000 7feec55e8640 1 -- 172.21.15.32:0/1579527599 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00aee10 con 0x7feec015eb70 2024-02-17T00:37:47.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.040+0000 7feec55e8640 1 --2- 172.21.15.32:0/1579527599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015eb70 0x7feec00af3e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feeb00097a0 tx=0x7feeb002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e1ab25bbcfdb7a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.040+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb002f050 con 0x7feec015eb70 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.040+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0031500 con 0x7feec015eb70 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.040+0000 7feec4de7640 1 -- 172.21.15.32:0/1579527599 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc001670 con 0x7feec015eb70 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 -- 172.21.15.32:0/1579527599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015eb70 msgr2=0x7feec00af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 --2- 172.21.15.32:0/1579527599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015eb70 0x7feec00af3e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feeb00097a0 tx=0x7feeb002b820 comp rx=0 tx=0).stop 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 -- 172.21.15.32:0/1579527599 shutdown_connections 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 --2- 172.21.15.32:0/1579527599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015eb70 0x7feec00af3e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 -- 172.21.15.32:0/1579527599 >> 172.21.15.32:0/1579527599 conn(0x7feec00b5c30 msgr2=0x7feec00999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 -- 172.21.15.32:0/1579527599 shutdown_connections 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.041+0000 7feec804d640 1 -- 172.21.15.32:0/1579527599 wait complete. 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.042+0000 7feec804d640 1 Processor -- start 2024-02-17T00:37:47.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.042+0000 7feec804d640 1 -- start start 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feec00ae710 0x7feec0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015a900 0x7feec00d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 0x7feec0154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec00d0bd0 con 0x7feec015eb70 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec01f3440 con 0x7feec015a900 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00d0e00 con 0x7feec00ae710 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 0x7feec0154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 0x7feec0154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38132/0 (socket says 172.21.15.32:38132) 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 -- 172.21.15.32:0/1722902568 learned_addr learned my addr 172.21.15.32:0/1722902568 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec55e8640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015a900 0x7feec00d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 -- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feec00ae710 msgr2=0x7feec0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec5de9640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feec00ae710 0x7feec0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feec00ae710 0x7feec0159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 -- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015a900 msgr2=0x7feec00d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015a900 0x7feec00d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 -- 172.21.15.32:0/1722902568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0009400 con 0x7feec015eb70 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec55e8640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015a900 0x7feec00d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec5de9640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feec00ae710 0x7feec0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec65ea640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 0x7feec0154130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c790 tx=0x7feeb800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800cea0 con 0x7feec015eb70 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8003b70 con 0x7feec015eb70 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec00ccff0 con 0x7feec015eb70 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800a850 con 0x7feec015eb70 2024-02-17T00:37:47.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.043+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec00cd5b0 con 0x7feec015eb70 2024-02-17T00:37:47.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.044+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec0068fd0 con 0x7feec015eb70 2024-02-17T00:37:47.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.045+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7feeb800a9b0 con 0x7feec015eb70 2024-02-17T00:37:47.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.045+0000 7feeb67fc640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7feea406b810 0x7feea406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.045+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7feeb8089ec0 con 0x7feec015eb70 2024-02-17T00:37:47.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.045+0000 7feec5de9640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7feea406b810 0x7feea406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.046+0000 7feec5de9640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7feea406b810 0x7feea406dcd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feebc0011e0 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.049+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feeb8054aa0 con 0x7feec015eb70 2024-02-17T00:37:47.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.296+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7feec00b59f0 con 0x7feec015eb70 2024-02-17T00:37:47.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.298+0000 7feeb67fc640 1 -- 172.21.15.32:0/1722902568 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7feeb8058160 con 0x7feec015eb70 2024-02-17T00:37:47.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7feea406b810 msgr2=0x7feea406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7feea406b810 0x7feea406dcd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feebc0011e0 tx=0x7feebc009040 comp rx=0 tx=0).stop 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 msgr2=0x7feec0154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 0x7feec0154130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c790 tx=0x7feeb800cc50 comp rx=0 tx=0).stop 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 shutdown_connections 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feec015eb70 0x7feec0154130 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feec015a900 0x7feec00d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7feea406b810 0x7feea406dcd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 --2- 172.21.15.32:0/1722902568 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feec00ae710 0x7feec0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 >> 172.21.15.32:0/1722902568 conn(0x7feec00b5c30 msgr2=0x7feec00b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.299+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 shutdown_connections 2024-02-17T00:37:47.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.300+0000 7feec804d640 1 -- 172.21.15.32:0/1722902568 wait complete. 2024-02-17T00:37:47.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-17T00:37:47.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.412+0000 7fe3a219a640 1 Processor -- start 2024-02-17T00:37:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.412+0000 7fe3a219a640 1 -- start start 2024-02-17T00:37:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe3a219a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c15da60 0x7fe39c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe3a219a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe39c15de40 0x7fe39c15e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe3a219a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe39c161d70 0x7fe39c1621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe3a219a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c161640 con 0x7fe39c15de40 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe3a219a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c15e8a0 con 0x7fe39c161d70 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe3a219a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15eb80 con 0x7fe39c15da60 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe39c15de40 0x7fe39c15e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe39c15de40 0x7fe39c15e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38146/0 (socket says 172.21.15.32:38146) 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 -- 172.21.15.32:0/1966367268 learned_addr learned my addr 172.21.15.32:0/1966367268 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39b7fe640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c15da60 0x7fe39c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39bfff640 1 --2- 172.21.15.32:0/1966367268 >> v2:172.21.15.39:3300/0 conn(0x7fe39c161d70 0x7fe39c1621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 -- 172.21.15.32:0/1966367268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c15da60 msgr2=0x7fe39c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c15da60 0x7fe39c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 -- 172.21.15.32:0/1966367268 >> v2:172.21.15.39:3300/0 conn(0x7fe39c161d70 msgr2=0x7fe39c1621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 --2- 172.21.15.32:0/1966367268 >> v2:172.21.15.39:3300/0 conn(0x7fe39c161d70 0x7fe39c1621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39affd640 1 -- 172.21.15.32:0/1966367268 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c15ee60 con 0x7fe39c15de40 2024-02-17T00:37:47.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39b7fe640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c15da60 0x7fe39c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:47.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.413+0000 7fe39bfff640 1 --2- 172.21.15.32:0/1966367268 >> v2:172.21.15.39:3300/0 conn(0x7fe39c161d70 0x7fe39c1621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:47.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.414+0000 7fe39affd640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15de40 0x7fe39c15e2a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06b840 tx=0x7fe39002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42845b8475184afb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.414+0000 7fe39a7fc640 1 -- 172.21.15.32:0/1966367268 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900317e0 con 0x7fe39c15de40 2024-02-17T00:37:47.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.414+0000 7fe39a7fc640 1 -- 172.21.15.32:0/1966367268 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390031940 con 0x7fe39c15de40 2024-02-17T00:37:47.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.414+0000 7fe39a7fc640 1 -- 172.21.15.32:0/1966367268 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390031cd0 con 0x7fe39c15de40 2024-02-17T00:37:47.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.414+0000 7fe3a219a640 1 -- 172.21.15.32:0/1966367268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15de40 msgr2=0x7fe39c15e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.414+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15de40 0x7fe39c15e2a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06b840 tx=0x7fe39002b880 comp rx=0 tx=0).stop 2024-02-17T00:37:47.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 -- 172.21.15.32:0/1966367268 shutdown_connections 2024-02-17T00:37:47.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1966367268 >> v2:172.21.15.39:3300/0 conn(0x7fe39c161d70 0x7fe39c1621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15de40 0x7fe39c15e2a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1966367268 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c15da60 0x7fe39c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 -- 172.21.15.32:0/1966367268 >> 172.21.15.32:0/1966367268 conn(0x7fe39c06bfe0 msgr2=0x7fe39c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 -- 172.21.15.32:0/1966367268 shutdown_connections 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.415+0000 7fe3a219a640 1 -- 172.21.15.32:0/1966367268 wait complete. 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.416+0000 7fe3a219a640 1 Processor -- start 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.416+0000 7fe3a219a640 1 -- start start 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 0x7fe39c156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe39c15de40 0x7fe39c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c161d70 0x7fe39c1e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0cb970 con 0x7fe39c15da60 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c156d60 con 0x7fe39c15de40 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0cbbc0 con 0x7fe39c161d70 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 0x7fe39c156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 0x7fe39c156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38158/0 (socket says 172.21.15.32:38158) 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 -- 172.21.15.32:0/1196739632 learned_addr learned my addr 172.21.15.32:0/1196739632 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39affd640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe39c15de40 0x7fe39c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39bfff640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c161d70 0x7fe39c1e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 -- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c161d70 msgr2=0x7fe39c1e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c161d70 0x7fe39c1e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 -- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe39c15de40 msgr2=0x7fe39c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe39c15de40 0x7fe39c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 -- 172.21.15.32:0/1196739632 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900094d0 con 0x7fe39c15da60 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe39b7fe640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 0x7fe39c156820 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c7c0 tx=0x7fe38c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c007a30 con 0x7fe39c15da60 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c007b90 con 0x7fe39c15da60 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00ce70 con 0x7fe39c15da60 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c0cbea0 con 0x7fe39c15da60 2024-02-17T00:37:47.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.417+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c0cc460 con 0x7fe39c15da60 2024-02-17T00:37:47.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.418+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c0680c0 con 0x7fe39c15da60 2024-02-17T00:37:47.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.419+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe38c0113f0 con 0x7fe39c15da60 2024-02-17T00:37:47.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.419+0000 7fe383fff640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe38806b810 0x7fe38806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.419+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe38c08a120 con 0x7fe39c15da60 2024-02-17T00:37:47.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.419+0000 7fe39affd640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe38806b810 0x7fe38806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.420+0000 7fe39affd640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe38806b810 0x7fe38806dcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe390036000 tx=0x7fe39003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.423+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe38c054d00 con 0x7fe39c15da60 2024-02-17T00:37:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.674+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe39c068fd0 con 0x7fe39c15da60 2024-02-17T00:37:47.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.677+0000 7fe383fff640 1 -- 172.21.15.32:0/1196739632 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe38c0583c0 con 0x7fe39c15da60 2024-02-17T00:37:47.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe38806b810 msgr2=0x7fe38806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe38806b810 0x7fe38806dcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe390036000 tx=0x7fe39003d040 comp rx=0 tx=0).stop 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 msgr2=0x7fe39c156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 0x7fe39c156820 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c7c0 tx=0x7fe38c00cc80 comp rx=0 tx=0).stop 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 shutdown_connections 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe38806b810 0x7fe38806dcd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe39c161d70 0x7fe39c1e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe39c15de40 0x7fe39c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 --2- 172.21.15.32:0/1196739632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe39c15da60 0x7fe39c156820 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 >> 172.21.15.32:0/1196739632 conn(0x7fe39c06bfe0 msgr2=0x7fe39c0d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 shutdown_connections 2024-02-17T00:37:47.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.679+0000 7fe3a219a640 1 -- 172.21.15.32:0/1196739632 wait complete. 2024-02-17T00:37:47.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:47.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.790+0000 7f4565d8a640 1 Processor -- start 2024-02-17T00:37:47.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.790+0000 7f4565d8a640 1 -- start start 2024-02-17T00:37:47.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f4565d8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f45600d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f4565d8a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f45600b53b0 0x7f45600d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f4565d8a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600d1e80 con 0x7f45600ce2b0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f4565d8a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600b5930 con 0x7f45600b53b0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f4565d8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45600b5c10 con 0x7f456015db00 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f455ffff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f45600ce2b0 0x7f4560161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32778/0 (socket says 172.21.15.32:32778) 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f455ffff640 1 -- 172.21.15.32:0/2905061574 learned_addr learned my addr 172.21.15.32:0/2905061574 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f455effd640 1 --2- 172.21.15.32:0/2905061574 >> v2:172.21.15.39:3300/0 conn(0x7f45600b53b0 0x7f45600d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f455f7fe640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f45600d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.791+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070975776 0 0) 0x7f45600d1e80 con 0x7f45600ce2b0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4548003520 con 0x7f45600ce2b0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785054672 0 0) 0x7f4548003520 con 0x7f45600ce2b0 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 msgr2=0x7f45600d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f45600d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 >> v2:172.21.15.39:3300/0 conn(0x7f45600b53b0 msgr2=0x7f45600d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 --2- 172.21.15.32:0/2905061574 >> v2:172.21.15.39:3300/0 conn(0x7f45600b53b0 0x7f45600d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600b5ef0 con 0x7f45600ce2b0 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f45580019f0 con 0x7f45600ce2b0 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 >> v1:172.21.15.32:6789/0 conn(0x7f45600ce2b0 legacy=0x7f4560161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4548003970 0x7f4548003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45480047c0 0x7f4548004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f4548005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600b5930 con 0x7f45480047c0 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600b5c10 con 0x7f4548003970 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454800b980 con 0x7f456015db00 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455effd640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45480047c0 0x7f4548004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455f7fe640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4548003970 0x7f4548003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455ffff640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f4548005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455effd640 1 -- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 msgr2=0x7f4548005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455effd640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f4548005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455effd640 1 -- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4548003970 msgr2=0x7f4548003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455effd640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4548003970 0x7f4548003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455effd640 1 -- 172.21.15.32:0/2905061574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548003520 con 0x7f45480047c0 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455f7fe640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4548003970 0x7f4548003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.792+0000 7f455ffff640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f456015db00 0x7f4548005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.793+0000 7f455effd640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45480047c0 0x7f4548004c40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4554009ac0 tx=0x7f45480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ca05fe6f7862ff server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.793+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455402c710 con 0x7f45480047c0 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.793+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455402c870 con 0x7f45480047c0 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.793+0000 7f455e7fc640 1 -- 172.21.15.32:0/2905061574 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455402cc00 con 0x7f45480047c0 2024-02-17T00:37:47.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f4565d8a640 1 -- 172.21.15.32:0/2905061574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45480047c0 msgr2=0x7f4548004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f4565d8a640 1 --2- 172.21.15.32:0/2905061574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45480047c0 0x7f4548004c40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4554009ac0 tx=0x7f45480057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f455ffff640 1 -- 172.21.15.32:0/2905061574 reap_dead start 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f4565d8a640 1 -- 172.21.15.32:0/2905061574 shutdown_connections 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f4565d8a640 1 -- 172.21.15.32:0/2905061574 >> 172.21.15.32:0/2905061574 conn(0x7f4560072290 msgr2=0x7f45600726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f4565d8a640 1 -- 172.21.15.32:0/2905061574 shutdown_connections 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.794+0000 7f4565d8a640 1 -- 172.21.15.32:0/2905061574 wait complete. 2024-02-17T00:37:47.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.795+0000 7f4565d8a640 1 Processor -- start 2024-02-17T00:37:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.795+0000 7f4565d8a640 1 -- start start 2024-02-17T00:37:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f45480047c0 0x7f45600c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 0x7f45600cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45600ccf60 0x7f45600cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456015ba20 con 0x7f45601595b0 2024-02-17T00:37:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4560149890 con 0x7f45600ccf60 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456015bc70 con 0x7f45480047c0 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 0x7f45600cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 0x7f45600cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38188/0 (socket says 172.21.15.32:38188) 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 -- 172.21.15.32:0/707473694 learned_addr learned my addr 172.21.15.32:0/707473694 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455f7fe640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f45480047c0 0x7f45600c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455ffff640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45600ccf60 0x7f45600cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 -- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f45480047c0 msgr2=0x7f45600c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f45480047c0 0x7f45600c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 -- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45600ccf60 msgr2=0x7f45600cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45600ccf60 0x7f45600cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 -- 172.21.15.32:0/707473694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456015bf50 con 0x7f45601595b0 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455f7fe640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f45480047c0 0x7f45600c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455ffff640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45600ccf60 0x7f45600cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f455effd640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 0x7f45600cca20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4554000c00 tx=0x7f4554004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554003810 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455402de90 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554003b90 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.796+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456015c230 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.797+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45600c6c50 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.797+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600b6190 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.798+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4554003cf0 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.798+0000 7f4547fff640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f454c06b810 0x7f454c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.798+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f45540ac0c0 con 0x7f45601595b0 2024-02-17T00:37:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.798+0000 7f455f7fe640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f454c06b810 0x7f454c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.799+0000 7f455f7fe640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f454c06b810 0x7f454c06dcd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4550009a70 tx=0x7f4550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.802+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4554076c00 con 0x7f45601595b0 2024-02-17T00:37:47.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.984+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45600d3630 con 0x7f45601595b0 2024-02-17T00:37:47.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.985+0000 7f4547fff640 1 -- 172.21.15.32:0/707473694 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13116 (secure 0 0 0) 0x7f455407a2c0 con 0x7f45601595b0 2024-02-17T00:37:47.988 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:47.988 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":37,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:45.025422+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:47.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f454c06b810 msgr2=0x7f454c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f454c06b810 0x7f454c06dcd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4550009a70 tx=0x7f4550008040 comp rx=0 tx=0).stop 2024-02-17T00:37:47.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 msgr2=0x7f45600cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 0x7f45600cca20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4554000c00 tx=0x7f4554004730 comp rx=0 tx=0).stop 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 shutdown_connections 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45600ccf60 0x7f45600cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45601595b0 0x7f45600cca20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f454c06b810 0x7f454c06dcd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 --2- 172.21.15.32:0/707473694 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f45480047c0 0x7f45600c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 >> 172.21.15.32:0/707473694 conn(0x7f4560072290 msgr2=0x7f45600c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 shutdown_connections 2024-02-17T00:37:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:47.987+0000 7f4565d8a640 1 -- 172.21.15.32:0/707473694 wait complete. 2024-02-17T00:37:48.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T00:37:48.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T00:37:48.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.103+0000 7f2256972640 1 Processor -- start 2024-02-17T00:37:48.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.103+0000 7f2256972640 1 -- start start 2024-02-17T00:37:48.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2256972640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d2c40 0x7f22500b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2256972640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22500b68b0 0x7f22500b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2256972640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500b7ef0 con 0x7f22500d0780 2024-02-17T00:37:48.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2256972640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500b81d0 con 0x7f22500b68b0 2024-02-17T00:37:48.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2256972640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500b84b0 con 0x7f22500d2c40 2024-02-17T00:37:48.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22500b68b0 0x7f22500b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22500b68b0 0x7f22500b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38200/0 (socket says 172.21.15.32:38200) 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 -- 172.21.15.32:0/2886005545 learned_addr learned my addr 172.21.15.32:0/2886005545 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f224f7fe640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d2c40 0x7f22500b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 -- 172.21.15.32:0/2886005545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d2c40 msgr2=0x7f22500b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d2c40 0x7f22500b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 -- 172.21.15.32:0/2886005545 >> v1:172.21.15.32:6789/0 conn(0x7f22500d0780 legacy=0x7f22500d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f2254f0f640 1 -- 172.21.15.32:0/2886005545 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500b8790 con 0x7f22500b68b0 2024-02-17T00:37:48.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.104+0000 7f224f7fe640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d2c40 0x7f22500b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.105+0000 7f2254f0f640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500b68b0 0x7f22500b6d40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2248009e50 tx=0x7f224802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e889f796d19755aa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.105+0000 7f224effd640 1 -- 172.21.15.32:0/2886005545 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224802cb00 con 0x7f22500b68b0 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.105+0000 7f224effd640 1 -- 172.21.15.32:0/2886005545 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224802cc60 con 0x7f22500b68b0 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.105+0000 7f224effd640 1 -- 172.21.15.32:0/2886005545 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480343f0 con 0x7f22500b68b0 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 -- 172.21.15.32:0/2886005545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500b68b0 msgr2=0x7f22500b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500b68b0 0x7f22500b6d40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2248009e50 tx=0x7f224802bf60 comp rx=0 tx=0).stop 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 -- 172.21.15.32:0/2886005545 shutdown_connections 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500b68b0 0x7f22500b6d40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 --2- 172.21.15.32:0/2886005545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d2c40 0x7f22500b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 -- 172.21.15.32:0/2886005545 >> 172.21.15.32:0/2886005545 conn(0x7f22500726b0 msgr2=0x7f2250072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 -- 172.21.15.32:0/2886005545 shutdown_connections 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.106+0000 7f2256972640 1 -- 172.21.15.32:0/2886005545 wait complete. 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.107+0000 7f2256972640 1 Processor -- start 2024-02-17T00:37:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.107+0000 7f2256972640 1 -- start start 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2256972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22500b68b0 0x7f22500b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2256972640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d0780 0x7f22500ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2256972640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 0x7f22500cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2256972640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500cc070 con 0x7f22500d2c40 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2256972640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250153d30 con 0x7f22500b68b0 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2256972640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500cb460 con 0x7f22500d0780 2024-02-17T00:37:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 0x7f22500cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 0x7f22500cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38212/0 (socket says 172.21.15.32:38212) 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 -- 172.21.15.32:0/1425835033 learned_addr learned my addr 172.21.15.32:0/1425835033 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f224f7fe640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d0780 0x7f22500ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f224ffff640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22500b68b0 0x7f22500b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 -- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d0780 msgr2=0x7f22500ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d0780 0x7f22500ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 -- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22500b68b0 msgr2=0x7f22500b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22500b68b0 0x7f22500b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 -- 172.21.15.32:0/1425835033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248009b30 con 0x7f22500d2c40 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f224ffff640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22500b68b0 0x7f22500b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.108+0000 7f2254f0f640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 0x7f22500cae30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2248009e50 tx=0x7f2248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.109+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248009510 con 0x7f22500d2c40 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.109+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224803e450 con 0x7f22500d2c40 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.109+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500cb740 con 0x7f22500d2c40 2024-02-17T00:37:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.109+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224803e800 con 0x7f22500d2c40 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.109+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22500cbd00 con 0x7f22500d2c40 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.110+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22500685d0 con 0x7f22500d2c40 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.110+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f224803e960 con 0x7f22500d2c40 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.110+0000 7f224cff9640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f223006b810 0x7f223006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.110+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f22480acdc0 con 0x7f22500d2c40 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.111+0000 7f224ffff640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f223006b810 0x7f223006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.111+0000 7f224ffff640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f223006b810 0x7f223006dcd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2240001680 tx=0x7f2240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.115+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2248077910 con 0x7f22500d2c40 2024-02-17T00:37:48.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.293+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2250068f60 con 0x7f22500d2c40 2024-02-17T00:37:48.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.293+0000 7f224cff9640 1 -- 172.21.15.32:0/1425835033 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2248043020 con 0x7f22500d2c40 2024-02-17T00:37:48.296 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T00:37:48.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f223006b810 msgr2=0x7f223006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f223006b810 0x7f223006dcd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2240001680 tx=0x7f2240009040 comp rx=0 tx=0).stop 2024-02-17T00:37:48.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 msgr2=0x7f22500cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 0x7f22500cae30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2248009e50 tx=0x7f2248004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:48.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 shutdown_connections 2024-02-17T00:37:48.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22500d2c40 0x7f22500cae30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f223006b810 0x7f223006dcd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f22500d0780 0x7f22500ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 --2- 172.21.15.32:0/1425835033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22500b68b0 0x7f22500b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 >> 172.21.15.32:0/1425835033 conn(0x7f22500726b0 msgr2=0x7f22500d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:48.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 shutdown_connections 2024-02-17T00:37:48.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.295+0000 7f2256972640 1 -- 172.21.15.32:0/1425835033 wait complete. 2024-02-17T00:37:48.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T00:37:48.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.407+0000 7f8fcc956640 1 Processor -- start 2024-02-17T00:37:48.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.407+0000 7f8fcc956640 1 -- start start 2024-02-17T00:37:48.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fcc956640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815da60 0x7f8fc80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fcc956640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc815e8a0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fcc956640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc815eb80 con 0x7f8fc815de40 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fcc956640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8161640 con 0x7f8fc815da60 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fc6d9d640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8fc815e2a0 0x7f8fc80ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32796/0 (socket says 172.21.15.32:32796) 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fc6d9d640 1 -- 172.21.15.32:0/1862903602 learned_addr learned my addr 172.21.15.32:0/1862903602 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fc659c640 1 --2- 172.21.15.32:0/1862903602 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815da60 0x7f8fc80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.408+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286050645 0 0) 0x7f8fc815e8a0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.409+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb4003520 con 0x7f8fc815e2a0 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.409+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161003173 0 0) 0x7f8fc815eb80 con 0x7f8fc815de40 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.409+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc815e8a0 con 0x7f8fc815de40 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.409+0000 7f8fc659c640 1 -- 172.21.15.32:0/1862903602 >> v1:172.21.15.39:6789/0 conn(0x7f8fc815de40 legacy=0x7f8fc8161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.409+0000 7f8fc659c640 1 -- 172.21.15.32:0/1862903602 >> v1:172.21.15.32:6789/0 conn(0x7f8fc815e2a0 legacy=0x7f8fc80ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.409+0000 7f8fc659c640 1 -- 172.21.15.32:0/1862903602 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc815ee60 con 0x7f8fc815da60 2024-02-17T00:37:48.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fc659c640 1 --2- 172.21.15.32:0/1862903602 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815da60 0x7f8fc80d0aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00097d0 tx=0x7f8fc002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203b047c045b6434 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0031800 con 0x7f8fc815da60 2024-02-17T00:37:48.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0031960 con 0x7f8fc815da60 2024-02-17T00:37:48.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fc559a640 1 -- 172.21.15.32:0/1862903602 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0031cf0 con 0x7f8fc815da60 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 -- 172.21.15.32:0/1862903602 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815da60 msgr2=0x7f8fc80d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 --2- 172.21.15.32:0/1862903602 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815da60 0x7f8fc80d0aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00097d0 tx=0x7f8fc002b8a0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 -- 172.21.15.32:0/1862903602 shutdown_connections 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 --2- 172.21.15.32:0/1862903602 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815da60 0x7f8fc80d0aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 -- 172.21.15.32:0/1862903602 >> 172.21.15.32:0/1862903602 conn(0x7f8fc806bfe0 msgr2=0x7f8fc806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 -- 172.21.15.32:0/1862903602 shutdown_connections 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.410+0000 7f8fcc956640 1 -- 172.21.15.32:0/1862903602 wait complete. 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 Processor -- start 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 -- start start 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc815da60 0x7f8fc80c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815de40 0x7f8fc8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 0x7f8fc8153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80b4e80 con 0x7f8fc815e2a0 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80b5120 con 0x7f8fc815da60 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fcc956640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80b5400 con 0x7f8fc815de40 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fc6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 0x7f8fc8153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fc6d9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 0x7f8fc8153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38222/0 (socket says 172.21.15.32:38222) 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.412+0000 7f8fc6d9d640 1 -- 172.21.15.32:0/309190149 learned_addr learned my addr 172.21.15.32:0/309190149 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc5d9b640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815de40 0x7f8fc8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc659c640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc815da60 0x7f8fc80c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc6d9d640 1 -- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815de40 msgr2=0x7f8fc8157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc6d9d640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815de40 0x7f8fc8157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc6d9d640 1 -- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc815da60 msgr2=0x7f8fc80c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc6d9d640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc815da60 0x7f8fc80c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc6d9d640 1 -- 172.21.15.32:0/309190149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0009400 con 0x7f8fc815e2a0 2024-02-17T00:37:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc5d9b640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815de40 0x7f8fc8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fc6d9d640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 0x7f8fc8153d10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cb10 tx=0x7f8fb800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800ac70 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb800add0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc8162600 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8012600 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.413+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc80b59c0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.414+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc80680c0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.415+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8fb8007070 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.415+0000 7f8fbeffd640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fa806b810 0x7f8fa806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.415+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8fb8089f10 con 0x7f8fc815e2a0 2024-02-17T00:37:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.415+0000 7f8fc659c640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fa806b810 0x7f8fa806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.416+0000 7f8fc659c640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fa806b810 0x7f8fa806dcd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0036000 tx=0x7f8fc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.419+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8fb8054b20 con 0x7f8fc815e2a0 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.602+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8fc80b5bb0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.602+0000 7f8fbeffd640 1 -- 172.21.15.32:0/309190149 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8fb80581e0 con 0x7f8fc815e2a0 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-02-17T00:37:48.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-02-17T00:37:48.606 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fa806b810 msgr2=0x7f8fa806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fa806b810 0x7f8fa806dcd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0036000 tx=0x7f8fc0008030 comp rx=0 tx=0).stop 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 msgr2=0x7f8fc8153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 0x7f8fc8153d10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cb10 tx=0x7f8fb800a060 comp rx=0 tx=0).stop 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 shutdown_connections 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc815e2a0 0x7f8fc8153d10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f8fa806b810 0x7f8fa806dcd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8fc815de40 0x7f8fc8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 --2- 172.21.15.32:0/309190149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc815da60 0x7f8fc80c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 >> 172.21.15.32:0/309190149 conn(0x7f8fc806bfe0 msgr2=0x7f8fc80b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 shutdown_connections 2024-02-17T00:37:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.604+0000 7f8fcc956640 1 -- 172.21.15.32:0/309190149 wait complete. 2024-02-17T00:37:48.617 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T00:37:48.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T00:37:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.720+0000 7f3e428df640 1 Processor -- start 2024-02-17T00:37:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.720+0000 7f3e428df640 1 -- start start 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e428df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e428df640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e3c0cfe60 0x7f3e3c0cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e428df640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0d05b0 con 0x7f3e3c0999f0 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e428df640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c06cc50 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e428df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c06cf30 con 0x7f3e3c0cd620 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e3c0cfe60 0x7f3e3c0cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e3c0cfe60 0x7f3e3c0cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38226/0 (socket says 172.21.15.32:38226) 2024-02-17T00:37:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 -- 172.21.15.32:0/177691083 learned_addr learned my addr 172.21.15.32:0/177691083 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e3bfff640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 -- 172.21.15.32:0/177691083 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 msgr2=0x7f3e3c06c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c06c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 -- 172.21.15.32:0/177691083 >> v1:172.21.15.32:6789/0 conn(0x7f3e3c0999f0 legacy=0x7f3e3c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e40e7c640 1 -- 172.21.15.32:0/177691083 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c06d210 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.721+0000 7f3e3bfff640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c06c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.722+0000 7f3e40e7c640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c0cbc90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e50 tx=0x7f3e3402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb78ca6440dbf4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.722+0000 7f3e3affd640 1 -- 172.21.15.32:0/177691083 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3402cb00 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.722+0000 7f3e3affd640 1 -- 172.21.15.32:0/177691083 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3402cc60 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.722+0000 7f3e3affd640 1 -- 172.21.15.32:0/177691083 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340343f0 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 -- 172.21.15.32:0/177691083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 msgr2=0x7f3e3c0cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c0cbc90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e50 tx=0x7f3e3402bf60 comp rx=0 tx=0).stop 2024-02-17T00:37:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 -- 172.21.15.32:0/177691083 shutdown_connections 2024-02-17T00:37:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c0cbc90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 --2- 172.21.15.32:0/177691083 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c06c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 -- 172.21.15.32:0/177691083 >> 172.21.15.32:0/177691083 conn(0x7f3e3c0b3130 msgr2=0x7f3e3c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 -- 172.21.15.32:0/177691083 shutdown_connections 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.723+0000 7f3e428df640 1 -- 172.21.15.32:0/177691083 wait complete. 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.724+0000 7f3e428df640 1 Processor -- start 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.724+0000 7f3e428df640 1 -- start start 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e428df640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e3c0999f0 0x7f3e3c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e428df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e428df640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c1f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e428df640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0aef10 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e428df640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b0210 con 0x7f3e3c0999f0 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e428df640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0af170 con 0x7f3e3c0cd620 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c1f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c1f34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38236/0 (socket says 172.21.15.32:38236) 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 -- 172.21.15.32:0/474489726 learned_addr learned my addr 172.21.15.32:0/474489726 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e3b7fe640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e3bfff640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e3c0999f0 0x7f3e3c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 -- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 msgr2=0x7f3e3c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c0ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 -- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e3c0999f0 msgr2=0x7f3e3c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e3c0999f0 0x7f3e3c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.725+0000 7f3e40e7c640 1 -- 172.21.15.32:0/474489726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009b30 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.726+0000 7f3e40e7c640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c1f34f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e50 tx=0x7f3e34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.726+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34040670 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.726+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340407d0 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.726+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0af450 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.726+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34040b80 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.726+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0afa10 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.727+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c0cf540 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.727+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3e34040ce0 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.728+0000 7f3e38ff9640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3e1c06b810 0x7f3e1c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.728+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3e340acf70 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.728+0000 7f3e3bfff640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3e1c06b810 0x7f3e1c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.729+0000 7f3e3bfff640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3e1c06b810 0x7f3e1c06dcd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c09f2d0 tx=0x7f3e2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:48.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.732+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e340e08c0 con 0x7f3e3c0cfe60 2024-02-17T00:37:48.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:48.914+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e3c069040 con 0x7f3e3c0cfe60 2024-02-17T00:37:49.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.680+0000 7f3e38ff9640 1 -- 172.21.15.32:0/474489726 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3e34077c00 con 0x7f3e3c0cfe60 2024-02-17T00:37:49.683 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3e1c06b810 msgr2=0x7f3e1c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3e1c06b810 0x7f3e1c06dcd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c09f2d0 tx=0x7f3e2c008040 comp rx=0 tx=0).stop 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 msgr2=0x7f3e3c1f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c1f34f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e50 tx=0x7f3e34004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 shutdown_connections 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3c0cfe60 0x7f3e3c1f34f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3e1c06b810 0x7f3e1c06dcd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3e3c0cd620 0x7f3e3c0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 --2- 172.21.15.32:0/474489726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e3c0999f0 0x7f3e3c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 >> 172.21.15.32:0/474489726 conn(0x7f3e3c0b3130 msgr2=0x7f3e3c0b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:49.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 shutdown_connections 2024-02-17T00:37:49.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.683+0000 7f3e428df640 1 -- 172.21.15.32:0/474489726 wait complete. 2024-02-17T00:37:49.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T00:37:49.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.813+0000 7f5f776f4640 1 Processor -- start 2024-02-17T00:37:49.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.813+0000 7f5f776f4640 1 -- start start 2024-02-17T00:37:49.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f776f4640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5f7015da60 0x7f5f700d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f776f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f776f4640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7015e8a0 con 0x7f5f7015de40 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f776f4640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f70161640 con 0x7f5f7015da60 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f776f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7015eb80 con 0x7f5f7015e2d0 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f75490640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5f7015da60 0x7f5f700d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f75490640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5f7015da60 0x7f5f700d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38242/0 (socket says 172.21.15.32:38242) 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.814+0000 7f5f75490640 1 -- 172.21.15.32:0/3345683622 learned_addr learned my addr 172.21.15.32:0/3345683622 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.815+0000 7f5f75c91640 1 --2- 172.21.15.32:0/3345683622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.815+0000 7f5f75490640 1 -- 172.21.15.32:0/3345683622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 msgr2=0x7f5f700ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.815+0000 7f5f75490640 1 --2- 172.21.15.32:0/3345683622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.815+0000 7f5f75490640 1 -- 172.21.15.32:0/3345683622 >> v1:172.21.15.32:6789/0 conn(0x7f5f7015de40 legacy=0x7f5f70161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.815+0000 7f5f75490640 1 -- 172.21.15.32:0/3345683622 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7015ee60 con 0x7f5f7015da60 2024-02-17T00:37:49.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f75490640 1 --2- 172.21.15.32:0/3345683622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700d0aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009870 tx=0x7f5f6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232a370bc45f7331 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f67fff640 1 -- 172.21.15.32:0/3345683622 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c031640 con 0x7f5f7015da60 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f67fff640 1 -- 172.21.15.32:0/3345683622 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c0317a0 con 0x7f5f7015da60 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f67fff640 1 -- 172.21.15.32:0/3345683622 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c031b30 con 0x7f5f7015da60 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 -- 172.21.15.32:0/3345683622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 msgr2=0x7f5f700d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 --2- 172.21.15.32:0/3345683622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700d0aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009870 tx=0x7f5f6c02b8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 -- 172.21.15.32:0/3345683622 shutdown_connections 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 --2- 172.21.15.32:0/3345683622 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 --2- 172.21.15.32:0/3345683622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700d0aa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 -- 172.21.15.32:0/3345683622 >> 172.21.15.32:0/3345683622 conn(0x7f5f7006bfe0 msgr2=0x7f5f7006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 -- 172.21.15.32:0/3345683622 shutdown_connections 2024-02-17T00:37:49.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.816+0000 7f5f776f4640 1 -- 172.21.15.32:0/3345683622 wait complete. 2024-02-17T00:37:49.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.817+0000 7f5f776f4640 1 Processor -- start 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 -- start start 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7015de40 0x7f5f700b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700cc3f0 con 0x7f5f7015da60 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700cc6d0 con 0x7f5f7015de40 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f776f4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700cc9b0 con 0x7f5f7015e2d0 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f75490640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f75490640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38254/0 (socket says 172.21.15.32:38254) 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.818+0000 7f5f75490640 1 -- 172.21.15.32:0/1878443686 learned_addr learned my addr 172.21.15.32:0/1878443686 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75c91640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f74c8f640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7015de40 0x7f5f700b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75490640 1 -- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 msgr2=0x7f5f700b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:49.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75490640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75490640 1 -- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7015de40 msgr2=0x7f5f700b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75490640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7015de40 0x7f5f700b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75490640 1 -- 172.21.15.32:0/1878443686 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0094d0 con 0x7f5f7015da60 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f75490640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700cd490 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000c00 tx=0x7f5f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c03a930 con 0x7f5f7015da60 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c03aa90 con 0x7f5f7015da60 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f70162600 con 0x7f5f7015da60 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c03ae40 con 0x7f5f7015da60 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.819+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f700aa470 con 0x7f5f7015da60 2024-02-17T00:37:49.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.820+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f700cd2e0 con 0x7f5f7015da60 2024-02-17T00:37:49.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.821+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5f6c02f050 con 0x7f5f7015da60 2024-02-17T00:37:49.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.821+0000 7f5f65ffb640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5f5406b810 0x7f5f5406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:49.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.821+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f5f6c0abfe0 con 0x7f5f7015da60 2024-02-17T00:37:49.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.821+0000 7f5f74c8f640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5f5406b810 0x7f5f5406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:49.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.822+0000 7f5f74c8f640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5f5406b810 0x7f5f5406dcd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f60007fd0 tx=0x7f5f60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:49.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:49.826+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f6c0769f0 con 0x7f5f7015da60 2024-02-17T00:37:50.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.004+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5f700680c0 con 0x7f5f7015da60 2024-02-17T00:37:50.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.685+0000 7f5f65ffb640 1 -- 172.21.15.32:0/1878443686 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5f6c07a0b0 con 0x7f5f7015da60 2024-02-17T00:37:50.688 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-02-17T00:37:50.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5f5406b810 msgr2=0x7f5f5406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:50.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5f5406b810 0x7f5f5406dcd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f60007fd0 tx=0x7f5f60009040 comp rx=0 tx=0).stop 2024-02-17T00:37:50.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 msgr2=0x7f5f700cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:50.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700cd490 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000c00 tx=0x7f5f6c0046c0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 shutdown_connections 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f5f5406b810 0x7f5f5406dcd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5f7015e2d0 0x7f5f700b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7015de40 0x7f5f700b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 --2- 172.21.15.32:0/1878443686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f7015da60 0x7f5f700cd490 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 >> 172.21.15.32:0/1878443686 conn(0x7f5f7006bfe0 msgr2=0x7f5f700d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 shutdown_connections 2024-02-17T00:37:50.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.687+0000 7f5f776f4640 1 -- 172.21.15.32:0/1878443686 wait complete. 2024-02-17T00:37:50.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T00:37:50.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.821+0000 7fc217756640 1 Processor -- start 2024-02-17T00:37:50.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.821+0000 7fc217756640 1 -- start start 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc217756640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc210143fb0 0x7fc2100b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc217756640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100b2ee0 con 0x7fc21006e240 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc217756640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100b3150 con 0x7fc2100ced20 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc217756640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100b4750 con 0x7fc210143fb0 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc2154f2640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc210143fb0 0x7fc2100b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc2154f2640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc210143fb0 0x7fc2100b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38258/0 (socket says 172.21.15.32:38258) 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc2154f2640 1 -- 172.21.15.32:0/1490331479 learned_addr learned my addr 172.21.15.32:0/1490331479 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:50.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc2154f2640 1 -- 172.21.15.32:0/1490331479 >> v1:172.21.15.39:6789/0 conn(0x7fc2100ced20 legacy=0x7fc21015ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:50.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc2154f2640 1 -- 172.21.15.32:0/1490331479 >> v1:172.21.15.32:6789/0 conn(0x7fc21006e240 legacy=0x7fc2100ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:50.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.822+0000 7fc2154f2640 1 -- 172.21.15.32:0/1490331479 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100b3430 con 0x7fc210143fb0 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.823+0000 7fc2154f2640 1 --2- 172.21.15.32:0/1490331479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc210143fb0 0x7fc2100b3c30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc200009870 tx=0x7fc20002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95202abd112d7624 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.823+0000 7fc207fff640 1 -- 172.21.15.32:0/1490331479 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200030860 con 0x7fc210143fb0 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.823+0000 7fc207fff640 1 -- 172.21.15.32:0/1490331479 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2000309c0 con 0x7fc210143fb0 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.823+0000 7fc207fff640 1 -- 172.21.15.32:0/1490331479 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200030d50 con 0x7fc210143fb0 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 -- 172.21.15.32:0/1490331479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc210143fb0 msgr2=0x7fc2100b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 --2- 172.21.15.32:0/1490331479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc210143fb0 0x7fc2100b3c30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc200009870 tx=0x7fc20002b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 -- 172.21.15.32:0/1490331479 shutdown_connections 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 --2- 172.21.15.32:0/1490331479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc210143fb0 0x7fc2100b3c30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 -- 172.21.15.32:0/1490331479 >> 172.21.15.32:0/1490331479 conn(0x7fc21006ab60 msgr2=0x7fc21006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:50.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 -- 172.21.15.32:0/1490331479 shutdown_connections 2024-02-17T00:37:50.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.824+0000 7fc217756640 1 -- 172.21.15.32:0/1490331479 wait complete. 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.825+0000 7fc217756640 1 Processor -- start 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.825+0000 7fc217756640 1 -- start start 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc217756640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc21006e240 0x7fc2101ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc217756640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 0x7fc2100ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc217756640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc210143fb0 0x7fc2100acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc217756640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2101f34b0 con 0x7fc2100ced20 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc217756640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100ad3d0 con 0x7fc210143fb0 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc217756640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100ad6b0 con 0x7fc21006e240 2024-02-17T00:37:50.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 0x7fc2100ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 0x7fc2100ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38260/0 (socket says 172.21.15.32:38260) 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 -- 172.21.15.32:0/2266748142 learned_addr learned my addr 172.21.15.32:0/2266748142 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc2154f2640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc21006e240 0x7fc2101ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc215cf3640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc210143fb0 0x7fc2100acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 -- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc21006e240 msgr2=0x7fc2101ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc21006e240 0x7fc2101ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 -- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc210143fb0 msgr2=0x7fc2100acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc210143fb0 0x7fc2100acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 -- 172.21.15.32:0/2266748142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000094d0 con 0x7fc2100ced20 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.826+0000 7fc214cf1640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 0x7fc2100ac860 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c400 tx=0x7fc20c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.827+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0052d0 con 0x7fc2100ced20 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.827+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c005450 con 0x7fc2100ced20 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.827+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2100ad990 con 0x7fc2100ced20 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.827+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c007260 con 0x7fc2100ced20 2024-02-17T00:37:50.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.827+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2101ed560 con 0x7fc2100ced20 2024-02-17T00:37:50.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.828+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2101e2cf0 con 0x7fc2100ced20 2024-02-17T00:37:50.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.828+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc20c0073c0 con 0x7fc2100ced20 2024-02-17T00:37:50.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.829+0000 7fc205ffb640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1f406b810 0x7fc1f406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:50.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.829+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fc20c089730 con 0x7fc2100ced20 2024-02-17T00:37:50.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.829+0000 7fc2154f2640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1f406b810 0x7fc1f406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:50.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.830+0000 7fc2154f2640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1f406b810 0x7fc1f406dcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc200036000 tx=0x7fc20003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:50.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:50.833+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2101e2cf0 con 0x7fc2100ced20 2024-02-17T00:37:51.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.051+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc2101e2cf0 con 0x7fc2100ced20 2024-02-17T00:37:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.686+0000 7fc205ffb640 1 -- 172.21.15.32:0/2266748142 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc2101e2cf0 con 0x7fc2100ced20 2024-02-17T00:37:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 5 and data pool 6 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1f406b810 msgr2=0x7fc1f406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1f406b810 0x7fc1f406dcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc200036000 tx=0x7fc20003b040 comp rx=0 tx=0).stop 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 msgr2=0x7fc2100ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 0x7fc2100ac860 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c400 tx=0x7fc20c00c8c0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 shutdown_connections 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc210143fb0 0x7fc2100acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2100ced20 0x7fc2100ac860 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc1f406b810 0x7fc1f406dcd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 --2- 172.21.15.32:0/2266748142 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc21006e240 0x7fc2101ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 >> 172.21.15.32:0/2266748142 conn(0x7fc21006ab60 msgr2=0x7fc2100cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 shutdown_connections 2024-02-17T00:37:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.690+0000 7fc217756640 1 -- 172.21.15.32:0/2266748142 wait complete. 2024-02-17T00:37:51.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:51.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.823+0000 7f81fba64640 1 Processor -- start 2024-02-17T00:37:51.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.823+0000 7f81fba64640 1 -- start start 2024-02-17T00:37:51.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81fba64640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81f4144100 0x7f81f40cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81fba64640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f40ced20 0x7f81f406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81fba64640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f81f406e7a0 0x7f81f415e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81fba64640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f406ec30 con 0x7f81f4144100 2024-02-17T00:37:51.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81fba64640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f41444e0 con 0x7f81f406e7a0 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81fba64640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f415ac70 con 0x7f81f40ced20 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81f9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81f4144100 0x7f81f40cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81f9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81f4144100 0x7f81f40cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38264/0 (socket says 172.21.15.32:38264) 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81f9800640 1 -- 172.21.15.32:0/1219192079 learned_addr learned my addr 172.21.15.32:0/1219192079 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.824+0000 7f81f8fff640 1 --2- 172.21.15.32:0/1219192079 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f40ced20 0x7f81f406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81fa001640 1 --2- 172.21.15.32:0/1219192079 >> v2:172.21.15.39:3300/0 conn(0x7f81f406e7a0 0x7f81f415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81f9800640 1 -- 172.21.15.32:0/1219192079 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f40ced20 msgr2=0x7f81f406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81f9800640 1 --2- 172.21.15.32:0/1219192079 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f40ced20 0x7f81f406e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81f9800640 1 -- 172.21.15.32:0/1219192079 >> v2:172.21.15.39:3300/0 conn(0x7f81f406e7a0 msgr2=0x7f81f415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81f9800640 1 --2- 172.21.15.32:0/1219192079 >> v2:172.21.15.39:3300/0 conn(0x7f81f406e7a0 0x7f81f415e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81f9800640 1 -- 172.21.15.32:0/1219192079 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40cdbf0 con 0x7f81f4144100 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.825+0000 7f81f9800640 1 --2- 172.21.15.32:0/1219192079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f4144100 0x7f81f40cd610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f81f40b1e10 tx=0x7f81f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f13c7567ae655c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81ebfff640 1 -- 172.21.15.32:0/1219192079 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f002ca70 con 0x7f81f4144100 2024-02-17T00:37:51.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81ebfff640 1 -- 172.21.15.32:0/1219192079 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f002cbd0 con 0x7f81f4144100 2024-02-17T00:37:51.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81ebfff640 1 -- 172.21.15.32:0/1219192079 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00343f0 con 0x7f81f4144100 2024-02-17T00:37:51.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 -- 172.21.15.32:0/1219192079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f4144100 msgr2=0x7f81f40cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 --2- 172.21.15.32:0/1219192079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f4144100 0x7f81f40cd610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f81f40b1e10 tx=0x7f81f002bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 -- 172.21.15.32:0/1219192079 shutdown_connections 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 --2- 172.21.15.32:0/1219192079 >> v2:172.21.15.39:3300/0 conn(0x7f81f406e7a0 0x7f81f415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 --2- 172.21.15.32:0/1219192079 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f40ced20 0x7f81f406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 --2- 172.21.15.32:0/1219192079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f4144100 0x7f81f40cd610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 -- 172.21.15.32:0/1219192079 >> 172.21.15.32:0/1219192079 conn(0x7f81f4071150 msgr2=0x7f81f4071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 -- 172.21.15.32:0/1219192079 shutdown_connections 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.826+0000 7f81fba64640 1 -- 172.21.15.32:0/1219192079 wait complete. 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 Processor -- start 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 -- start start 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f406e7a0 0x7f81f41593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 0x7f81f4141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81f4144100 0x7f81f41293e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4159920 con 0x7f81f40ced20 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f412c140 con 0x7f81f4144100 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81fba64640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4127560 con 0x7f81f406e7a0 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81f8fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 0x7f81f4141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81f8fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 0x7f81f4141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38274/0 (socket says 172.21.15.32:38274) 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.828+0000 7f81f8fff640 1 -- 172.21.15.32:0/2393100339 learned_addr learned my addr 172.21.15.32:0/2393100339 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f9800640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f406e7a0 0x7f81f41593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81fa001640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81f4144100 0x7f81f41293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f8fff640 1 -- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f406e7a0 msgr2=0x7f81f41593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f8fff640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f406e7a0 0x7f81f41593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f8fff640 1 -- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81f4144100 msgr2=0x7f81f41293e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f8fff640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81f4144100 0x7f81f41293e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f8fff640 1 -- 172.21.15.32:0/2393100339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0009b30 con 0x7f81f40ced20 2024-02-17T00:37:51.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81f8fff640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 0x7f81f4141140 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e870 tx=0x7f81e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:51.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40094f0 con 0x7f81f40ced20 2024-02-17T00:37:51.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e400c940 con 0x7f81f40ced20 2024-02-17T00:37:51.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f412c3b0 con 0x7f81f40ced20 2024-02-17T00:37:51.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400ccf0 con 0x7f81f40ced20 2024-02-17T00:37:51.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.829+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f412c970 con 0x7f81f40ced20 2024-02-17T00:37:51.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.830+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f4068fd0 con 0x7f81f40ced20 2024-02-17T00:37:51.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.831+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f81e4013470 con 0x7f81f40ced20 2024-02-17T00:37:51.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.831+0000 7f81e9ffb640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f81d806b810 0x7f81d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:51.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.831+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81e408a370 con 0x7f81f40ced20 2024-02-17T00:37:51.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.831+0000 7f81f9800640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f81d806b810 0x7f81d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:51.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.832+0000 7f81f9800640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f81d806b810 0x7f81d806dcd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f81f0035000 tx=0x7f81f0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:51.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:51.835+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81e4054c90 con 0x7f81f40ced20 2024-02-17T00:37:52.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.018+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81f415ba70 con 0x7f81f40ced20 2024-02-17T00:37:52.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.019+0000 7f81e9ffb640 1 -- 172.21.15.32:0/2393100339 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16907 (secure 0 0 0) 0x7f81e4058350 con 0x7f81f40ced20 2024-02-17T00:37:52.022 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:52.022 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:51.052659+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:37:48.933613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-02-17T00:37:50.024420+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:52.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f81d806b810 msgr2=0x7f81d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f81d806b810 0x7f81d806dcd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f81f0035000 tx=0x7f81f0030000 comp rx=0 tx=0).stop 2024-02-17T00:37:52.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 msgr2=0x7f81f4141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 0x7f81f4141140 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e870 tx=0x7f81e400ed30 comp rx=0 tx=0).stop 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 shutdown_connections 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81f4144100 0x7f81f41293e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81f40ced20 0x7f81f4141140 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f81d806b810 0x7f81d806dcd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 --2- 172.21.15.32:0/2393100339 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f81f406e7a0 0x7f81f41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 >> 172.21.15.32:0/2393100339 conn(0x7f81f4071150 msgr2=0x7f81f4142260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 shutdown_connections 2024-02-17T00:37:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.021+0000 7f81fba64640 1 -- 172.21.15.32:0/2393100339 wait complete. 2024-02-17T00:37:52.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:52.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.135+0000 7fbc46a15640 1 Processor -- start 2024-02-17T00:37:52.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.135+0000 7fbc46a15640 1 -- start start 2024-02-17T00:37:52.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.136+0000 7fbc46a15640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.136+0000 7fbc46a15640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc400ce2b0 0x7fbc400d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.136+0000 7fbc46a15640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400d1e80 con 0x7fbc400b53b0 2024-02-17T00:37:52.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.136+0000 7fbc46a15640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400b5930 con 0x7fbc400ce2b0 2024-02-17T00:37:52.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.136+0000 7fbc46a15640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400b5c10 con 0x7fbc4015db00 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc400ce2b0 0x7fbc400d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc400ce2b0 0x7fbc400d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45934/0 (socket says 172.21.15.32:45934) 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 -- 172.21.15.32:0/90349981 learned_addr learned my addr 172.21.15.32:0/90349981 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 -- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 msgr2=0x7fbc400d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 --2- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 -- 172.21.15.32:0/90349981 >> v1:172.21.15.39:6789/0 conn(0x7fbc400b53b0 legacy=0x7fbc40161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc44fb2640 1 -- 172.21.15.32:0/90349981 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400b5ef0 con 0x7fbc400ce2b0 2024-02-17T00:37:52.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.137+0000 7fbc3ffff640 1 --2- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:52.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.138+0000 7fbc44fb2640 1 --2- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc400d0880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc3802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31e704fba48e095 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.138+0000 7fbc3effd640 1 -- 172.21.15.32:0/90349981 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3802cb00 con 0x7fbc400ce2b0 2024-02-17T00:37:52.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.138+0000 7fbc3effd640 1 -- 172.21.15.32:0/90349981 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3802cc60 con 0x7fbc400ce2b0 2024-02-17T00:37:52.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.138+0000 7fbc3effd640 1 -- 172.21.15.32:0/90349981 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380343f0 con 0x7fbc400ce2b0 2024-02-17T00:37:52.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 -- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 msgr2=0x7fbc400d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 --2- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc400d0880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc3802bf60 comp rx=0 tx=0).stop 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 -- 172.21.15.32:0/90349981 shutdown_connections 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 --2- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc400d0880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 --2- 172.21.15.32:0/90349981 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 -- 172.21.15.32:0/90349981 >> 172.21.15.32:0/90349981 conn(0x7fbc40072290 msgr2=0x7fbc400726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 -- 172.21.15.32:0/90349981 shutdown_connections 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.139+0000 7fbc46a15640 1 -- 172.21.15.32:0/90349981 wait complete. 2024-02-17T00:37:52.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.140+0000 7fbc46a15640 1 Processor -- start 2024-02-17T00:37:52.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.140+0000 7fbc46a15640 1 -- start start 2024-02-17T00:37:52.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 0x7fbc4015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc4015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400cd560 con 0x7fbc400b53b0 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401f4200 con 0x7fbc400ce2b0 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401f44e0 con 0x7fbc4015db00 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 0x7fbc4015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 0x7fbc4015bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38280/0 (socket says 172.21.15.32:38280) 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 -- 172.21.15.32:0/1987164592 learned_addr learned my addr 172.21.15.32:0/1987164592 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc44fb2640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3f7fe640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc4015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 -- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 msgr2=0x7fbc400b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 -- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 msgr2=0x7fbc4015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc4015c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 -- 172.21.15.32:0/1987164592 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30009400 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc44fb2640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3f7fe640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc4015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3ffff640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 0x7fbc4015bdf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000e960 tx=0x7fbc3000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000ca00 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3000cb60 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30013470 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.141+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc38009b30 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.142+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4015f250 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.143+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc40068fd0 con 0x7fbc400b53b0 2024-02-17T00:37:52.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.143+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbc300135d0 con 0x7fbc400b53b0 2024-02-17T00:37:52.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.143+0000 7fbc3cff9640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc2c06b810 0x7fbc2c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.143+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbc3008a5a0 con 0x7fbc400b53b0 2024-02-17T00:37:52.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.144+0000 7fbc3f7fe640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc2c06b810 0x7fbc2c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.144+0000 7fbc3f7fe640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc2c06b810 0x7fbc2c06dcd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc400b9240 tx=0x7fbc34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.148+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc30054e30 con 0x7fbc400b53b0 2024-02-17T00:37:52.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.332+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc400d3630 con 0x7fbc400b53b0 2024-02-17T00:37:52.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.333+0000 7fbc3cff9640 1 -- 172.21.15.32:0/1987164592 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16907 (secure 0 0 0) 0x7fbc300584f0 con 0x7fbc400b53b0 2024-02-17T00:37:52.336 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:52.336 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:51.052659+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:37:48.933613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-02-17T00:37:50.024420+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:52.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc2c06b810 msgr2=0x7fbc2c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc2c06b810 0x7fbc2c06dcd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc400b9240 tx=0x7fbc34009040 comp rx=0 tx=0).stop 2024-02-17T00:37:52.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 msgr2=0x7fbc4015bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 0x7fbc4015bdf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000e960 tx=0x7fbc3000ee20 comp rx=0 tx=0).stop 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 shutdown_connections 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fbc2c06b810 0x7fbc2c06dcd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbc4015db00 0x7fbc400b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc400ce2b0 0x7fbc4015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 --2- 172.21.15.32:0/1987164592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc400b53b0 0x7fbc4015bdf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 >> 172.21.15.32:0/1987164592 conn(0x7fbc40072290 msgr2=0x7fbc400d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 shutdown_connections 2024-02-17T00:37:52.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.335+0000 7fbc46a15640 1 -- 172.21.15.32:0/1987164592 wait complete. 2024-02-17T00:37:52.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T00:37:52.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.451+0000 7fc7f682a640 1 Processor -- start 2024-02-17T00:37:52.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.451+0000 7fc7f682a640 1 -- start start 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f682a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00d0780 0x7fc7f00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f682a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7f00b9590 0x7fc7f00b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f682a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00d10a0 con 0x7fc7f00b9130 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f682a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00b7ef0 con 0x7fc7f00b9590 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f682a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00b81d0 con 0x7fc7f00d0780 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f4dc7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7f00b9590 0x7fc7f00b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7effff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00d0780 0x7fc7f00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7ef7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc7f00b9130 0x7fc7f00d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.32:44946/0 (socket says 172.21.15.32:44946) 2024-02-17T00:37:52.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f4dc7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7f00b9590 0x7fc7f00b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:45966/0 (socket says 172.21.15.32:45966) 2024-02-17T00:37:52.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7ef7fe640 1 -- 172.21.15.32:0/2381060294 learned_addr learned my addr 172.21.15.32:0/2381060294 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:52.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f4dc7640 1 -- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00d0780 msgr2=0x7fc7f00d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:52.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f4dc7640 1 --2- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00d0780 0x7fc7f00d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f4dc7640 1 -- 172.21.15.32:0/2381060294 >> v1:172.21.15.39:6789/0 conn(0x7fc7f00b9130 legacy=0x7fc7f00d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.452+0000 7fc7f4dc7640 1 -- 172.21.15.32:0/2381060294 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00b84b0 con 0x7fc7f00b9590 2024-02-17T00:37:52.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.453+0000 7fc7f4dc7640 1 --2- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00b9590 0x7fc7f00b78c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009d90 tx=0x7fc7e802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb2634f2865d867 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.453+0000 7fc7eeffd640 1 -- 172.21.15.32:0/2381060294 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e802cc50 con 0x7fc7f00b9590 2024-02-17T00:37:52.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.453+0000 7fc7eeffd640 1 -- 172.21.15.32:0/2381060294 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e802cdb0 con 0x7fc7f00b9590 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.453+0000 7fc7eeffd640 1 -- 172.21.15.32:0/2381060294 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8034660 con 0x7fc7f00b9590 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 -- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00b9590 msgr2=0x7fc7f00b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 --2- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00b9590 0x7fc7f00b78c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009d90 tx=0x7fc7e802bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 -- 172.21.15.32:0/2381060294 shutdown_connections 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 --2- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00b9590 0x7fc7f00b78c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 --2- 172.21.15.32:0/2381060294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00d0780 0x7fc7f00d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 -- 172.21.15.32:0/2381060294 >> 172.21.15.32:0/2381060294 conn(0x7fc7f00726b0 msgr2=0x7fc7f0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 -- 172.21.15.32:0/2381060294 shutdown_connections 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.454+0000 7fc7f682a640 1 -- 172.21.15.32:0/2381060294 wait complete. 2024-02-17T00:37:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.455+0000 7fc7f682a640 1 Processor -- start 2024-02-17T00:37:52.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.455+0000 7fc7f682a640 1 -- start start 2024-02-17T00:37:52.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f682a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 0x7fc7f014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f682a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00b9590 0x7fc7f00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f682a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00d0780 0x7fc7f00c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f682a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f015b3e0 con 0x7fc7f00b9130 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f682a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f01502c0 con 0x7fc7f00d0780 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f682a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f015b680 con 0x7fc7f00b9590 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 0x7fc7f014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 0x7fc7f014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38294/0 (socket says 172.21.15.32:38294) 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 -- 172.21.15.32:0/648565831 learned_addr learned my addr 172.21.15.32:0/648565831 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7f4dc7640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00d0780 0x7fc7f00c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7ef7fe640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00b9590 0x7fc7f00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 -- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00b9590 msgr2=0x7fc7f00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00b9590 0x7fc7f00c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 -- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00d0780 msgr2=0x7fc7f00c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00d0780 0x7fc7f00c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.456+0000 7fc7effff640 1 -- 172.21.15.32:0/648565831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009a70 con 0x7fc7f00b9130 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.457+0000 7fc7effff640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 0x7fc7f014fd80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000e870 tx=0x7fc7e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.457+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00094f0 con 0x7fc7f00b9130 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.457+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e000c940 con 0x7fc7f00b9130 2024-02-17T00:37:52.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.457+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f015b960 con 0x7fc7f00b9130 2024-02-17T00:37:52.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.457+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000ccf0 con 0x7fc7f00b9130 2024-02-17T00:37:52.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.457+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f015bf20 con 0x7fc7f00b9130 2024-02-17T00:37:52.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.458+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f00685d0 con 0x7fc7f00b9130 2024-02-17T00:37:52.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.458+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc7e0013470 con 0x7fc7f00b9130 2024-02-17T00:37:52.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.459+0000 7fc7ecff9640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc7dc06b810 0x7fc7dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.459+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc7e008a380 con 0x7fc7f00b9130 2024-02-17T00:37:52.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.459+0000 7fc7ef7fe640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc7dc06b810 0x7fc7dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.459+0000 7fc7ef7fe640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc7dc06b810 0x7fc7dc06dcd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00cf560 tx=0x7fc7e4007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.463+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7e0054cc0 con 0x7fc7f00b9130 2024-02-17T00:37:52.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.685+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc7f0068f60 con 0x7fc7f00b9130 2024-02-17T00:37:52.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.702+0000 7fc7ecff9640 1 -- 172.21.15.32:0/648565831 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc7e0058380 con 0x7fc7f00b9130 2024-02-17T00:37:52.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc7dc06b810 msgr2=0x7fc7dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc7dc06b810 0x7fc7dc06dcd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00cf560 tx=0x7fc7e4007e80 comp rx=0 tx=0).stop 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 msgr2=0x7fc7f014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 0x7fc7f014fd80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000e870 tx=0x7fc7e000ed30 comp rx=0 tx=0).stop 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 shutdown_connections 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00d0780 0x7fc7f00c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc7dc06b810 0x7fc7dc06dcd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc7f00b9590 0x7fc7f00c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 --2- 172.21.15.32:0/648565831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b9130 0x7fc7f014fd80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 >> 172.21.15.32:0/648565831 conn(0x7fc7f00726b0 msgr2=0x7fc7f00b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 shutdown_connections 2024-02-17T00:37:52.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.705+0000 7fc7f682a640 1 -- 172.21.15.32:0/648565831 wait complete. 2024-02-17T00:37:52.718 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T00:37:52.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T00:37:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.820+0000 7fc27c325640 1 Processor -- start 2024-02-17T00:37:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.820+0000 7fc27c325640 1 -- start start 2024-02-17T00:37:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27c325640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2740d0a00 0x7fc27409a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27c325640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2740cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27c325640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2741615e0 con 0x7fc274161200 2024-02-17T00:37:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27c325640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27406c9f0 con 0x7fc2740d0a00 2024-02-17T00:37:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27c325640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27406ccd0 con 0x7fc27409a7d0 2024-02-17T00:37:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27a0c1640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc274161200 0x7fc2740cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:32844/0 (socket says 172.21.15.32:32844) 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27a0c1640 1 -- 172.21.15.32:0/3288271752 learned_addr learned my addr 172.21.15.32:0/3288271752 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115563352 0 0) 0x7fc2741615e0 con 0x7fc274161200 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2798c0640 1 --2- 172.21.15.32:0/3288271752 >> v2:172.21.15.39:3300/0 conn(0x7fc2740d0a00 0x7fc27409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc260003520 con 0x7fc274161200 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc27a8c2640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2740cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934889244 0 0) 0x7fc260003520 con 0x7fc274161200 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 msgr2=0x7fc2740cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2740cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 >> v2:172.21.15.39:3300/0 conn(0x7fc2740d0a00 msgr2=0x7fc27409a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 --2- 172.21.15.32:0/3288271752 >> v2:172.21.15.39:3300/0 conn(0x7fc2740d0a00 0x7fc27409a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274099a90 con 0x7fc274161200 2024-02-17T00:37:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fc270001670 con 0x7fc274161200 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.821+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 >> v1:172.21.15.32:6789/0 conn(0x7fc274161200 legacy=0x7fc2740cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2790bf640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc260003970 0x7fc260003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2790bf640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2790bf640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc260004d00 0x7fc260005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27406c9f0 con 0x7fc260003970 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27406ccd0 con 0x7fc260004d00 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26000b980 con 0x7fc27409a7d0 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc260003970 0x7fc260003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2798c0640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a8c2640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc260004d00 0x7fc260005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a0c1640 1 -- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 msgr2=0x7fc2600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a0c1640 1 -- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc260004d00 msgr2=0x7fc260005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc260004d00 0x7fc260005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc27a0c1640 1 -- 172.21.15.32:0/3288271752 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260003520 con 0x7fc260003970 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.822+0000 7fc2798c0640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc27409a7d0 0x7fc2600047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc260003970 0x7fc260003d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c290 tx=0x7fc2600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b57fc95edb129a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270005ad0 con 0x7fc260003970 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc270005c30 con 0x7fc260003970 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc2790bf640 1 -- 172.21.15.32:0/3288271752 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27002c8d0 con 0x7fc260003970 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27c325640 1 -- 172.21.15.32:0/3288271752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc260003970 msgr2=0x7fc260003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27c325640 1 --2- 172.21.15.32:0/3288271752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc260003970 0x7fc260003d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c290 tx=0x7fc2600057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27a8c2640 1 -- 172.21.15.32:0/3288271752 reap_dead start 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27c325640 1 -- 172.21.15.32:0/3288271752 shutdown_connections 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27c325640 1 -- 172.21.15.32:0/3288271752 >> 172.21.15.32:0/3288271752 conn(0x7fc2740b31a0 msgr2=0x7fc2740b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27c325640 1 -- 172.21.15.32:0/3288271752 shutdown_connections 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.823+0000 7fc27c325640 1 -- 172.21.15.32:0/3288271752 wait complete. 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 Processor -- start 2024-02-17T00:37:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 -- start start 2024-02-17T00:37:52.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc260003970 0x7fc274156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 0x7fc27406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2740ae820 0x7fc274070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274157400 con 0x7fc2740ae3a0 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b0b30 con 0x7fc2740ae820 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27c325640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b12f0 con 0x7fc260003970 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc2798c0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 0x7fc27406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc2798c0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 0x7fc27406fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38300/0 (socket says 172.21.15.32:38300) 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc2798c0640 1 -- 172.21.15.32:0/2889544782 learned_addr learned my addr 172.21.15.32:0/2889544782 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.825+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc260003970 0x7fc274156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc27a8c2640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2740ae820 0x7fc274070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc2798c0640 1 -- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc260003970 msgr2=0x7fc274156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc2798c0640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc260003970 0x7fc274156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc2798c0640 1 -- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2740ae820 msgr2=0x7fc274070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc2798c0640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2740ae820 0x7fc274070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc2798c0640 1 -- 172.21.15.32:0/2889544782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27415d560 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc27a8c2640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2740ae820 0x7fc274070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc2798c0640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 0x7fc27406fde0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc264011560 tx=0x7fc264011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264015870 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2640159d0 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27415d840 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264015d60 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.826+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27415db20 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.827+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2740680c0 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.827+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc26400f460 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.828+0000 7fc26affd640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc25806b810 0x7fc25806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.828+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc26408a930 con 0x7fc2740ae3a0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.828+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc25806b810 0x7fc25806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.828+0000 7fc27a0c1640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc25806b810 0x7fc25806dcd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc270034000 tx=0x7fc270007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:52.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:52.832+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc264055250 con 0x7fc2740ae3a0 2024-02-17T00:37:53.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.051+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc274068f60 con 0x7fc2740ae3a0 2024-02-17T00:37:53.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.710+0000 7fc26affd640 1 -- 172.21.15.32:0/2889544782 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc264058910 con 0x7fc2740ae3a0 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc25806b810 msgr2=0x7fc25806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc25806b810 0x7fc25806dcd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc270034000 tx=0x7fc270007000 comp rx=0 tx=0).stop 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 msgr2=0x7fc27406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 0x7fc27406fde0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc264011560 tx=0x7fc264011a20 comp rx=0 tx=0).stop 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 shutdown_connections 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2740ae820 0x7fc274070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2740ae3a0 0x7fc27406fde0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc25806b810 0x7fc25806dcd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 --2- 172.21.15.32:0/2889544782 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc260003970 0x7fc274156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 >> 172.21.15.32:0/2889544782 conn(0x7fc2740b31a0 msgr2=0x7fc274161fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 shutdown_connections 2024-02-17T00:37:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.713+0000 7fc27c325640 1 -- 172.21.15.32:0/2889544782 wait complete. 2024-02-17T00:37:53.728 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T00:37:53.729 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:53.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.832+0000 7f4c77c9a640 1 Processor -- start 2024-02-17T00:37:53.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.832+0000 7f4c77c9a640 1 -- start start 2024-02-17T00:37:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c77c9a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c7015da50 0x7f4c700cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c77c9a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c7015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c77c9a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c700ce2b0 con 0x7f4c7015de30 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c77c9a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7015ef20 con 0x7f4c7015da50 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c77c9a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7015e960 con 0x7f4c700d0990 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c75a36640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c7015da50 0x7f4c700cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c75a36640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c7015da50 0x7f4c700cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42148/0 (socket says 172.21.15.32:42148) 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.833+0000 7f4c75a36640 1 -- 172.21.15.32:0/1533608031 learned_addr learned my addr 172.21.15.32:0/1533608031 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.834+0000 7f4c75a36640 1 -- 172.21.15.32:0/1533608031 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 msgr2=0x7f4c7015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.834+0000 7f4c75a36640 1 --2- 172.21.15.32:0/1533608031 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c7015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.834+0000 7f4c75a36640 1 -- 172.21.15.32:0/1533608031 >> v1:172.21.15.39:6789/0 conn(0x7f4c7015de30 legacy=0x7f4c700d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.834+0000 7f4c75a36640 1 -- 172.21.15.32:0/1533608031 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7015ec40 con 0x7f4c7015da50 2024-02-17T00:37:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.834+0000 7f4c75a36640 1 --2- 172.21.15.32:0/1533608031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015da50 0x7f4c700cea90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca46a31c9de61bb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c74a34640 1 -- 172.21.15.32:0/1533608031 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68031870 con 0x7f4c7015da50 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c74a34640 1 -- 172.21.15.32:0/1533608031 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c680319d0 con 0x7f4c7015da50 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c74a34640 1 -- 172.21.15.32:0/1533608031 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68031d60 con 0x7f4c7015da50 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 -- 172.21.15.32:0/1533608031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015da50 msgr2=0x7f4c700cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/1533608031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015da50 0x7f4c700cea90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6802b910 comp rx=0 tx=0).stop 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 -- 172.21.15.32:0/1533608031 shutdown_connections 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/1533608031 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c7015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/1533608031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015da50 0x7f4c700cea90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 -- 172.21.15.32:0/1533608031 >> 172.21.15.32:0/1533608031 conn(0x7f4c70072290 msgr2=0x7f4c70072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 -- 172.21.15.32:0/1533608031 shutdown_connections 2024-02-17T00:37:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.835+0000 7f4c77c9a640 1 -- 172.21.15.32:0/1533608031 wait complete. 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.836+0000 7f4c77c9a640 1 Processor -- start 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.836+0000 7f4c77c9a640 1 -- start start 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c77c9a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c701f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c77c9a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7015da50 0x7f4c70144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c77c9a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 0x7f4c70144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c77c9a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70158620 con 0x7f4c7015de30 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c77c9a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70157a10 con 0x7f4c7015da50 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c77c9a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70157cf0 con 0x7f4c700d0990 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 0x7f4c70144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 0x7f4c70144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42152/0 (socket says 172.21.15.32:42152) 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 -- 172.21.15.32:0/204887658 learned_addr learned my addr 172.21.15.32:0/204887658 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c75a36640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c701f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:53.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c75235640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7015da50 0x7f4c70144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 -- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 msgr2=0x7f4c701f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c701f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 -- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7015da50 msgr2=0x7f4c70144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.837+0000 7f4c76237640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7015da50 0x7f4c70144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c76237640 1 -- 172.21.15.32:0/204887658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680094d0 con 0x7f4c7015de30 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c76237640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 0x7f4c70144d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000b9e0 tx=0x7f4c6000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000cb20 con 0x7f4c7015de30 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000cca0 con 0x7f4c7015de30 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c70157fd0 con 0x7f4c7015de30 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60014680 con 0x7f4c7015de30 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.838+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c701576c0 con 0x7f4c7015de30 2024-02-17T00:37:53.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.839+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c700d1610 con 0x7f4c7015de30 2024-02-17T00:37:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.840+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4c6001d3b0 con 0x7f4c7015de30 2024-02-17T00:37:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.840+0000 7f4c6e7fc640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c5c06b810 0x7f4c5c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.840+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4c6008a200 con 0x7f4c7015de30 2024-02-17T00:37:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.840+0000 7f4c75a36640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c5c06b810 0x7f4c5c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.841+0000 7f4c75a36640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c5c06b810 0x7f4c5c06dcd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4c68036000 tx=0x7f4c6803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:53.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:53.844+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c60054a90 con 0x7f4c7015de30 2024-02-17T00:37:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.061+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c70068fb0 con 0x7f4c7015de30 2024-02-17T00:37:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.061+0000 7f4c6e7fc640 1 -- 172.21.15.32:0/204887658 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f4c60058150 con 0x7f4c7015de30 2024-02-17T00:37:54.064 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:54.065 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/4067364288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":4067364288},{"type":"v1","addr":"172.21.15.39:6836","nonce":4067364288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5182,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/2995424971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2995424971},{"type":"v1","addr":"172.21.15.32:6834","nonce":2995424971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3597184782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3597184782},{"type":"v1","addr":"172.21.15.32:6835","nonce":3597184782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:37:51.052969+0000","modified":"2024-02-17T00:37:53.052790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/3098499346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":3098499346},{"type":"v1","addr":"172.21.15.39:6837","nonce":3098499346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-17T00:37:54.065 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 15 2024-02-17T00:37:54.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c5c06b810 msgr2=0x7f4c5c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c5c06b810 0x7f4c5c06dcd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4c68036000 tx=0x7f4c6803c040 comp rx=0 tx=0).stop 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 msgr2=0x7f4c70144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 0x7f4c70144d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000b9e0 tx=0x7f4c6000bea0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 shutdown_connections 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7015de30 0x7f4c70144d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7015da50 0x7f4c70144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f4c5c06b810 0x7f4c5c06dcd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 --2- 172.21.15.32:0/204887658 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c700d0990 0x7f4c701f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 >> 172.21.15.32:0/204887658 conn(0x7f4c70072290 msgr2=0x7f4c7015f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 shutdown_connections 2024-02-17T00:37:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.064+0000 7f4c77c9a640 1 -- 172.21.15.32:0/204887658 wait complete. 2024-02-17T00:37:54.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T00:37:54.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.177+0000 7fc66ff56640 1 Processor -- start 2024-02-17T00:37:54.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.177+0000 7fc66ff56640 1 -- start start 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66ff56640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc66815b990 0x7fc66809a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66ff56640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680ccd10 0x7fc6680c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66ff56640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66809ad90 con 0x7fc6680c5780 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66ff56640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680cd560 con 0x7fc66815b990 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66ff56640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc668099a90 con 0x7fc6680ccd10 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc66815b990 0x7fc66809a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc66815b990 0x7fc66809a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42154/0 (socket says 172.21.15.32:42154) 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 -- 172.21.15.32:0/3007615201 learned_addr learned my addr 172.21.15.32:0/3007615201 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:54.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66d4f1640 1 --2- 172.21.15.32:0/3007615201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680ccd10 0x7fc6680c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 -- 172.21.15.32:0/3007615201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680ccd10 msgr2=0x7fc6680c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:54.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 --2- 172.21.15.32:0/3007615201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680ccd10 0x7fc6680c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 -- 172.21.15.32:0/3007615201 >> v1:172.21.15.39:6789/0 conn(0x7fc6680c5780 legacy=0x7fc6680cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.178+0000 7fc66dcf2640 1 -- 172.21.15.32:0/3007615201 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc668099d70 con 0x7fc66815b990 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66dcf2640 1 --2- 172.21.15.32:0/3007615201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc66809a850 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc664009870 tx=0x7fc66402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83c6644a9cda91e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ccf0640 1 -- 172.21.15.32:0/3007615201 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664031640 con 0x7fc66815b990 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ccf0640 1 -- 172.21.15.32:0/3007615201 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640317a0 con 0x7fc66815b990 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ccf0640 1 -- 172.21.15.32:0/3007615201 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664031b30 con 0x7fc66815b990 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ff56640 1 -- 172.21.15.32:0/3007615201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 msgr2=0x7fc66809a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ff56640 1 --2- 172.21.15.32:0/3007615201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc66809a850 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc664009870 tx=0x7fc66402b8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ff56640 1 -- 172.21.15.32:0/3007615201 shutdown_connections 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ff56640 1 --2- 172.21.15.32:0/3007615201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680ccd10 0x7fc6680c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ff56640 1 --2- 172.21.15.32:0/3007615201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc66809a850 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.179+0000 7fc66ff56640 1 -- 172.21.15.32:0/3007615201 >> 172.21.15.32:0/3007615201 conn(0x7fc6680d16f0 msgr2=0x7fc6680d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:54.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.180+0000 7fc66ff56640 1 -- 172.21.15.32:0/3007615201 shutdown_connections 2024-02-17T00:37:54.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.180+0000 7fc66ff56640 1 -- 172.21.15.32:0/3007615201 wait complete. 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 Processor -- start 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 -- start start 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680c5780 0x7fc668156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6680ccd10 0x7fc6680c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc6680c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680ca350 con 0x7fc66815b990 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681f2190 con 0x7fc6680ccd10 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.181+0000 7fc66ff56640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680ca5f0 con 0x7fc6680c5780 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc6680c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc6680c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42162/0 (socket says 172.21.15.32:42162) 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 -- 172.21.15.32:0/2461510839 learned_addr learned my addr 172.21.15.32:0/2461510839 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66d4f1640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6680ccd10 0x7fc6680c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66dcf2640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680c5780 0x7fc668156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 -- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680c5780 msgr2=0x7fc668156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680c5780 0x7fc668156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 -- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6680ccd10 msgr2=0x7fc6680c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6680ccd10 0x7fc6680c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 -- 172.21.15.32:0/2461510839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640094d0 con 0x7fc66815b990 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66e4f3640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc6680c9710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c6b0 tx=0x7fc66000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660003b70 con 0x7fc66815b990 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc660003cf0 con 0x7fc66815b990 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680ca8d0 con 0x7fc66815b990 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660003ea0 con 0x7fc66815b990 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.182+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6680cae90 con 0x7fc66815b990 2024-02-17T00:37:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.183+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6680d0c50 con 0x7fc66815b990 2024-02-17T00:37:54.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.184+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc660005310 con 0x7fc66815b990 2024-02-17T00:37:54.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.184+0000 7fc65e7fc640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc64c06b840 0x7fc64c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.184+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc660089f90 con 0x7fc66815b990 2024-02-17T00:37:54.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.184+0000 7fc66dcf2640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc64c06b840 0x7fc64c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.185+0000 7fc66dcf2640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc64c06b840 0x7fc64c06dd00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc664036000 tx=0x7fc66403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.188+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6600bd8c0 con 0x7fc66815b990 2024-02-17T00:37:54.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.371+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc668068fd0 con 0x7fc66815b990 2024-02-17T00:37:54.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.372+0000 7fc65e7fc640 1 -- 172.21.15.32:0/2461510839 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16894 (secure 0 0 0) 0x7fc6600548d0 con 0x7fc66815b990 2024-02-17T00:37:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:54.374 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":41,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T00:37:52.687483+0000","last_up_change":"2024-02-17T00:36:24.648940+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:37:48.933613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-02-17T00:37:50.024420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists","up"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T00:37:54.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc64c06b840 msgr2=0x7fc64c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc64c06b840 0x7fc64c06dd00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc664036000 tx=0x7fc66403c040 comp rx=0 tx=0).stop 2024-02-17T00:37:54.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 msgr2=0x7fc6680c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc6680c9710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c6b0 tx=0x7fc66000cb70 comp rx=0 tx=0).stop 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 shutdown_connections 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc66815b990 0x7fc6680c9710 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6680ccd10 0x7fc6680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fc64c06b840 0x7fc64c06dd00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 --2- 172.21.15.32:0/2461510839 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc6680c5780 0x7fc668156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 >> 172.21.15.32:0/2461510839 conn(0x7fc6680d16f0 msgr2=0x7fc6680b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 shutdown_connections 2024-02-17T00:37:54.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.374+0000 7fc66ff56640 1 -- 172.21.15.32:0/2461510839 wait complete. 2024-02-17T00:37:54.387 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T00:37:54.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:54.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.487+0000 7f90719d7640 1 Processor -- start 2024-02-17T00:37:54.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.487+0000 7f90719d7640 1 -- start start 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f90719d7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f906c06ab60 0x7f906c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f90719d7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c15dc60 0x7f906c06af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f90719d7640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c0b5a20 con 0x7f906c0afc00 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f90719d7640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0b07e0 con 0x7f906c06ab60 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f90719d7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0b0160 con 0x7f906c15dc60 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906b7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f906c0afc00 0x7f906c0b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51758/0 (socket says 172.21.15.32:51758) 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906b7fe640 1 -- 172.21.15.32:0/3445948381 learned_addr learned my addr 172.21.15.32:0/3445948381 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f9063fff640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c15dc60 0x7f906c06af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906affd640 1 --2- 172.21.15.32:0/3445948381 >> v2:172.21.15.39:3300/0 conn(0x7f906c06ab60 0x7f906c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906a7fc640 1 -- 172.21.15.32:0/3445948381 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544478575 0 0) 0x7f906c0b5a20 con 0x7f906c0afc00 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906a7fc640 1 -- 172.21.15.32:0/3445948381 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9058003520 con 0x7f906c0afc00 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906a7fc640 1 -- 172.21.15.32:0/3445948381 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57404434 0 0) 0x7f9058003520 con 0x7f906c0afc00 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906affd640 1 -- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c15dc60 msgr2=0x7f906c06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906affd640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c15dc60 0x7f906c06af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906affd640 1 -- 172.21.15.32:0/3445948381 >> v1:172.21.15.32:6789/0 conn(0x7f906c0afc00 legacy=0x7f906c0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f906affd640 1 -- 172.21.15.32:0/3445948381 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c06b480 con 0x7f906c06ab60 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.488+0000 7f9063fff640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c15dc60 0x7f906c06af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.489+0000 7f906affd640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c06ab60 0x7f906c0b1ba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097a0 tx=0x7f905c02b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4dc9debaca8dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.489+0000 7f906a7fc640 1 -- 172.21.15.32:0/3445948381 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90640019f0 con 0x7f906c06ab60 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.489+0000 7f906a7fc640 1 -- 172.21.15.32:0/3445948381 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c02e050 con 0x7f906c06ab60 2024-02-17T00:37:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.489+0000 7f906a7fc640 1 -- 172.21.15.32:0/3445948381 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c030710 con 0x7f906c06ab60 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 -- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c06ab60 msgr2=0x7f906c0b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c06ab60 0x7f906c0b1ba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097a0 tx=0x7f905c02b660 comp rx=0 tx=0).stop 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 -- 172.21.15.32:0/3445948381 shutdown_connections 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c15dc60 0x7f906c06af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 --2- 172.21.15.32:0/3445948381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c06ab60 0x7f906c0b1ba0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 -- 172.21.15.32:0/3445948381 >> 172.21.15.32:0/3445948381 conn(0x7f906c0b5c30 msgr2=0x7f906c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 -- 172.21.15.32:0/3445948381 shutdown_connections 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.490+0000 7f90719d7640 1 -- 172.21.15.32:0/3445948381 wait complete. 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.491+0000 7f90719d7640 1 Processor -- start 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.491+0000 7f90719d7640 1 -- start start 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f90719d7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c06ab60 0x7f906c140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f90719d7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c0afc00 0x7f906c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f90719d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 0x7f906c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f90719d7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c15f090 con 0x7f906c15dc60 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f90719d7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c15f650 con 0x7f906c0afc00 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f90719d7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c158d00 con 0x7f906c06ab60 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 0x7f906c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 0x7f906c156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42178/0 (socket says 172.21.15.32:42178) 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 -- 172.21.15.32:0/2966318255 learned_addr learned my addr 172.21.15.32:0/2966318255 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906affd640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c06ab60 0x7f906c140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f9063fff640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c0afc00 0x7f906c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 -- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c06ab60 msgr2=0x7f906c140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c06ab60 0x7f906c140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 -- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c0afc00 msgr2=0x7f906c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c0afc00 0x7f906c155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 -- 172.21.15.32:0/2966318255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054009400 con 0x7f906c15dc60 2024-02-17T00:37:54.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.492+0000 7f906b7fe640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 0x7f906c156380 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9064001830 tx=0x7f906400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.493+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064012400 con 0x7f906c15dc60 2024-02-17T00:37:54.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.493+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064012560 con 0x7f906c15dc60 2024-02-17T00:37:54.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.493+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c009400 con 0x7f906c15dc60 2024-02-17T00:37:54.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.493+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064012910 con 0x7f906c15dc60 2024-02-17T00:37:54.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.493+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c15f2e0 con 0x7f906c15dc60 2024-02-17T00:37:54.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.494+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c099ca0 con 0x7f906c15dc60 2024-02-17T00:37:54.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.494+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9064012a70 con 0x7f906c15dc60 2024-02-17T00:37:54.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.494+0000 7f9068ff9640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.494+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f906408a9b0 con 0x7f906c15dc60 2024-02-17T00:37:54.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.495+0000 7f906affd640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.495+0000 7f906affd640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f905c034000 tx=0x7f905c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.498+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9064055300 con 0x7f906c15dc60 2024-02-17T00:37:54.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.675+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f906c0b0400 con 0x7f904c06b810 2024-02-17T00:37:54.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.683+0000 7f9068ff9640 1 -- 172.21.15.32:0/2966318255 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278624 (secure 0 0 0) 0x7f905c040070 con 0x7f904c06b810 2024-02-17T00:37:54.688 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:54.689 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 msgr2=0x7f904c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f905c034000 tx=0x7f905c008030 comp rx=0 tx=0).stop 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 msgr2=0x7f906c156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 0x7f906c156380 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9064001830 tx=0x7f906400a430 comp rx=0 tx=0).stop 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 shutdown_connections 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f906c15dc60 0x7f906c156380 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f906c0afc00 0x7f906c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f904c06b810 0x7f904c06dcd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 --2- 172.21.15.32:0/2966318255 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f906c06ab60 0x7f906c140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 >> 172.21.15.32:0/2966318255 conn(0x7f906c0b5c30 msgr2=0x7f906c06fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:54.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 shutdown_connections 2024-02-17T00:37:54.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.686+0000 7f90719d7640 1 -- 172.21.15.32:0/2966318255 wait complete. 2024-02-17T00:37:54.698 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-02-17T00:37:53.966090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253976,"kb_used_data":4512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720744,"statfs":{"total":773094113280,"available":772834041856,"internally_reserved":0,"allocated":4620288,"data_stored":2607912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.284095"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693441+0000","last_change":"2024-02-17T00:37:51.711548+0000","last_active":"2024-02-17T00:37:52.693441+0000","last_peered":"2024-02-17T00:37:52.693441+0000","last_clean":"2024-02-17T00:37:52.693441+0000","last_became_active":"2024-02-17T00:37:51.711260+0000","last_became_peered":"2024-02-17T00:37:51.711260+0000","last_unstale":"2024-02-17T00:37:52.693441+0000","last_undegraded":"2024-02-17T00:37:52.693441+0000","last_fullsized":"2024-02-17T00:37:52.693441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:45:34.889730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693811+0000","last_change":"2024-02-17T00:37:51.714730+0000","last_active":"2024-02-17T00:37:52.693811+0000","last_peered":"2024-02-17T00:37:52.693811+0000","last_clean":"2024-02-17T00:37:52.693811+0000","last_became_active":"2024-02-17T00:37:51.714431+0000","last_became_peered":"2024-02-17T00:37:51.714431+0000","last_unstale":"2024-02-17T00:37:52.693811+0000","last_undegraded":"2024-02-17T00:37:52.693811+0000","last_fullsized":"2024-02-17T00:37:52.693811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:21:44.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693557+0000","last_change":"2024-02-17T00:37:51.718977+0000","last_active":"2024-02-17T00:37:52.693557+0000","last_peered":"2024-02-17T00:37:52.693557+0000","last_clean":"2024-02-17T00:37:52.693557+0000","last_became_active":"2024-02-17T00:37:51.718689+0000","last_became_peered":"2024-02-17T00:37:51.718689+0000","last_unstale":"2024-02-17T00:37:52.693557+0000","last_undegraded":"2024-02-17T00:37:52.693557+0000","last_fullsized":"2024-02-17T00:37:52.693557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:39:22.812319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687592+0000","last_change":"2024-02-17T00:37:49.687592+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687592+0000","last_undegraded":"2024-02-17T00:37:49.687592+0000","last_fullsized":"2024-02-17T00:37:49.687592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685895+0000","last_change":"2024-02-17T00:37:49.685895+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685895+0000","last_undegraded":"2024-02-17T00:37:49.685895+0000","last_fullsized":"2024-02-17T00:37:49.685895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684296+0000","last_change":"2024-02-17T00:37:49.684296+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684296+0000","last_undegraded":"2024-02-17T00:37:49.684296+0000","last_fullsized":"2024-02-17T00:37:49.684296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687383+0000","last_change":"2024-02-17T00:37:49.687383+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687383+0000","last_undegraded":"2024-02-17T00:37:49.687383+0000","last_fullsized":"2024-02-17T00:37:49.687383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687745+0000","last_change":"2024-02-17T00:37:49.687745+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687745+0000","last_undegraded":"2024-02-17T00:37:49.687745+0000","last_fullsized":"2024-02-17T00:37:49.687745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688575+0000","last_change":"2024-02-17T00:37:49.688575+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688575+0000","last_undegraded":"2024-02-17T00:37:49.688575+0000","last_fullsized":"2024-02-17T00:37:49.688575+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685490+0000","last_change":"2024-02-17T00:37:49.685490+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685490+0000","last_undegraded":"2024-02-17T00:37:49.685490+0000","last_fullsized":"2024-02-17T00:37:49.685490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688701+0000","last_change":"2024-02-17T00:37:49.688701+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688701+0000","last_undegraded":"2024-02-17T00:37:49.688701+0000","last_fullsized":"2024-02-17T00:37:49.688701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685178+0000","last_change":"2024-02-17T00:37:49.685178+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685178+0000","last_undegraded":"2024-02-17T00:37:49.685178+0000","last_fullsized":"2024-02-17T00:37:49.685178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689184+0000","last_change":"2024-02-17T00:37:49.689184+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689184+0000","last_undegraded":"2024-02-17T00:37:49.689184+0000","last_fullsized":"2024-02-17T00:37:49.689184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688878+0000","last_change":"2024-02-17T00:37:49.688878+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688878+0000","last_undegraded":"2024-02-17T00:37:49.688878+0000","last_fullsized":"2024-02-17T00:37:49.688878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685713+0000","last_change":"2024-02-17T00:37:49.685713+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685713+0000","last_undegraded":"2024-02-17T00:37:49.685713+0000","last_fullsized":"2024-02-17T00:37:49.685713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685251+0000","last_change":"2024-02-17T00:37:49.685251+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685251+0000","last_undegraded":"2024-02-17T00:37:49.685251+0000","last_fullsized":"2024-02-17T00:37:49.685251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685634+0000","last_change":"2024-02-17T00:37:49.685634+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685634+0000","last_undegraded":"2024-02-17T00:37:49.685634+0000","last_fullsized":"2024-02-17T00:37:49.685634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689788+0000","last_change":"2024-02-17T00:37:49.689788+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689788+0000","last_undegraded":"2024-02-17T00:37:49.689788+0000","last_fullsized":"2024-02-17T00:37:49.689788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693589+0000","last_change":"2024-02-17T00:37:51.716454+0000","last_active":"2024-02-17T00:37:52.693589+0000","last_peered":"2024-02-17T00:37:52.693589+0000","last_clean":"2024-02-17T00:37:52.693589+0000","last_became_active":"2024-02-17T00:37:51.716112+0000","last_became_peered":"2024-02-17T00:37:51.716112+0000","last_unstale":"2024-02-17T00:37:52.693589+0000","last_undegraded":"2024-02-17T00:37:52.693589+0000","last_fullsized":"2024-02-17T00:37:52.693589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:17:58.554817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687376+0000","last_change":"2024-02-17T00:37:49.687376+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687376+0000","last_undegraded":"2024-02-17T00:37:49.687376+0000","last_fullsized":"2024-02-17T00:37:49.687376+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689211+0000","last_change":"2024-02-17T00:37:49.689211+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689211+0000","last_undegraded":"2024-02-17T00:37:49.689211+0000","last_fullsized":"2024-02-17T00:37:49.689211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688536+0000","last_change":"2024-02-17T00:37:49.688536+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688536+0000","last_undegraded":"2024-02-17T00:37:49.688536+0000","last_fullsized":"2024-02-17T00:37:49.688536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693431+0000","last_change":"2024-02-17T00:37:50.707696+0000","last_active":"2024-02-17T00:37:52.693431+0000","last_peered":"2024-02-17T00:37:52.693431+0000","last_clean":"2024-02-17T00:37:52.693431+0000","last_became_active":"2024-02-17T00:37:50.707097+0000","last_became_peered":"2024-02-17T00:37:50.707097+0000","last_unstale":"2024-02-17T00:37:52.693431+0000","last_undegraded":"2024-02-17T00:37:52.693431+0000","last_fullsized":"2024-02-17T00:37:52.693431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:30:26.693300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.694053+0000","last_change":"2024-02-17T00:37:49.694053+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.694053+0000","last_undegraded":"2024-02-17T00:37:49.694053+0000","last_fullsized":"2024-02-17T00:37:49.694053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.693986+0000","last_change":"2024-02-17T00:37:49.693986+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.693986+0000","last_undegraded":"2024-02-17T00:37:49.693986+0000","last_fullsized":"2024-02-17T00:37:49.693986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685164+0000","last_change":"2024-02-17T00:37:49.685164+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685164+0000","last_undegraded":"2024-02-17T00:37:49.685164+0000","last_fullsized":"2024-02-17T00:37:49.685164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688977+0000","last_change":"2024-02-17T00:37:49.688977+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688977+0000","last_undegraded":"2024-02-17T00:37:49.688977+0000","last_fullsized":"2024-02-17T00:37:49.688977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684339+0000","last_change":"2024-02-17T00:37:49.684339+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684339+0000","last_undegraded":"2024-02-17T00:37:49.684339+0000","last_fullsized":"2024-02-17T00:37:49.684339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693612+0000","last_change":"2024-02-17T00:37:51.715709+0000","last_active":"2024-02-17T00:37:52.693612+0000","last_peered":"2024-02-17T00:37:52.693612+0000","last_clean":"2024-02-17T00:37:52.693612+0000","last_became_active":"2024-02-17T00:37:51.715427+0000","last_became_peered":"2024-02-17T00:37:51.715427+0000","last_unstale":"2024-02-17T00:37:52.693612+0000","last_undegraded":"2024-02-17T00:37:52.693612+0000","last_fullsized":"2024-02-17T00:37:52.693612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:01:01.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689251+0000","last_change":"2024-02-17T00:37:49.689251+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689251+0000","last_undegraded":"2024-02-17T00:37:49.689251+0000","last_fullsized":"2024-02-17T00:37:49.689251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693673+0000","last_change":"2024-02-17T00:37:50.707462+0000","last_active":"2024-02-17T00:37:52.693673+0000","last_peered":"2024-02-17T00:37:52.693673+0000","last_clean":"2024-02-17T00:37:52.693673+0000","last_became_active":"2024-02-17T00:37:50.707079+0000","last_became_peered":"2024-02-17T00:37:50.707079+0000","last_unstale":"2024-02-17T00:37:52.693673+0000","last_undegraded":"2024-02-17T00:37:52.693673+0000","last_fullsized":"2024-02-17T00:37:52.693673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:48.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693584+0000","last_change":"2024-02-17T00:37:50.709902+0000","last_active":"2024-02-17T00:37:52.693584+0000","last_peered":"2024-02-17T00:37:52.693584+0000","last_clean":"2024-02-17T00:37:52.693584+0000","last_became_active":"2024-02-17T00:37:50.709574+0000","last_became_peered":"2024-02-17T00:37:50.709574+0000","last_unstale":"2024-02-17T00:37:52.693584+0000","last_undegraded":"2024-02-17T00:37:52.693584+0000","last_fullsized":"2024-02-17T00:37:52.693584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:58.955350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693416+0000","last_change":"2024-02-17T00:37:51.720548+0000","last_active":"2024-02-17T00:37:52.693416+0000","last_peered":"2024-02-17T00:37:52.693416+0000","last_clean":"2024-02-17T00:37:52.693416+0000","last_became_active":"2024-02-17T00:37:51.720050+0000","last_became_peered":"2024-02-17T00:37:51.720050+0000","last_unstale":"2024-02-17T00:37:52.693416+0000","last_undegraded":"2024-02-17T00:37:52.693416+0000","last_fullsized":"2024-02-17T00:37:52.693416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:41.301414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684832+0000","last_change":"2024-02-17T00:37:49.684832+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684832+0000","last_undegraded":"2024-02-17T00:37:49.684832+0000","last_fullsized":"2024-02-17T00:37:49.684832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.686737+0000","last_change":"2024-02-17T00:37:49.686737+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.686737+0000","last_undegraded":"2024-02-17T00:37:49.686737+0000","last_fullsized":"2024-02-17T00:37:49.686737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688707+0000","last_change":"2024-02-17T00:37:49.688707+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688707+0000","last_undegraded":"2024-02-17T00:37:49.688707+0000","last_fullsized":"2024-02-17T00:37:49.688707+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684512+0000","last_change":"2024-02-17T00:37:49.684512+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684512+0000","last_undegraded":"2024-02-17T00:37:49.684512+0000","last_fullsized":"2024-02-17T00:37:49.684512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.686790+0000","last_change":"2024-02-17T00:37:49.686790+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.686790+0000","last_undegraded":"2024-02-17T00:37:49.686790+0000","last_fullsized":"2024-02-17T00:37:49.686790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-02-17T00:37:49.688966+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:37:49.688966+0000","last_peered":"2024-02-17T00:37:49.688966+0000","last_clean":"2024-02-17T00:37:49.688966+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:37:49.688966+0000","last_undegraded":"2024-02-17T00:37:49.688966+0000","last_fullsized":"2024-02-17T00:37:49.688966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68899999999999995}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54700000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":769295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34799999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.503}]},{"osd":1,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.377}]},{"osd":2,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45800000000000002}]},{"osd":6,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.622},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.751},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":178927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.316},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.497}]},{"osd":6,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.435},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.53300000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":763086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":178927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.374}]},{"osd":2,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.443}]},{"osd":3,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.628},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76700000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.629},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.0839999999999996,"5min":6.0839999999999996,"15min":6.0839999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:54.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.838+0000 7fb76d513640 1 Processor -- start 2024-02-17T00:37:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.838+0000 7fb76d513640 1 -- start start 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb76d513640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb76815dbb0 0x7fb7680b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb76d513640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb76806c280 0x7fb76806da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb76d513640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7680cc290 con 0x7fb768161ff0 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb76d513640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7680cc570 con 0x7fb76806c280 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb76d513640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb768072650 con 0x7fb76815dbb0 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb76806c280 0x7fb76806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb76806c280 0x7fb76806da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42180/0 (socket says 172.21.15.32:42180) 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb75ffff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb768161ff0 0x7fb76806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51762/0 (socket says 172.21.15.32:51762) 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 -- 172.21.15.32:0/3316578221 learned_addr learned my addr 172.21.15.32:0/3316578221 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:54.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 -- 172.21.15.32:0/3316578221 >> v2:172.21.15.39:3300/0 conn(0x7fb76815dbb0 msgr2=0x7fb7680b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb766ffd640 1 --2- 172.21.15.32:0/3316578221 >> v2:172.21.15.39:3300/0 conn(0x7fb76815dbb0 0x7fb7680b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 --2- 172.21.15.32:0/3316578221 >> v2:172.21.15.39:3300/0 conn(0x7fb76815dbb0 0x7fb7680b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 -- 172.21.15.32:0/3316578221 >> v1:172.21.15.32:6789/0 conn(0x7fb768161ff0 legacy=0x7fb76806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7677fe640 1 -- 172.21.15.32:0/3316578221 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb768072930 con 0x7fb76806c280 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb7667fc640 1 -- 172.21.15.32:0/3316578221 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566314970 0 0) 0x7fb7680cc290 con 0x7fb768161ff0 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.839+0000 7fb766ffd640 1 --2- 172.21.15.32:0/3316578221 >> v2:172.21.15.39:3300/0 conn(0x7fb76815dbb0 0x7fb7680b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.840+0000 7fb7677fe640 1 --2- 172.21.15.32:0/3316578221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb76806c280 0x7fb76806da00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb76806fa50 tx=0x7fb76002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b95187aa4b4111 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.840+0000 7fb7667fc640 1 -- 172.21.15.32:0/3316578221 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76002cb20 con 0x7fb76806c280 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.840+0000 7fb7667fc640 1 -- 172.21.15.32:0/3316578221 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76002cc80 con 0x7fb76806c280 2024-02-17T00:37:54.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.840+0000 7fb7667fc640 1 -- 172.21.15.32:0/3316578221 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600343f0 con 0x7fb76806c280 2024-02-17T00:37:54.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 -- 172.21.15.32:0/3316578221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb76806c280 msgr2=0x7fb76806da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 --2- 172.21.15.32:0/3316578221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb76806c280 0x7fb76806da00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb76806fa50 tx=0x7fb76002bf80 comp rx=0 tx=0).stop 2024-02-17T00:37:54.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 -- 172.21.15.32:0/3316578221 shutdown_connections 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 --2- 172.21.15.32:0/3316578221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb76806c280 0x7fb76806da00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 --2- 172.21.15.32:0/3316578221 >> v2:172.21.15.39:3300/0 conn(0x7fb76815dbb0 0x7fb7680b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 -- 172.21.15.32:0/3316578221 >> 172.21.15.32:0/3316578221 conn(0x7fb7680719c0 msgr2=0x7fb768071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 -- 172.21.15.32:0/3316578221 shutdown_connections 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.841+0000 7fb76d513640 1 -- 172.21.15.32:0/3316578221 wait complete. 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.842+0000 7fb76d513640 1 Processor -- start 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.842+0000 7fb76d513640 1 -- start start 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb76d513640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb76806c280 0x7fb7680cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb76d513640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb76815dbb0 0x7fb76814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb76d513640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 0x7fb768159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb76d513640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76815cfa0 con 0x7fb768161ff0 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb76d513640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76814bc10 con 0x7fb76806c280 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb76d513640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76815a1f0 con 0x7fb76815dbb0 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 0x7fb768159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 0x7fb768159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42194/0 (socket says 172.21.15.32:42194) 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 -- 172.21.15.32:0/882904195 learned_addr learned my addr 172.21.15.32:0/882904195 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb766ffd640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb76806c280 0x7fb7680cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb75ffff640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb76815dbb0 0x7fb76814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 -- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb76815dbb0 msgr2=0x7fb76814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb76815dbb0 0x7fb76814b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 -- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb76806c280 msgr2=0x7fb7680cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb76806c280 0x7fb7680cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 -- 172.21.15.32:0/882904195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009b30 con 0x7fb768161ff0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb766ffd640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb76806c280 0x7fb7680cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb75ffff640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb76815dbb0 0x7fb76814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.843+0000 7fb7677fe640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 0x7fb768159cb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb760036040 tx=0x7fb760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.844+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760009510 con 0x7fb768161ff0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.844+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76003e450 con 0x7fb768161ff0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.844+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76815c320 con 0x7fb768161ff0 2024-02-17T00:37:54.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.844+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76003e600 con 0x7fb768161ff0 2024-02-17T00:37:54.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.844+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76815c8e0 con 0x7fb768161ff0 2024-02-17T00:37:54.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.845+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76815d0e0 con 0x7fb768161ff0 2024-02-17T00:37:54.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.845+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb76003e760 con 0x7fb768161ff0 2024-02-17T00:37:54.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.845+0000 7fb75f7fe640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb74806b810 0x7fb74806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:54.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.845+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb7600acca0 con 0x7fb768161ff0 2024-02-17T00:37:54.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.846+0000 7fb766ffd640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb74806b810 0x7fb74806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:54.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.846+0000 7fb766ffd640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb74806b810 0x7fb74806dcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb758006fd0 tx=0x7fb758008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:54.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:54.850+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb76815d0e0 con 0x7fb768161ff0 2024-02-17T00:37:55.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.026+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb768162460 con 0x7fb74806b810 2024-02-17T00:37:55.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.034+0000 7fb75f7fe640 1 -- 172.21.15.32:0/882904195 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278624 (secure 0 0 0) 0x7fb75800c040 con 0x7fb74806b810 2024-02-17T00:37:55.039 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb74806b810 msgr2=0x7fb74806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb74806b810 0x7fb74806dcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb758006fd0 tx=0x7fb758008040 comp rx=0 tx=0).stop 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 msgr2=0x7fb768159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 0x7fb768159cb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb760036040 tx=0x7fb760004a40 comp rx=0 tx=0).stop 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 shutdown_connections 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb768161ff0 0x7fb768159cb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb74806b810 0x7fb74806dcd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb76815dbb0 0x7fb76814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 --2- 172.21.15.32:0/882904195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb76806c280 0x7fb7680cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 >> 172.21.15.32:0/882904195 conn(0x7fb7680719c0 msgr2=0x7fb7680ad190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 shutdown_connections 2024-02-17T00:37:55.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.037+0000 7fb76d513640 1 -- 172.21.15.32:0/882904195 wait complete. 2024-02-17T00:37:55.050 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-02-17T00:37:53.966090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253976,"kb_used_data":4512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720744,"statfs":{"total":773094113280,"available":772834041856,"internally_reserved":0,"allocated":4620288,"data_stored":2607912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.284095"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693441+0000","last_change":"2024-02-17T00:37:51.711548+0000","last_active":"2024-02-17T00:37:52.693441+0000","last_peered":"2024-02-17T00:37:52.693441+0000","last_clean":"2024-02-17T00:37:52.693441+0000","last_became_active":"2024-02-17T00:37:51.711260+0000","last_became_peered":"2024-02-17T00:37:51.711260+0000","last_unstale":"2024-02-17T00:37:52.693441+0000","last_undegraded":"2024-02-17T00:37:52.693441+0000","last_fullsized":"2024-02-17T00:37:52.693441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:45:34.889730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693811+0000","last_change":"2024-02-17T00:37:51.714730+0000","last_active":"2024-02-17T00:37:52.693811+0000","last_peered":"2024-02-17T00:37:52.693811+0000","last_clean":"2024-02-17T00:37:52.693811+0000","last_became_active":"2024-02-17T00:37:51.714431+0000","last_became_peered":"2024-02-17T00:37:51.714431+0000","last_unstale":"2024-02-17T00:37:52.693811+0000","last_undegraded":"2024-02-17T00:37:52.693811+0000","last_fullsized":"2024-02-17T00:37:52.693811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:21:44.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693557+0000","last_change":"2024-02-17T00:37:51.718977+0000","last_active":"2024-02-17T00:37:52.693557+0000","last_peered":"2024-02-17T00:37:52.693557+0000","last_clean":"2024-02-17T00:37:52.693557+0000","last_became_active":"2024-02-17T00:37:51.718689+0000","last_became_peered":"2024-02-17T00:37:51.718689+0000","last_unstale":"2024-02-17T00:37:52.693557+0000","last_undegraded":"2024-02-17T00:37:52.693557+0000","last_fullsized":"2024-02-17T00:37:52.693557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:39:22.812319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687592+0000","last_change":"2024-02-17T00:37:49.687592+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687592+0000","last_undegraded":"2024-02-17T00:37:49.687592+0000","last_fullsized":"2024-02-17T00:37:49.687592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685895+0000","last_change":"2024-02-17T00:37:49.685895+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685895+0000","last_undegraded":"2024-02-17T00:37:49.685895+0000","last_fullsized":"2024-02-17T00:37:49.685895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684296+0000","last_change":"2024-02-17T00:37:49.684296+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684296+0000","last_undegraded":"2024-02-17T00:37:49.684296+0000","last_fullsized":"2024-02-17T00:37:49.684296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687383+0000","last_change":"2024-02-17T00:37:49.687383+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687383+0000","last_undegraded":"2024-02-17T00:37:49.687383+0000","last_fullsized":"2024-02-17T00:37:49.687383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687745+0000","last_change":"2024-02-17T00:37:49.687745+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687745+0000","last_undegraded":"2024-02-17T00:37:49.687745+0000","last_fullsized":"2024-02-17T00:37:49.687745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688575+0000","last_change":"2024-02-17T00:37:49.688575+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688575+0000","last_undegraded":"2024-02-17T00:37:49.688575+0000","last_fullsized":"2024-02-17T00:37:49.688575+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685490+0000","last_change":"2024-02-17T00:37:49.685490+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685490+0000","last_undegraded":"2024-02-17T00:37:49.685490+0000","last_fullsized":"2024-02-17T00:37:49.685490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688701+0000","last_change":"2024-02-17T00:37:49.688701+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688701+0000","last_undegraded":"2024-02-17T00:37:49.688701+0000","last_fullsized":"2024-02-17T00:37:49.688701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685178+0000","last_change":"2024-02-17T00:37:49.685178+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685178+0000","last_undegraded":"2024-02-17T00:37:49.685178+0000","last_fullsized":"2024-02-17T00:37:49.685178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689184+0000","last_change":"2024-02-17T00:37:49.689184+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689184+0000","last_undegraded":"2024-02-17T00:37:49.689184+0000","last_fullsized":"2024-02-17T00:37:49.689184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688878+0000","last_change":"2024-02-17T00:37:49.688878+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688878+0000","last_undegraded":"2024-02-17T00:37:49.688878+0000","last_fullsized":"2024-02-17T00:37:49.688878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685713+0000","last_change":"2024-02-17T00:37:49.685713+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685713+0000","last_undegraded":"2024-02-17T00:37:49.685713+0000","last_fullsized":"2024-02-17T00:37:49.685713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685251+0000","last_change":"2024-02-17T00:37:49.685251+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685251+0000","last_undegraded":"2024-02-17T00:37:49.685251+0000","last_fullsized":"2024-02-17T00:37:49.685251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685634+0000","last_change":"2024-02-17T00:37:49.685634+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685634+0000","last_undegraded":"2024-02-17T00:37:49.685634+0000","last_fullsized":"2024-02-17T00:37:49.685634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689788+0000","last_change":"2024-02-17T00:37:49.689788+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689788+0000","last_undegraded":"2024-02-17T00:37:49.689788+0000","last_fullsized":"2024-02-17T00:37:49.689788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693589+0000","last_change":"2024-02-17T00:37:51.716454+0000","last_active":"2024-02-17T00:37:52.693589+0000","last_peered":"2024-02-17T00:37:52.693589+0000","last_clean":"2024-02-17T00:37:52.693589+0000","last_became_active":"2024-02-17T00:37:51.716112+0000","last_became_peered":"2024-02-17T00:37:51.716112+0000","last_unstale":"2024-02-17T00:37:52.693589+0000","last_undegraded":"2024-02-17T00:37:52.693589+0000","last_fullsized":"2024-02-17T00:37:52.693589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:17:58.554817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687376+0000","last_change":"2024-02-17T00:37:49.687376+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687376+0000","last_undegraded":"2024-02-17T00:37:49.687376+0000","last_fullsized":"2024-02-17T00:37:49.687376+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689211+0000","last_change":"2024-02-17T00:37:49.689211+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689211+0000","last_undegraded":"2024-02-17T00:37:49.689211+0000","last_fullsized":"2024-02-17T00:37:49.689211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688536+0000","last_change":"2024-02-17T00:37:49.688536+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688536+0000","last_undegraded":"2024-02-17T00:37:49.688536+0000","last_fullsized":"2024-02-17T00:37:49.688536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693431+0000","last_change":"2024-02-17T00:37:50.707696+0000","last_active":"2024-02-17T00:37:52.693431+0000","last_peered":"2024-02-17T00:37:52.693431+0000","last_clean":"2024-02-17T00:37:52.693431+0000","last_became_active":"2024-02-17T00:37:50.707097+0000","last_became_peered":"2024-02-17T00:37:50.707097+0000","last_unstale":"2024-02-17T00:37:52.693431+0000","last_undegraded":"2024-02-17T00:37:52.693431+0000","last_fullsized":"2024-02-17T00:37:52.693431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:30:26.693300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.694053+0000","last_change":"2024-02-17T00:37:49.694053+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.694053+0000","last_undegraded":"2024-02-17T00:37:49.694053+0000","last_fullsized":"2024-02-17T00:37:49.694053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.693986+0000","last_change":"2024-02-17T00:37:49.693986+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.693986+0000","last_undegraded":"2024-02-17T00:37:49.693986+0000","last_fullsized":"2024-02-17T00:37:49.693986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685164+0000","last_change":"2024-02-17T00:37:49.685164+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685164+0000","last_undegraded":"2024-02-17T00:37:49.685164+0000","last_fullsized":"2024-02-17T00:37:49.685164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688977+0000","last_change":"2024-02-17T00:37:49.688977+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688977+0000","last_undegraded":"2024-02-17T00:37:49.688977+0000","last_fullsized":"2024-02-17T00:37:49.688977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684339+0000","last_change":"2024-02-17T00:37:49.684339+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684339+0000","last_undegraded":"2024-02-17T00:37:49.684339+0000","last_fullsized":"2024-02-17T00:37:49.684339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693612+0000","last_change":"2024-02-17T00:37:51.715709+0000","last_active":"2024-02-17T00:37:52.693612+0000","last_peered":"2024-02-17T00:37:52.693612+0000","last_clean":"2024-02-17T00:37:52.693612+0000","last_became_active":"2024-02-17T00:37:51.715427+0000","last_became_peered":"2024-02-17T00:37:51.715427+0000","last_unstale":"2024-02-17T00:37:52.693612+0000","last_undegraded":"2024-02-17T00:37:52.693612+0000","last_fullsized":"2024-02-17T00:37:52.693612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:01:01.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689251+0000","last_change":"2024-02-17T00:37:49.689251+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689251+0000","last_undegraded":"2024-02-17T00:37:49.689251+0000","last_fullsized":"2024-02-17T00:37:49.689251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693673+0000","last_change":"2024-02-17T00:37:50.707462+0000","last_active":"2024-02-17T00:37:52.693673+0000","last_peered":"2024-02-17T00:37:52.693673+0000","last_clean":"2024-02-17T00:37:52.693673+0000","last_became_active":"2024-02-17T00:37:50.707079+0000","last_became_peered":"2024-02-17T00:37:50.707079+0000","last_unstale":"2024-02-17T00:37:52.693673+0000","last_undegraded":"2024-02-17T00:37:52.693673+0000","last_fullsized":"2024-02-17T00:37:52.693673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:48.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693584+0000","last_change":"2024-02-17T00:37:50.709902+0000","last_active":"2024-02-17T00:37:52.693584+0000","last_peered":"2024-02-17T00:37:52.693584+0000","last_clean":"2024-02-17T00:37:52.693584+0000","last_became_active":"2024-02-17T00:37:50.709574+0000","last_became_peered":"2024-02-17T00:37:50.709574+0000","last_unstale":"2024-02-17T00:37:52.693584+0000","last_undegraded":"2024-02-17T00:37:52.693584+0000","last_fullsized":"2024-02-17T00:37:52.693584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:58.955350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693416+0000","last_change":"2024-02-17T00:37:51.720548+0000","last_active":"2024-02-17T00:37:52.693416+0000","last_peered":"2024-02-17T00:37:52.693416+0000","last_clean":"2024-02-17T00:37:52.693416+0000","last_became_active":"2024-02-17T00:37:51.720050+0000","last_became_peered":"2024-02-17T00:37:51.720050+0000","last_unstale":"2024-02-17T00:37:52.693416+0000","last_undegraded":"2024-02-17T00:37:52.693416+0000","last_fullsized":"2024-02-17T00:37:52.693416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:41.301414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684832+0000","last_change":"2024-02-17T00:37:49.684832+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684832+0000","last_undegraded":"2024-02-17T00:37:49.684832+0000","last_fullsized":"2024-02-17T00:37:49.684832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.686737+0000","last_change":"2024-02-17T00:37:49.686737+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.686737+0000","last_undegraded":"2024-02-17T00:37:49.686737+0000","last_fullsized":"2024-02-17T00:37:49.686737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688707+0000","last_change":"2024-02-17T00:37:49.688707+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688707+0000","last_undegraded":"2024-02-17T00:37:49.688707+0000","last_fullsized":"2024-02-17T00:37:49.688707+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684512+0000","last_change":"2024-02-17T00:37:49.684512+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684512+0000","last_undegraded":"2024-02-17T00:37:49.684512+0000","last_fullsized":"2024-02-17T00:37:49.684512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.686790+0000","last_change":"2024-02-17T00:37:49.686790+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.686790+0000","last_undegraded":"2024-02-17T00:37:49.686790+0000","last_fullsized":"2024-02-17T00:37:49.686790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-02-17T00:37:49.688966+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:37:49.688966+0000","last_peered":"2024-02-17T00:37:49.688966+0000","last_clean":"2024-02-17T00:37:49.688966+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:37:49.688966+0000","last_undegraded":"2024-02-17T00:37:49.688966+0000","last_fullsized":"2024-02-17T00:37:49.688966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68899999999999995}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54700000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":769295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34799999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.503}]},{"osd":1,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.377}]},{"osd":2,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45800000000000002}]},{"osd":6,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.622},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.751},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":178927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.316},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.497}]},{"osd":6,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.435},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.53300000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":763086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":178927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.374}]},{"osd":2,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.443}]},{"osd":3,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.628},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76700000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.629},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.0839999999999996,"5min":6.0839999999999996,"15min":6.0839999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:55.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:55.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.190+0000 7f03dcfa0640 1 Processor -- start 2024-02-17T00:37:55.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.190+0000 7f03dcfa0640 1 -- start start 2024-02-17T00:37:55.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03dcfa0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d8161200 0x7f03d80b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03dcfa0640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03d80d2380 0x7f03d80d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03dcfa0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f03d80d0600 0x7f03d80ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03dcfa0640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80d0a90 con 0x7f03d80d2380 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03dcfa0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80d3dc0 con 0x7f03d80d0600 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03dcfa0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80d27c0 con 0x7f03d8161200 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03d80d2380 0x7f03d80d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03d80d2380 0x7f03d80d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42200/0 (socket says 172.21.15.32:42200) 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 -- 172.21.15.32:0/2289189336 learned_addr learned my addr 172.21.15.32:0/2289189336 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d77fe640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d8161200 0x7f03d80b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d7fff640 1 --2- 172.21.15.32:0/2289189336 >> v2:172.21.15.39:3300/0 conn(0x7f03d80d0600 0x7f03d80ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 -- 172.21.15.32:0/2289189336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d8161200 msgr2=0x7f03d80b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d8161200 0x7f03d80b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 -- 172.21.15.32:0/2289189336 >> v2:172.21.15.39:3300/0 conn(0x7f03d80d0600 msgr2=0x7f03d80ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.191+0000 7f03d6ffd640 1 --2- 172.21.15.32:0/2289189336 >> v2:172.21.15.39:3300/0 conn(0x7f03d80d0600 0x7f03d80ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d6ffd640 1 -- 172.21.15.32:0/2289189336 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80b28b0 con 0x7f03d80d2380 2024-02-17T00:37:55.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d77fe640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d8161200 0x7f03d80b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:55.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d7fff640 1 --2- 172.21.15.32:0/2289189336 >> v2:172.21.15.39:3300/0 conn(0x7f03d80d0600 0x7f03d80ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d6ffd640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d80d2380 0x7f03d80d00c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f03d80b4a80 tx=0x7f03cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f753cff16509c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d67fc640 1 -- 172.21.15.32:0/2289189336 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc031640 con 0x7f03d80d2380 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d67fc640 1 -- 172.21.15.32:0/2289189336 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc0317a0 con 0x7f03d80d2380 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.192+0000 7f03d67fc640 1 -- 172.21.15.32:0/2289189336 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc031b30 con 0x7f03d80d2380 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 -- 172.21.15.32:0/2289189336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d80d2380 msgr2=0x7f03d80d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d80d2380 0x7f03d80d00c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f03d80b4a80 tx=0x7f03cc02b8f0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 -- 172.21.15.32:0/2289189336 shutdown_connections 2024-02-17T00:37:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/2289189336 >> v2:172.21.15.39:3300/0 conn(0x7f03d80d0600 0x7f03d80ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d80d2380 0x7f03d80d00c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/2289189336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d8161200 0x7f03d80b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 -- 172.21.15.32:0/2289189336 >> 172.21.15.32:0/2289189336 conn(0x7f03d808af80 msgr2=0x7f03d80d36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 -- 172.21.15.32:0/2289189336 shutdown_connections 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.193+0000 7f03dcfa0640 1 -- 172.21.15.32:0/2289189336 wait complete. 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.194+0000 7f03dcfa0640 1 Processor -- start 2024-02-17T00:37:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.194+0000 7f03dcfa0640 1 -- start start 2024-02-17T00:37:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03dcfa0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03d80d0600 0x7f03d81f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03dcfa0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d80d2380 0x7f03d80b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03dcfa0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 0x7f03d815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03dcfa0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80a14a0 con 0x7f03d8161200 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03dcfa0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d815d200 con 0x7f03d80d0600 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03dcfa0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81f3670 con 0x7f03d80d2380 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 0x7f03d815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 0x7f03d815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42202/0 (socket says 172.21.15.32:42202) 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 -- 172.21.15.32:0/3134540889 learned_addr learned my addr 172.21.15.32:0/3134540889 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d77fe640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03d80d0600 0x7f03d81f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d6ffd640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d80d2380 0x7f03d80b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 -- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d80d2380 msgr2=0x7f03d80b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d80d2380 0x7f03d80b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 -- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03d80d0600 msgr2=0x7f03d81f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03d80d0600 0x7f03d81f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.195+0000 7f03d7fff640 1 -- 172.21.15.32:0/3134540889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0094d0 con 0x7f03d8161200 2024-02-17T00:37:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.196+0000 7f03d7fff640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 0x7f03d815ccc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03d000cd10 tx=0x7f03d000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.196+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000f680 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.196+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000f800 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.196+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d81f3950 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.196+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000fbb0 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.196+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d81f66d0 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.197+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d81f68c0 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.197+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f03d000b040 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.198+0000 7f03bffff640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f03c406b810 0x7f03c406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.198+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f03d008aba0 con 0x7f03d8161200 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.198+0000 7f03d77fe640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f03c406b810 0x7f03c406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.198+0000 7f03d77fe640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f03c406b810 0x7f03c406dcd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f03d80b8bb0 tx=0x7f03c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.202+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03d00554e0 con 0x7f03d8161200 2024-02-17T00:37:55.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.378+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03d80d3fd0 con 0x7f03c406b810 2024-02-17T00:37:55.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.386+0000 7f03bffff640 1 -- 172.21.15.32:0/3134540889 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278624 (secure 0 0 0) 0x7f03c800c040 con 0x7f03c406b810 2024-02-17T00:37:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f03c406b810 msgr2=0x7f03c406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f03c406b810 0x7f03c406dcd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f03d80b8bb0 tx=0x7f03c8008040 comp rx=0 tx=0).stop 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 msgr2=0x7f03d815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 0x7f03d815ccc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03d000cd10 tx=0x7f03d000a650 comp rx=0 tx=0).stop 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 shutdown_connections 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03d8161200 0x7f03d815ccc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f03c406b810 0x7f03c406dcd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f03d80d2380 0x7f03d80b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 --2- 172.21.15.32:0/3134540889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03d80d0600 0x7f03d81f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 >> 172.21.15.32:0/3134540889 conn(0x7f03d808af80 msgr2=0x7f03d8160040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 shutdown_connections 2024-02-17T00:37:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.389+0000 7f03dcfa0640 1 -- 172.21.15.32:0/3134540889 wait complete. 2024-02-17T00:37:55.402 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-02-17T00:37:53.966090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253976,"kb_used_data":4512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720744,"statfs":{"total":773094113280,"available":772834041856,"internally_reserved":0,"allocated":4620288,"data_stored":2607912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.284095"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693441+0000","last_change":"2024-02-17T00:37:51.711548+0000","last_active":"2024-02-17T00:37:52.693441+0000","last_peered":"2024-02-17T00:37:52.693441+0000","last_clean":"2024-02-17T00:37:52.693441+0000","last_became_active":"2024-02-17T00:37:51.711260+0000","last_became_peered":"2024-02-17T00:37:51.711260+0000","last_unstale":"2024-02-17T00:37:52.693441+0000","last_undegraded":"2024-02-17T00:37:52.693441+0000","last_fullsized":"2024-02-17T00:37:52.693441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:45:34.889730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693811+0000","last_change":"2024-02-17T00:37:51.714730+0000","last_active":"2024-02-17T00:37:52.693811+0000","last_peered":"2024-02-17T00:37:52.693811+0000","last_clean":"2024-02-17T00:37:52.693811+0000","last_became_active":"2024-02-17T00:37:51.714431+0000","last_became_peered":"2024-02-17T00:37:51.714431+0000","last_unstale":"2024-02-17T00:37:52.693811+0000","last_undegraded":"2024-02-17T00:37:52.693811+0000","last_fullsized":"2024-02-17T00:37:52.693811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:21:44.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693557+0000","last_change":"2024-02-17T00:37:51.718977+0000","last_active":"2024-02-17T00:37:52.693557+0000","last_peered":"2024-02-17T00:37:52.693557+0000","last_clean":"2024-02-17T00:37:52.693557+0000","last_became_active":"2024-02-17T00:37:51.718689+0000","last_became_peered":"2024-02-17T00:37:51.718689+0000","last_unstale":"2024-02-17T00:37:52.693557+0000","last_undegraded":"2024-02-17T00:37:52.693557+0000","last_fullsized":"2024-02-17T00:37:52.693557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:39:22.812319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687592+0000","last_change":"2024-02-17T00:37:49.687592+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687592+0000","last_undegraded":"2024-02-17T00:37:49.687592+0000","last_fullsized":"2024-02-17T00:37:49.687592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685895+0000","last_change":"2024-02-17T00:37:49.685895+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685895+0000","last_undegraded":"2024-02-17T00:37:49.685895+0000","last_fullsized":"2024-02-17T00:37:49.685895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684296+0000","last_change":"2024-02-17T00:37:49.684296+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684296+0000","last_undegraded":"2024-02-17T00:37:49.684296+0000","last_fullsized":"2024-02-17T00:37:49.684296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687383+0000","last_change":"2024-02-17T00:37:49.687383+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687383+0000","last_undegraded":"2024-02-17T00:37:49.687383+0000","last_fullsized":"2024-02-17T00:37:49.687383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687745+0000","last_change":"2024-02-17T00:37:49.687745+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687745+0000","last_undegraded":"2024-02-17T00:37:49.687745+0000","last_fullsized":"2024-02-17T00:37:49.687745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688575+0000","last_change":"2024-02-17T00:37:49.688575+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688575+0000","last_undegraded":"2024-02-17T00:37:49.688575+0000","last_fullsized":"2024-02-17T00:37:49.688575+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685490+0000","last_change":"2024-02-17T00:37:49.685490+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685490+0000","last_undegraded":"2024-02-17T00:37:49.685490+0000","last_fullsized":"2024-02-17T00:37:49.685490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688701+0000","last_change":"2024-02-17T00:37:49.688701+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688701+0000","last_undegraded":"2024-02-17T00:37:49.688701+0000","last_fullsized":"2024-02-17T00:37:49.688701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685178+0000","last_change":"2024-02-17T00:37:49.685178+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685178+0000","last_undegraded":"2024-02-17T00:37:49.685178+0000","last_fullsized":"2024-02-17T00:37:49.685178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689184+0000","last_change":"2024-02-17T00:37:49.689184+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689184+0000","last_undegraded":"2024-02-17T00:37:49.689184+0000","last_fullsized":"2024-02-17T00:37:49.689184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688878+0000","last_change":"2024-02-17T00:37:49.688878+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688878+0000","last_undegraded":"2024-02-17T00:37:49.688878+0000","last_fullsized":"2024-02-17T00:37:49.688878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685713+0000","last_change":"2024-02-17T00:37:49.685713+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685713+0000","last_undegraded":"2024-02-17T00:37:49.685713+0000","last_fullsized":"2024-02-17T00:37:49.685713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685251+0000","last_change":"2024-02-17T00:37:49.685251+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685251+0000","last_undegraded":"2024-02-17T00:37:49.685251+0000","last_fullsized":"2024-02-17T00:37:49.685251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685634+0000","last_change":"2024-02-17T00:37:49.685634+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685634+0000","last_undegraded":"2024-02-17T00:37:49.685634+0000","last_fullsized":"2024-02-17T00:37:49.685634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689788+0000","last_change":"2024-02-17T00:37:49.689788+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689788+0000","last_undegraded":"2024-02-17T00:37:49.689788+0000","last_fullsized":"2024-02-17T00:37:49.689788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693589+0000","last_change":"2024-02-17T00:37:51.716454+0000","last_active":"2024-02-17T00:37:52.693589+0000","last_peered":"2024-02-17T00:37:52.693589+0000","last_clean":"2024-02-17T00:37:52.693589+0000","last_became_active":"2024-02-17T00:37:51.716112+0000","last_became_peered":"2024-02-17T00:37:51.716112+0000","last_unstale":"2024-02-17T00:37:52.693589+0000","last_undegraded":"2024-02-17T00:37:52.693589+0000","last_fullsized":"2024-02-17T00:37:52.693589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:17:58.554817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.687376+0000","last_change":"2024-02-17T00:37:49.687376+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.687376+0000","last_undegraded":"2024-02-17T00:37:49.687376+0000","last_fullsized":"2024-02-17T00:37:49.687376+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689211+0000","last_change":"2024-02-17T00:37:49.689211+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689211+0000","last_undegraded":"2024-02-17T00:37:49.689211+0000","last_fullsized":"2024-02-17T00:37:49.689211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688536+0000","last_change":"2024-02-17T00:37:49.688536+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688536+0000","last_undegraded":"2024-02-17T00:37:49.688536+0000","last_fullsized":"2024-02-17T00:37:49.688536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693431+0000","last_change":"2024-02-17T00:37:50.707696+0000","last_active":"2024-02-17T00:37:52.693431+0000","last_peered":"2024-02-17T00:37:52.693431+0000","last_clean":"2024-02-17T00:37:52.693431+0000","last_became_active":"2024-02-17T00:37:50.707097+0000","last_became_peered":"2024-02-17T00:37:50.707097+0000","last_unstale":"2024-02-17T00:37:52.693431+0000","last_undegraded":"2024-02-17T00:37:52.693431+0000","last_fullsized":"2024-02-17T00:37:52.693431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:30:26.693300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.694053+0000","last_change":"2024-02-17T00:37:49.694053+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.694053+0000","last_undegraded":"2024-02-17T00:37:49.694053+0000","last_fullsized":"2024-02-17T00:37:49.694053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.693986+0000","last_change":"2024-02-17T00:37:49.693986+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.693986+0000","last_undegraded":"2024-02-17T00:37:49.693986+0000","last_fullsized":"2024-02-17T00:37:49.693986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.685164+0000","last_change":"2024-02-17T00:37:49.685164+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.685164+0000","last_undegraded":"2024-02-17T00:37:49.685164+0000","last_fullsized":"2024-02-17T00:37:49.685164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688977+0000","last_change":"2024-02-17T00:37:49.688977+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688977+0000","last_undegraded":"2024-02-17T00:37:49.688977+0000","last_fullsized":"2024-02-17T00:37:49.688977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684339+0000","last_change":"2024-02-17T00:37:49.684339+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684339+0000","last_undegraded":"2024-02-17T00:37:49.684339+0000","last_fullsized":"2024-02-17T00:37:49.684339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693612+0000","last_change":"2024-02-17T00:37:51.715709+0000","last_active":"2024-02-17T00:37:52.693612+0000","last_peered":"2024-02-17T00:37:52.693612+0000","last_clean":"2024-02-17T00:37:52.693612+0000","last_became_active":"2024-02-17T00:37:51.715427+0000","last_became_peered":"2024-02-17T00:37:51.715427+0000","last_unstale":"2024-02-17T00:37:52.693612+0000","last_undegraded":"2024-02-17T00:37:52.693612+0000","last_fullsized":"2024-02-17T00:37:52.693612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:01:01.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.689251+0000","last_change":"2024-02-17T00:37:49.689251+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.689251+0000","last_undegraded":"2024-02-17T00:37:49.689251+0000","last_fullsized":"2024-02-17T00:37:49.689251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693673+0000","last_change":"2024-02-17T00:37:50.707462+0000","last_active":"2024-02-17T00:37:52.693673+0000","last_peered":"2024-02-17T00:37:52.693673+0000","last_clean":"2024-02-17T00:37:52.693673+0000","last_became_active":"2024-02-17T00:37:50.707079+0000","last_became_peered":"2024-02-17T00:37:50.707079+0000","last_unstale":"2024-02-17T00:37:52.693673+0000","last_undegraded":"2024-02-17T00:37:52.693673+0000","last_fullsized":"2024-02-17T00:37:52.693673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:48.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693584+0000","last_change":"2024-02-17T00:37:50.709902+0000","last_active":"2024-02-17T00:37:52.693584+0000","last_peered":"2024-02-17T00:37:52.693584+0000","last_clean":"2024-02-17T00:37:52.693584+0000","last_became_active":"2024-02-17T00:37:50.709574+0000","last_became_peered":"2024-02-17T00:37:50.709574+0000","last_unstale":"2024-02-17T00:37:52.693584+0000","last_undegraded":"2024-02-17T00:37:52.693584+0000","last_fullsized":"2024-02-17T00:37:52.693584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:58.955350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693416+0000","last_change":"2024-02-17T00:37:51.720548+0000","last_active":"2024-02-17T00:37:52.693416+0000","last_peered":"2024-02-17T00:37:52.693416+0000","last_clean":"2024-02-17T00:37:52.693416+0000","last_became_active":"2024-02-17T00:37:51.720050+0000","last_became_peered":"2024-02-17T00:37:51.720050+0000","last_unstale":"2024-02-17T00:37:52.693416+0000","last_undegraded":"2024-02-17T00:37:52.693416+0000","last_fullsized":"2024-02-17T00:37:52.693416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:41.301414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684832+0000","last_change":"2024-02-17T00:37:49.684832+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684832+0000","last_undegraded":"2024-02-17T00:37:49.684832+0000","last_fullsized":"2024-02-17T00:37:49.684832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.686737+0000","last_change":"2024-02-17T00:37:49.686737+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.686737+0000","last_undegraded":"2024-02-17T00:37:49.686737+0000","last_fullsized":"2024-02-17T00:37:49.686737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.688707+0000","last_change":"2024-02-17T00:37:49.688707+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.688707+0000","last_undegraded":"2024-02-17T00:37:49.688707+0000","last_fullsized":"2024-02-17T00:37:49.688707+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.684512+0000","last_change":"2024-02-17T00:37:49.684512+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.684512+0000","last_undegraded":"2024-02-17T00:37:49.684512+0000","last_fullsized":"2024-02-17T00:37:49.684512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T00:37:50.681530+0000","last_change":"2024-02-17T00:37:50.681530+0000","last_active":"2024-02-17T00:37:50.681530+0000","last_peered":"2024-02-17T00:37:50.681530+0000","last_clean":"2024-02-17T00:37:50.681530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:50.681530+0000","last_undegraded":"2024-02-17T00:37:50.681530+0000","last_fullsized":"2024-02-17T00:37:50.681530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-02-17T00:37:49.686790+0000","last_change":"2024-02-17T00:37:49.686790+0000","last_active":"2024-02-17T00:37:49.679104+0000","last_peered":"2024-02-17T00:37:49.679104+0000","last_clean":"2024-02-17T00:37:49.679104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T00:37:49.686790+0000","last_undegraded":"2024-02-17T00:37:49.686790+0000","last_fullsized":"2024-02-17T00:37:49.686790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-02-17T00:37:49.688966+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:37:49.688966+0000","last_peered":"2024-02-17T00:37:49.688966+0000","last_clean":"2024-02-17T00:37:49.688966+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:37:49.688966+0000","last_undegraded":"2024-02-17T00:37:49.688966+0000","last_fullsized":"2024-02-17T00:37:49.688966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68899999999999995}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54700000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":769295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34799999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.503}]},{"osd":1,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.377}]},{"osd":2,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45800000000000002}]},{"osd":6,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":172718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.622},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.751},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":178927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.316},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.497}]},{"osd":6,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.435},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.53300000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":763086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":178927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.374}]},{"osd":2,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.443}]},{"osd":3,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.628},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76700000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.629},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.0839999999999996,"5min":6.0839999999999996,"15min":6.0839999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-02-17T00:37:55.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-02-17T00:37:55.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.687592+0000', 'last_change': '2024-02-17T00:37:49.687592+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.687592+0000', 'last_undegraded': '2024-02-17T00:37:49.687592+0000', 'last_fullsized': '2024-02-17T00:37:49.687592+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-02-17T00:37:55.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685895+0000', 'last_change': '2024-02-17T00:37:49.685895+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685895+0000', 'last_undegraded': '2024-02-17T00:37:49.685895+0000', 'last_fullsized': '2024-02-17T00:37:49.685895+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.684296+0000', 'last_change': '2024-02-17T00:37:49.684296+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.684296+0000', 'last_undegraded': '2024-02-17T00:37:49.684296+0000', 'last_fullsized': '2024-02-17T00:37:49.684296+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.687383+0000', 'last_change': '2024-02-17T00:37:49.687383+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.687383+0000', 'last_undegraded': '2024-02-17T00:37:49.687383+0000', 'last_fullsized': '2024-02-17T00:37:49.687383+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-02-17T00:37:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.687745+0000', 'last_change': '2024-02-17T00:37:49.687745+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.687745+0000', 'last_undegraded': '2024-02-17T00:37:49.687745+0000', 'last_fullsized': '2024-02-17T00:37:49.687745+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.688575+0000', 'last_change': '2024-02-17T00:37:49.688575+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.688575+0000', 'last_undegraded': '2024-02-17T00:37:49.688575+0000', 'last_fullsized': '2024-02-17T00:37:49.688575+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685490+0000', 'last_change': '2024-02-17T00:37:49.685490+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685490+0000', 'last_undegraded': '2024-02-17T00:37:49.685490+0000', 'last_fullsized': '2024-02-17T00:37:49.685490+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-02-17T00:37:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.688701+0000', 'last_change': '2024-02-17T00:37:49.688701+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.688701+0000', 'last_undegraded': '2024-02-17T00:37:49.688701+0000', 'last_fullsized': '2024-02-17T00:37:49.688701+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685178+0000', 'last_change': '2024-02-17T00:37:49.685178+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685178+0000', 'last_undegraded': '2024-02-17T00:37:49.685178+0000', 'last_fullsized': '2024-02-17T00:37:49.685178+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.689184+0000', 'last_change': '2024-02-17T00:37:49.689184+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.689184+0000', 'last_undegraded': '2024-02-17T00:37:49.689184+0000', 'last_fullsized': '2024-02-17T00:37:49.689184+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-02-17T00:37:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.688878+0000', 'last_change': '2024-02-17T00:37:49.688878+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.688878+0000', 'last_undegraded': '2024-02-17T00:37:49.688878+0000', 'last_fullsized': '2024-02-17T00:37:49.688878+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685713+0000', 'last_change': '2024-02-17T00:37:49.685713+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685713+0000', 'last_undegraded': '2024-02-17T00:37:49.685713+0000', 'last_fullsized': '2024-02-17T00:37:49.685713+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685251+0000', 'last_change': '2024-02-17T00:37:49.685251+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685251+0000', 'last_undegraded': '2024-02-17T00:37:49.685251+0000', 'last_fullsized': '2024-02-17T00:37:49.685251+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-02-17T00:37:55.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685634+0000', 'last_change': '2024-02-17T00:37:49.685634+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685634+0000', 'last_undegraded': '2024-02-17T00:37:49.685634+0000', 'last_fullsized': '2024-02-17T00:37:49.685634+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.689788+0000', 'last_change': '2024-02-17T00:37:49.689788+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.689788+0000', 'last_undegraded': '2024-02-17T00:37:49.689788+0000', 'last_fullsized': '2024-02-17T00:37:49.689788+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.687376+0000', 'last_change': '2024-02-17T00:37:49.687376+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.687376+0000', 'last_undegraded': '2024-02-17T00:37:49.687376+0000', 'last_fullsized': '2024-02-17T00:37:49.687376+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-02-17T00:37:55.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.689211+0000', 'last_change': '2024-02-17T00:37:49.689211+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.689211+0000', 'last_undegraded': '2024-02-17T00:37:49.689211+0000', 'last_fullsized': '2024-02-17T00:37:49.689211+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.688536+0000', 'last_change': '2024-02-17T00:37:49.688536+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.688536+0000', 'last_undegraded': '2024-02-17T00:37:49.688536+0000', 'last_fullsized': '2024-02-17T00:37:49.688536+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.694053+0000', 'last_change': '2024-02-17T00:37:49.694053+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.694053+0000', 'last_undegraded': '2024-02-17T00:37:49.694053+0000', 'last_fullsized': '2024-02-17T00:37:49.694053+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T00:37:55.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.693986+0000', 'last_change': '2024-02-17T00:37:49.693986+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.693986+0000', 'last_undegraded': '2024-02-17T00:37:49.693986+0000', 'last_fullsized': '2024-02-17T00:37:49.693986+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.685164+0000', 'last_change': '2024-02-17T00:37:49.685164+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.685164+0000', 'last_undegraded': '2024-02-17T00:37:49.685164+0000', 'last_fullsized': '2024-02-17T00:37:49.685164+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.688977+0000', 'last_change': '2024-02-17T00:37:49.688977+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.688977+0000', 'last_undegraded': '2024-02-17T00:37:49.688977+0000', 'last_fullsized': '2024-02-17T00:37:49.688977+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T00:37:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.684339+0000', 'last_change': '2024-02-17T00:37:49.684339+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.684339+0000', 'last_undegraded': '2024-02-17T00:37:49.684339+0000', 'last_fullsized': '2024-02-17T00:37:49.684339+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.689251+0000', 'last_change': '2024-02-17T00:37:49.689251+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.689251+0000', 'last_undegraded': '2024-02-17T00:37:49.689251+0000', 'last_fullsized': '2024-02-17T00:37:49.689251+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-02-17T00:37:55.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.684832+0000', 'last_change': '2024-02-17T00:37:49.684832+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.684832+0000', 'last_undegraded': '2024-02-17T00:37:49.684832+0000', 'last_fullsized': '2024-02-17T00:37:49.684832+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.686737+0000', 'last_change': '2024-02-17T00:37:49.686737+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.686737+0000', 'last_undegraded': '2024-02-17T00:37:49.686737+0000', 'last_fullsized': '2024-02-17T00:37:49.686737+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.688707+0000', 'last_change': '2024-02-17T00:37:49.688707+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.688707+0000', 'last_undegraded': '2024-02-17T00:37:49.688707+0000', 'last_fullsized': '2024-02-17T00:37:49.688707+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-02-17T00:37:55.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.684512+0000', 'last_change': '2024-02-17T00:37:49.684512+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.684512+0000', 'last_undegraded': '2024-02-17T00:37:49.684512+0000', 'last_fullsized': '2024-02-17T00:37:49.684512+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T00:37:55.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-02-17T00:37:55.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T00:37:50.681530+0000', 'last_change': '2024-02-17T00:37:50.681530+0000', 'last_active': '2024-02-17T00:37:50.681530+0000', 'last_peered': '2024-02-17T00:37:50.681530+0000', 'last_clean': '2024-02-17T00:37:50.681530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:50.681530+0000', 'last_undegraded': '2024-02-17T00:37:50.681530+0000', 'last_fullsized': '2024-02-17T00:37:50.681530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:50.681530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T00:37:55.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-02-17T00:37:55.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-02-17T00:37:49.686790+0000', 'last_change': '2024-02-17T00:37:49.686790+0000', 'last_active': '2024-02-17T00:37:49.679104+0000', 'last_peered': '2024-02-17T00:37:49.679104+0000', 'last_clean': '2024-02-17T00:37:49.679104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T00:37:49.686790+0000', 'last_undegraded': '2024-02-17T00:37:49.686790+0000', 'last_fullsized': '2024-02-17T00:37:49.686790+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'last_clean_scrub_stamp': '2024-02-17T00:37:49.679104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T00:37:55.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T00:37:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.541+0000 7fee767ac640 1 Processor -- start 2024-02-17T00:37:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.541+0000 7fee767ac640 1 -- start start 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee767ac640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fee700b9580 0x7fee700d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee767ac640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee700d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee767ac640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee700d1fe0 con 0x7fee7015dad0 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee767ac640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700b7990 con 0x7fee700b9580 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee767ac640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700d2240 con 0x7fee700d32e0 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee6ffff640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fee7015dad0 0x7fee700d18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51772/0 (socket says 172.21.15.32:51772) 2024-02-17T00:37:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee6ffff640 1 -- 172.21.15.32:0/101965306 learned_addr learned my addr 172.21.15.32:0/101965306 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee74d49640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee700d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee6f7fe640 1 --2- 172.21.15.32:0/101965306 >> v2:172.21.15.39:3300/0 conn(0x7fee700b9580 0x7fee700d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.542+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701115999 0 0) 0x7fee700d1fe0 con 0x7fee7015dad0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee58003520 con 0x7fee7015dad0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2791357762 0 0) 0x7fee58003520 con 0x7fee7015dad0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 msgr2=0x7fee700d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee700d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 >> v2:172.21.15.39:3300/0 conn(0x7fee700b9580 msgr2=0x7fee700d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 --2- 172.21.15.32:0/101965306 >> v2:172.21.15.39:3300/0 conn(0x7fee700b9580 0x7fee700d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700d2520 con 0x7fee7015dad0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fee64001690 con 0x7fee7015dad0 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 >> v1:172.21.15.32:6789/0 conn(0x7fee7015dad0 legacy=0x7fee700d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee58004d00 0x7fee58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b7990 con 0x7fee58003970 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700d2240 con 0x7fee58004d00 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5800b980 con 0x7fee700d32e0 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6ffff640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6f7fe640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee74d49640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee58004d00 0x7fee58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6ffff640 1 -- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 msgr2=0x7fee580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6ffff640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6ffff640 1 -- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee58004d00 msgr2=0x7fee58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6ffff640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee58004d00 0x7fee58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6ffff640 1 -- 172.21.15.32:0/101965306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58003520 con 0x7fee58003970 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee74d49640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee58004d00 0x7fee58005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.543+0000 7fee6f7fe640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700d32e0 0x7fee580047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee6ffff640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee58003d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fee64007fd0 tx=0x7fee580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7832af1a2e42f0b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64005ad0 con 0x7fee58003970 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64005c30 con 0x7fee58003970 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee6effd640 1 -- 172.21.15.32:0/101965306 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6402c8d0 con 0x7fee58003970 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee767ac640 1 -- 172.21.15.32:0/101965306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 msgr2=0x7fee58003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee767ac640 1 --2- 172.21.15.32:0/101965306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee58003d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fee64007fd0 tx=0x7fee580057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.544+0000 7fee74d49640 1 -- 172.21.15.32:0/101965306 reap_dead start 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.545+0000 7fee767ac640 1 -- 172.21.15.32:0/101965306 shutdown_connections 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.545+0000 7fee767ac640 1 -- 172.21.15.32:0/101965306 >> 172.21.15.32:0/101965306 conn(0x7fee7006bfe0 msgr2=0x7fee7006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.545+0000 7fee767ac640 1 -- 172.21.15.32:0/101965306 shutdown_connections 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.545+0000 7fee767ac640 1 -- 172.21.15.32:0/101965306 wait complete. 2024-02-17T00:37:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.546+0000 7fee767ac640 1 Processor -- start 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.546+0000 7fee767ac640 1 -- start start 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee700cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee70151d30 0x7fee700ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700cae60 0x7fee700cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7014e380 con 0x7fee58003970 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700cc730 con 0x7fee70151d30 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7015e810 con 0x7fee700cae60 2024-02-17T00:37:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee700cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee700cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42220/0 (socket says 172.21.15.32:42220) 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 -- 172.21.15.32:0/2442203946 learned_addr learned my addr 172.21.15.32:0/2442203946 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee74d49640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700cae60 0x7fee700cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6f7fe640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee70151d30 0x7fee700ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 -- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700cae60 msgr2=0x7fee700cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700cae60 0x7fee700cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 -- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee70151d30 msgr2=0x7fee700ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee70151d30 0x7fee700ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 -- 172.21.15.32:0/2442203946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700cc980 con 0x7fee58003970 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6ffff640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee700cc1b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fee6402c540 tx=0x7fee64001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6403c070 con 0x7fee58003970 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6402cae0 con 0x7fee58003970 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee700ccc60 con 0x7fee58003970 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6402ce70 con 0x7fee58003970 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.547+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7015e4a0 con 0x7fee58003970 2024-02-17T00:37:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.548+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee70074bb0 con 0x7fee58003970 2024-02-17T00:37:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.549+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fee64032070 con 0x7fee58003970 2024-02-17T00:37:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.549+0000 7fee6cff9640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fee5c06b840 0x7fee5c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.549+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fee640ab3f0 con 0x7fee58003970 2024-02-17T00:37:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.549+0000 7fee6f7fe640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fee5c06b840 0x7fee5c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.550+0000 7fee6f7fe640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fee5c06b840 0x7fee5c06dd00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee700d0bd0 tx=0x7fee60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.553+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee64075d10 con 0x7fee58003970 2024-02-17T00:37:55.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.806+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fee70159120 con 0x7fee58003970 2024-02-17T00:37:55.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.806+0000 7fee6cff9640 1 -- 172.21.15.32:0/2442203946 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1334 (secure 0 0 0) 0x7fee640793d0 con 0x7fee58003970 2024-02-17T00:37:55.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:55.808 INFO:teuthology.orchestra.run.smithi032.stdout:{"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":102,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1708130184,"num_in_osds":8,"osd_in_since":1708130175,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":58},{"state_name":"creating+peering","count":29},{"state_name":"active+clean","count":10}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590438,"bytes_used":260071424,"bytes_avail":772834041856,"bytes_total":773094113280,"unknown_pgs_ratio":0.59793812036514282,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":239,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5349}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-02-17T00:37:33.961161+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T00:37:55.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fee5c06b840 msgr2=0x7fee5c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fee5c06b840 0x7fee5c06dd00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee700d0bd0 tx=0x7fee60008040 comp rx=0 tx=0).stop 2024-02-17T00:37:55.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 msgr2=0x7fee700cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee700cc1b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fee6402c540 tx=0x7fee64001a20 comp rx=0 tx=0).stop 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 shutdown_connections 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fee5c06b840 0x7fee5c06dd00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fee700cae60 0x7fee700cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee70151d30 0x7fee700ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 --2- 172.21.15.32:0/2442203946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee58003970 0x7fee700cc1b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 >> 172.21.15.32:0/2442203946 conn(0x7fee7006bfe0 msgr2=0x7fee700d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 shutdown_connections 2024-02-17T00:37:55.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.808+0000 7fee767ac640 1 -- 172.21.15.32:0/2442203946 wait complete. 2024-02-17T00:37:55.821 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-17T00:37:55.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:55.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.920+0000 7fcd29039640 1 Processor -- start 2024-02-17T00:37:55.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.920+0000 7fcd29039640 1 -- start start 2024-02-17T00:37:55.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd29039640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 0x7fcd240cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd29039640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd240ce2b0 con 0x7fcd240d0990 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd29039640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2415e960 con 0x7fcd2415de30 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd29039640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2415ef20 con 0x7fcd2415da50 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd2359e640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcd240d0990 0x7fcd240d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51782/0 (socket says 172.21.15.32:51782) 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd2359e640 1 -- 172.21.15.32:0/1364719033 learned_addr learned my addr 172.21.15.32:0/1364719033 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 0x7fcd240cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354712466 0 0) 0x7fcd240ce2b0 con 0x7fcd240d0990 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.921+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c003520 con 0x7fcd240d0990 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 209762120 0 0) 0x7fcd0c003520 con 0x7fcd240d0990 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 msgr2=0x7fcd240cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 0x7fcd240cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 >> v1:172.21.15.39:6789/0 conn(0x7fcd2415de30 legacy=0x7fcd240d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2415ec40 con 0x7fcd240d0990 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fcd140019f0 con 0x7fcd240d0990 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 >> v1:172.21.15.32:6789/0 conn(0x7fcd240d0990 legacy=0x7fcd240d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0039a0 0x7fcd0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c0047c0 0x7fcd0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 0x7fcd0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2415ef20 con 0x7fcd0c0039a0 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c00ba30 con 0x7fcd0c0047c0 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c00bbf0 con 0x7fcd2415da50 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0039a0 0x7fcd0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd2359e640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 0x7fcd0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd2259c640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c0047c0 0x7fcd0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd22d9d640 1 -- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 msgr2=0x7fcd0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd2415da50 0x7fcd0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd22d9d640 1 -- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c0047c0 msgr2=0x7fcd0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0c0047c0 0x7fcd0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.922+0000 7fcd22d9d640 1 -- 172.21.15.32:0/1364719033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c003520 con 0x7fcd0c0039a0 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.923+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0039a0 0x7fcd0c003dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009a90 tx=0x7fcd0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e87295e9d3f0a6f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.923+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c02c680 con 0x7fcd0c0039a0 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.923+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c02c7e0 con 0x7fcd0c0039a0 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.923+0000 7fcd21d9b640 1 -- 172.21.15.32:0/1364719033 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c02cb70 con 0x7fcd0c0039a0 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd29039640 1 -- 172.21.15.32:0/1364719033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0039a0 msgr2=0x7fcd0c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd29039640 1 --2- 172.21.15.32:0/1364719033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0c0039a0 0x7fcd0c003dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009a90 tx=0x7fcd0c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd2359e640 1 -- 172.21.15.32:0/1364719033 reap_dead start 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd29039640 1 -- 172.21.15.32:0/1364719033 shutdown_connections 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd29039640 1 -- 172.21.15.32:0/1364719033 >> 172.21.15.32:0/1364719033 conn(0x7fcd24072290 msgr2=0x7fcd24072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd29039640 1 -- 172.21.15.32:0/1364719033 shutdown_connections 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.924+0000 7fcd29039640 1 -- 172.21.15.32:0/1364719033 wait complete. 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.925+0000 7fcd29039640 1 Processor -- start 2024-02-17T00:37:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.925+0000 7fcd29039640 1 -- start start 2024-02-17T00:37:55.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd29039640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c0039a0 0x7fcd241f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd29039640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 0x7fcd240cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd29039640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd240cbfd0 0x7fcd240cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd29039640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241f7d30 con 0x7fcd241550f0 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd29039640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240cd820 con 0x7fcd240cbfd0 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd29039640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd24154b40 con 0x7fcd0c0039a0 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 0x7fcd240cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 0x7fcd240cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42240/0 (socket says 172.21.15.32:42240) 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 -- 172.21.15.32:0/2318436161 learned_addr learned my addr 172.21.15.32:0/2318436161 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c0039a0 0x7fcd241f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2359e640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd240cbfd0 0x7fcd240cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 -- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c0039a0 msgr2=0x7fcd241f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c0039a0 0x7fcd241f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 -- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd240cbfd0 msgr2=0x7fcd240cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd240cbfd0 0x7fcd240cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 -- 172.21.15.32:0/2318436161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd241f7490 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.926+0000 7fcd2259c640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 0x7fcd240cd2e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800f5f0 tx=0x7fcd1800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.927+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180052e0 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.927+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18005440 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.927+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd241f7770 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.927+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18003810 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.927+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd240cab40 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.928+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd240ca980 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.928+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcd18003970 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.929+0000 7fcd0b7fe640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcd1006b810 0x7fcd1006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.929+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcd1808a070 con 0x7fcd241550f0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.929+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcd1006b810 0x7fcd1006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.929+0000 7fcd22d9d640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcd1006b810 0x7fcd1006dcd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c036000 tx=0x7fcd1c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:55.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:55.933+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd180549b0 con 0x7fcd241550f0 2024-02-17T00:37:56.030 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T00:37:56.027+0000 7ffa4c855640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T00:37:56.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.108+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd240d2450 con 0x7fcd1006b810 2024-02-17T00:37:56.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.116+0000 7fcd0b7fe640 1 -- 172.21.15.32:0/2318436161 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289435 (secure 0 0 0) 0x7fcd1c004040 con 0x7fcd1006b810 2024-02-17T00:37:56.121 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:56.122 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:56.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcd1006b810 msgr2=0x7fcd1006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:56.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcd1006b810 0x7fcd1006dcd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c036000 tx=0x7fcd1c030000 comp rx=0 tx=0).stop 2024-02-17T00:37:56.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 msgr2=0x7fcd240cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:56.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 0x7fcd240cd2e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800f5f0 tx=0x7fcd1800fab0 comp rx=0 tx=0).stop 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 shutdown_connections 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd240cbfd0 0x7fcd240cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd241550f0 0x7fcd240cd2e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fcd1006b810 0x7fcd1006dcd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 --2- 172.21.15.32:0/2318436161 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcd0c0039a0 0x7fcd241f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 >> 172.21.15.32:0/2318436161 conn(0x7fcd24072290 msgr2=0x7fcd240d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 shutdown_connections 2024-02-17T00:37:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:56.119+0000 7fcd29039640 1 -- 172.21.15.32:0/2318436161 wait complete. 2024-02-17T00:37:56.132 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-02-17T00:37:55.966614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254328,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720392,"statfs":{"total":773094113280,"available":772833681408,"internally_reserved":0,"allocated":4988928,"data_stored":2781180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001483"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140133+0000","last_change":"2024-02-17T00:37:51.717625+0000","last_active":"2024-02-17T00:37:54.140133+0000","last_peered":"2024-02-17T00:37:54.140133+0000","last_clean":"2024-02-17T00:37:54.140133+0000","last_became_active":"2024-02-17T00:37:51.714612+0000","last_became_peered":"2024-02-17T00:37:51.714612+0000","last_unstale":"2024-02-17T00:37:54.140133+0000","last_undegraded":"2024-02-17T00:37:54.140133+0000","last_fullsized":"2024-02-17T00:37:54.140133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:02:59.384871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692701+0000","last_change":"2024-02-17T00:37:51.710917+0000","last_active":"2024-02-17T00:37:52.692701+0000","last_peered":"2024-02-17T00:37:52.692701+0000","last_clean":"2024-02-17T00:37:52.692701+0000","last_became_active":"2024-02-17T00:37:51.710468+0000","last_became_peered":"2024-02-17T00:37:51.710468+0000","last_unstale":"2024-02-17T00:37:52.692701+0000","last_undegraded":"2024-02-17T00:37:52.692701+0000","last_fullsized":"2024-02-17T00:37:52.692701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:27:59.319843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139723+0000","last_change":"2024-02-17T00:37:51.708158+0000","last_active":"2024-02-17T00:37:54.139723+0000","last_peered":"2024-02-17T00:37:54.139723+0000","last_clean":"2024-02-17T00:37:54.139723+0000","last_became_active":"2024-02-17T00:37:51.707869+0000","last_became_peered":"2024-02-17T00:37:51.707869+0000","last_unstale":"2024-02-17T00:37:54.139723+0000","last_undegraded":"2024-02-17T00:37:54.139723+0000","last_fullsized":"2024-02-17T00:37:54.139723+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:00:22.916904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139796+0000","last_change":"2024-02-17T00:37:51.721194+0000","last_active":"2024-02-17T00:37:54.139796+0000","last_peered":"2024-02-17T00:37:54.139796+0000","last_clean":"2024-02-17T00:37:54.139796+0000","last_became_active":"2024-02-17T00:37:51.720870+0000","last_became_peered":"2024-02-17T00:37:51.720870+0000","last_unstale":"2024-02-17T00:37:54.139796+0000","last_undegraded":"2024-02-17T00:37:54.139796+0000","last_fullsized":"2024-02-17T00:37:54.139796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:37:41.785028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693441+0000","last_change":"2024-02-17T00:37:51.711548+0000","last_active":"2024-02-17T00:37:52.693441+0000","last_peered":"2024-02-17T00:37:52.693441+0000","last_clean":"2024-02-17T00:37:52.693441+0000","last_became_active":"2024-02-17T00:37:51.711260+0000","last_became_peered":"2024-02-17T00:37:51.711260+0000","last_unstale":"2024-02-17T00:37:52.693441+0000","last_undegraded":"2024-02-17T00:37:52.693441+0000","last_fullsized":"2024-02-17T00:37:52.693441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:45:34.889730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692895+0000","last_change":"2024-02-17T00:37:51.705032+0000","last_active":"2024-02-17T00:37:52.692895+0000","last_peered":"2024-02-17T00:37:52.692895+0000","last_clean":"2024-02-17T00:37:52.692895+0000","last_became_active":"2024-02-17T00:37:51.704373+0000","last_became_peered":"2024-02-17T00:37:51.704373+0000","last_unstale":"2024-02-17T00:37:52.692895+0000","last_undegraded":"2024-02-17T00:37:52.692895+0000","last_fullsized":"2024-02-17T00:37:52.692895+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:10:02.739213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692573+0000","last_change":"2024-02-17T00:37:51.712389+0000","last_active":"2024-02-17T00:37:52.692573+0000","last_peered":"2024-02-17T00:37:52.692573+0000","last_clean":"2024-02-17T00:37:52.692573+0000","last_became_active":"2024-02-17T00:37:51.712088+0000","last_became_peered":"2024-02-17T00:37:51.712088+0000","last_unstale":"2024-02-17T00:37:52.692573+0000","last_undegraded":"2024-02-17T00:37:52.692573+0000","last_fullsized":"2024-02-17T00:37:52.692573+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:24:06.413498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139328+0000","last_change":"2024-02-17T00:37:51.719469+0000","last_active":"2024-02-17T00:37:54.139328+0000","last_peered":"2024-02-17T00:37:54.139328+0000","last_clean":"2024-02-17T00:37:54.139328+0000","last_became_active":"2024-02-17T00:37:51.719168+0000","last_became_peered":"2024-02-17T00:37:51.719168+0000","last_unstale":"2024-02-17T00:37:54.139328+0000","last_undegraded":"2024-02-17T00:37:54.139328+0000","last_fullsized":"2024-02-17T00:37:54.139328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:50.004321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693811+0000","last_change":"2024-02-17T00:37:51.714730+0000","last_active":"2024-02-17T00:37:52.693811+0000","last_peered":"2024-02-17T00:37:52.693811+0000","last_clean":"2024-02-17T00:37:52.693811+0000","last_became_active":"2024-02-17T00:37:51.714431+0000","last_became_peered":"2024-02-17T00:37:51.714431+0000","last_unstale":"2024-02-17T00:37:52.693811+0000","last_undegraded":"2024-02-17T00:37:52.693811+0000","last_fullsized":"2024-02-17T00:37:52.693811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:21:44.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692842+0000","last_change":"2024-02-17T00:37:51.720581+0000","last_active":"2024-02-17T00:37:52.692842+0000","last_peered":"2024-02-17T00:37:52.692842+0000","last_clean":"2024-02-17T00:37:52.692842+0000","last_became_active":"2024-02-17T00:37:51.720314+0000","last_became_peered":"2024-02-17T00:37:51.720314+0000","last_unstale":"2024-02-17T00:37:52.692842+0000","last_undegraded":"2024-02-17T00:37:52.692842+0000","last_fullsized":"2024-02-17T00:37:52.692842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:55:37.147765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693629+0000","last_change":"2024-02-17T00:37:51.715664+0000","last_active":"2024-02-17T00:37:53.693629+0000","last_peered":"2024-02-17T00:37:53.693629+0000","last_clean":"2024-02-17T00:37:53.693629+0000","last_became_active":"2024-02-17T00:37:51.715127+0000","last_became_peered":"2024-02-17T00:37:51.715127+0000","last_unstale":"2024-02-17T00:37:53.693629+0000","last_undegraded":"2024-02-17T00:37:53.693629+0000","last_fullsized":"2024-02-17T00:37:53.693629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:36:50.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693557+0000","last_change":"2024-02-17T00:37:51.718977+0000","last_active":"2024-02-17T00:37:52.693557+0000","last_peered":"2024-02-17T00:37:52.693557+0000","last_clean":"2024-02-17T00:37:52.693557+0000","last_became_active":"2024-02-17T00:37:51.718689+0000","last_became_peered":"2024-02-17T00:37:51.718689+0000","last_unstale":"2024-02-17T00:37:52.693557+0000","last_undegraded":"2024-02-17T00:37:52.693557+0000","last_fullsized":"2024-02-17T00:37:52.693557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:39:22.812319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692667+0000","last_change":"2024-02-17T00:37:51.709096+0000","last_active":"2024-02-17T00:37:52.692667+0000","last_peered":"2024-02-17T00:37:52.692667+0000","last_clean":"2024-02-17T00:37:52.692667+0000","last_became_active":"2024-02-17T00:37:51.708813+0000","last_became_peered":"2024-02-17T00:37:51.708813+0000","last_unstale":"2024-02-17T00:37:52.692667+0000","last_undegraded":"2024-02-17T00:37:52.692667+0000","last_fullsized":"2024-02-17T00:37:52.692667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:07:37.127918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138755+0000","last_change":"2024-02-17T00:37:51.697693+0000","last_active":"2024-02-17T00:37:54.138755+0000","last_peered":"2024-02-17T00:37:54.138755+0000","last_clean":"2024-02-17T00:37:54.138755+0000","last_became_active":"2024-02-17T00:37:51.697444+0000","last_became_peered":"2024-02-17T00:37:51.697444+0000","last_unstale":"2024-02-17T00:37:54.138755+0000","last_undegraded":"2024-02-17T00:37:54.138755+0000","last_fullsized":"2024-02-17T00:37:54.138755+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:22:43.429747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138719+0000","last_change":"2024-02-17T00:37:51.702072+0000","last_active":"2024-02-17T00:37:54.138719+0000","last_peered":"2024-02-17T00:37:54.138719+0000","last_clean":"2024-02-17T00:37:54.138719+0000","last_became_active":"2024-02-17T00:37:51.701817+0000","last_became_peered":"2024-02-17T00:37:51.701817+0000","last_unstale":"2024-02-17T00:37:54.138719+0000","last_undegraded":"2024-02-17T00:37:54.138719+0000","last_fullsized":"2024-02-17T00:37:54.138719+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:11.319762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692518+0000","last_change":"2024-02-17T00:37:51.722844+0000","last_active":"2024-02-17T00:37:52.692518+0000","last_peered":"2024-02-17T00:37:52.692518+0000","last_clean":"2024-02-17T00:37:52.692518+0000","last_became_active":"2024-02-17T00:37:51.722561+0000","last_became_peered":"2024-02-17T00:37:51.722561+0000","last_unstale":"2024-02-17T00:37:52.692518+0000","last_undegraded":"2024-02-17T00:37:52.692518+0000","last_fullsized":"2024-02-17T00:37:52.692518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:13:25.617988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139384+0000","last_change":"2024-02-17T00:37:51.709647+0000","last_active":"2024-02-17T00:37:54.139384+0000","last_peered":"2024-02-17T00:37:54.139384+0000","last_clean":"2024-02-17T00:37:54.139384+0000","last_became_active":"2024-02-17T00:37:51.709390+0000","last_became_peered":"2024-02-17T00:37:51.709390+0000","last_unstale":"2024-02-17T00:37:54.139384+0000","last_undegraded":"2024-02-17T00:37:54.139384+0000","last_fullsized":"2024-02-17T00:37:54.139384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:20:10.535744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139269+0000","last_change":"2024-02-17T00:37:51.713338+0000","last_active":"2024-02-17T00:37:54.139269+0000","last_peered":"2024-02-17T00:37:54.139269+0000","last_clean":"2024-02-17T00:37:54.139269+0000","last_became_active":"2024-02-17T00:37:51.713067+0000","last_became_peered":"2024-02-17T00:37:51.713067+0000","last_unstale":"2024-02-17T00:37:54.139269+0000","last_undegraded":"2024-02-17T00:37:54.139269+0000","last_fullsized":"2024-02-17T00:37:54.139269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:20:46.149412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139850+0000","last_change":"2024-02-17T00:37:51.715816+0000","last_active":"2024-02-17T00:37:54.139850+0000","last_peered":"2024-02-17T00:37:54.139850+0000","last_clean":"2024-02-17T00:37:54.139850+0000","last_became_active":"2024-02-17T00:37:51.715520+0000","last_became_peered":"2024-02-17T00:37:51.715520+0000","last_unstale":"2024-02-17T00:37:54.139850+0000","last_undegraded":"2024-02-17T00:37:54.139850+0000","last_fullsized":"2024-02-17T00:37:54.139850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:54:58.706505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693319+0000","last_change":"2024-02-17T00:37:51.720407+0000","last_active":"2024-02-17T00:37:53.693319+0000","last_peered":"2024-02-17T00:37:53.693319+0000","last_clean":"2024-02-17T00:37:53.693319+0000","last_became_active":"2024-02-17T00:37:51.720105+0000","last_became_peered":"2024-02-17T00:37:51.720105+0000","last_unstale":"2024-02-17T00:37:53.693319+0000","last_undegraded":"2024-02-17T00:37:53.693319+0000","last_fullsized":"2024-02-17T00:37:53.693319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:27:59.319843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693503+0000","last_change":"2024-02-17T00:37:51.723237+0000","last_active":"2024-02-17T00:37:53.693503+0000","last_peered":"2024-02-17T00:37:53.693503+0000","last_clean":"2024-02-17T00:37:53.693503+0000","last_became_active":"2024-02-17T00:37:51.721350+0000","last_became_peered":"2024-02-17T00:37:51.721350+0000","last_unstale":"2024-02-17T00:37:53.693503+0000","last_undegraded":"2024-02-17T00:37:53.693503+0000","last_fullsized":"2024-02-17T00:37:53.693503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:10:02.739213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693231+0000","last_change":"2024-02-17T00:37:51.712808+0000","last_active":"2024-02-17T00:37:53.693231+0000","last_peered":"2024-02-17T00:37:53.693231+0000","last_clean":"2024-02-17T00:37:53.693231+0000","last_became_active":"2024-02-17T00:37:51.712523+0000","last_became_peered":"2024-02-17T00:37:51.712523+0000","last_unstale":"2024-02-17T00:37:53.693231+0000","last_undegraded":"2024-02-17T00:37:53.693231+0000","last_fullsized":"2024-02-17T00:37:53.693231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:54:58.706505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138851+0000","last_change":"2024-02-17T00:37:51.706785+0000","last_active":"2024-02-17T00:37:54.138851+0000","last_peered":"2024-02-17T00:37:54.138851+0000","last_clean":"2024-02-17T00:37:54.138851+0000","last_became_active":"2024-02-17T00:37:51.706375+0000","last_became_peered":"2024-02-17T00:37:51.706375+0000","last_unstale":"2024-02-17T00:37:54.138851+0000","last_undegraded":"2024-02-17T00:37:54.138851+0000","last_fullsized":"2024-02-17T00:37:54.138851+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:47:52.017880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139393+0000","last_change":"2024-02-17T00:37:51.718214+0000","last_active":"2024-02-17T00:37:54.139393+0000","last_peered":"2024-02-17T00:37:54.139393+0000","last_clean":"2024-02-17T00:37:54.139393+0000","last_became_active":"2024-02-17T00:37:51.717689+0000","last_became_peered":"2024-02-17T00:37:51.717689+0000","last_unstale":"2024-02-17T00:37:54.139393+0000","last_undegraded":"2024-02-17T00:37:54.139393+0000","last_fullsized":"2024-02-17T00:37:54.139393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:02:20.798959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139126+0000","last_change":"2024-02-17T00:37:51.704125+0000","last_active":"2024-02-17T00:37:54.139126+0000","last_peered":"2024-02-17T00:37:54.139126+0000","last_clean":"2024-02-17T00:37:54.139126+0000","last_became_active":"2024-02-17T00:37:51.703615+0000","last_became_peered":"2024-02-17T00:37:51.703615+0000","last_unstale":"2024-02-17T00:37:54.139126+0000","last_undegraded":"2024-02-17T00:37:54.139126+0000","last_fullsized":"2024-02-17T00:37:54.139126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:03:59.772931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139584+0000","last_change":"2024-02-17T00:37:51.713824+0000","last_active":"2024-02-17T00:37:54.139584+0000","last_peered":"2024-02-17T00:37:54.139584+0000","last_clean":"2024-02-17T00:37:54.139584+0000","last_became_active":"2024-02-17T00:37:51.713450+0000","last_became_peered":"2024-02-17T00:37:51.713450+0000","last_unstale":"2024-02-17T00:37:54.139584+0000","last_undegraded":"2024-02-17T00:37:54.139584+0000","last_fullsized":"2024-02-17T00:37:54.139584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:18:41.266050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693730+0000","last_change":"2024-02-17T00:37:51.715911+0000","last_active":"2024-02-17T00:37:53.693730+0000","last_peered":"2024-02-17T00:37:53.693730+0000","last_clean":"2024-02-17T00:37:53.693730+0000","last_became_active":"2024-02-17T00:37:51.715549+0000","last_became_peered":"2024-02-17T00:37:51.715549+0000","last_unstale":"2024-02-17T00:37:53.693730+0000","last_undegraded":"2024-02-17T00:37:53.693730+0000","last_fullsized":"2024-02-17T00:37:53.693730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:37:15.067883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692761+0000","last_change":"2024-02-17T00:37:51.721791+0000","last_active":"2024-02-17T00:37:52.692761+0000","last_peered":"2024-02-17T00:37:52.692761+0000","last_clean":"2024-02-17T00:37:52.692761+0000","last_became_active":"2024-02-17T00:37:51.721528+0000","last_became_peered":"2024-02-17T00:37:51.721528+0000","last_unstale":"2024-02-17T00:37:52.692761+0000","last_undegraded":"2024-02-17T00:37:52.692761+0000","last_fullsized":"2024-02-17T00:37:52.692761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:53:49.192425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138909+0000","last_change":"2024-02-17T00:37:51.707329+0000","last_active":"2024-02-17T00:37:54.138909+0000","last_peered":"2024-02-17T00:37:54.138909+0000","last_clean":"2024-02-17T00:37:54.138909+0000","last_became_active":"2024-02-17T00:37:51.706973+0000","last_became_peered":"2024-02-17T00:37:51.706973+0000","last_unstale":"2024-02-17T00:37:54.138909+0000","last_undegraded":"2024-02-17T00:37:54.138909+0000","last_fullsized":"2024-02-17T00:37:54.138909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:54:46.360178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139257+0000","last_change":"2024-02-17T00:37:51.707734+0000","last_active":"2024-02-17T00:37:54.139257+0000","last_peered":"2024-02-17T00:37:54.139257+0000","last_clean":"2024-02-17T00:37:54.139257+0000","last_became_active":"2024-02-17T00:37:51.707296+0000","last_became_peered":"2024-02-17T00:37:51.707296+0000","last_unstale":"2024-02-17T00:37:54.139257+0000","last_undegraded":"2024-02-17T00:37:54.139257+0000","last_fullsized":"2024-02-17T00:37:54.139257+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:20:04.075543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692594+0000","last_change":"2024-02-17T00:37:51.711731+0000","last_active":"2024-02-17T00:37:52.692594+0000","last_peered":"2024-02-17T00:37:52.692594+0000","last_clean":"2024-02-17T00:37:52.692594+0000","last_became_active":"2024-02-17T00:37:51.711448+0000","last_became_peered":"2024-02-17T00:37:51.711448+0000","last_unstale":"2024-02-17T00:37:52.692594+0000","last_undegraded":"2024-02-17T00:37:52.692594+0000","last_fullsized":"2024-02-17T00:37:52.692594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:53:51.108087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139542+0000","last_change":"2024-02-17T00:37:51.719992+0000","last_active":"2024-02-17T00:37:54.139542+0000","last_peered":"2024-02-17T00:37:54.139542+0000","last_clean":"2024-02-17T00:37:54.139542+0000","last_became_active":"2024-02-17T00:37:51.719733+0000","last_became_peered":"2024-02-17T00:37:51.719733+0000","last_unstale":"2024-02-17T00:37:54.139542+0000","last_undegraded":"2024-02-17T00:37:54.139542+0000","last_fullsized":"2024-02-17T00:37:54.139542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:42:36.450689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139102+0000","last_change":"2024-02-17T00:37:51.697017+0000","last_active":"2024-02-17T00:37:54.139102+0000","last_peered":"2024-02-17T00:37:54.139102+0000","last_clean":"2024-02-17T00:37:54.139102+0000","last_became_active":"2024-02-17T00:37:51.696734+0000","last_became_peered":"2024-02-17T00:37:51.696734+0000","last_unstale":"2024-02-17T00:37:54.139102+0000","last_undegraded":"2024-02-17T00:37:54.139102+0000","last_fullsized":"2024-02-17T00:37:54.139102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:26:51.731446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139066+0000","last_change":"2024-02-17T00:37:50.700432+0000","last_active":"2024-02-17T00:37:54.139066+0000","last_peered":"2024-02-17T00:37:54.139066+0000","last_clean":"2024-02-17T00:37:54.139066+0000","last_became_active":"2024-02-17T00:37:50.700148+0000","last_became_peered":"2024-02-17T00:37:50.700148+0000","last_unstale":"2024-02-17T00:37:54.139066+0000","last_undegraded":"2024-02-17T00:37:54.139066+0000","last_fullsized":"2024-02-17T00:37:54.139066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:02:52.343817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692539+0000","last_change":"2024-02-17T00:37:51.708681+0000","last_active":"2024-02-17T00:37:52.692539+0000","last_peered":"2024-02-17T00:37:52.692539+0000","last_clean":"2024-02-17T00:37:52.692539+0000","last_became_active":"2024-02-17T00:37:51.708402+0000","last_became_peered":"2024-02-17T00:37:51.708402+0000","last_unstale":"2024-02-17T00:37:52.692539+0000","last_undegraded":"2024-02-17T00:37:52.692539+0000","last_fullsized":"2024-02-17T00:37:52.692539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:57:25.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692632+0000","last_change":"2024-02-17T00:37:50.700499+0000","last_active":"2024-02-17T00:37:52.692632+0000","last_peered":"2024-02-17T00:37:52.692632+0000","last_clean":"2024-02-17T00:37:52.692632+0000","last_became_active":"2024-02-17T00:37:50.700107+0000","last_became_peered":"2024-02-17T00:37:50.700107+0000","last_unstale":"2024-02-17T00:37:52.692632+0000","last_undegraded":"2024-02-17T00:37:52.692632+0000","last_fullsized":"2024-02-17T00:37:52.692632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:42:21.569321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139474+0000","last_change":"2024-02-17T00:37:51.698298+0000","last_active":"2024-02-17T00:37:54.139474+0000","last_peered":"2024-02-17T00:37:54.139474+0000","last_clean":"2024-02-17T00:37:54.139474+0000","last_became_active":"2024-02-17T00:37:51.698030+0000","last_became_peered":"2024-02-17T00:37:51.698030+0000","last_unstale":"2024-02-17T00:37:54.139474+0000","last_undegraded":"2024-02-17T00:37:54.139474+0000","last_fullsized":"2024-02-17T00:37:54.139474+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:59:28.032618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139668+0000","last_change":"2024-02-17T00:37:50.701177+0000","last_active":"2024-02-17T00:37:54.139668+0000","last_peered":"2024-02-17T00:37:54.139668+0000","last_clean":"2024-02-17T00:37:54.139668+0000","last_became_active":"2024-02-17T00:37:50.700836+0000","last_became_peered":"2024-02-17T00:37:50.700836+0000","last_unstale":"2024-02-17T00:37:54.139668+0000","last_undegraded":"2024-02-17T00:37:54.139668+0000","last_fullsized":"2024-02-17T00:37:54.139668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:06:48.764698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692819+0000","last_change":"2024-02-17T00:37:51.707948+0000","last_active":"2024-02-17T00:37:52.692819+0000","last_peered":"2024-02-17T00:37:52.692819+0000","last_clean":"2024-02-17T00:37:52.692819+0000","last_became_active":"2024-02-17T00:37:51.707621+0000","last_became_peered":"2024-02-17T00:37:51.707621+0000","last_unstale":"2024-02-17T00:37:52.692819+0000","last_undegraded":"2024-02-17T00:37:52.692819+0000","last_fullsized":"2024-02-17T00:37:52.692819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:31.093234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138983+0000","last_change":"2024-02-17T00:37:50.705103+0000","last_active":"2024-02-17T00:37:54.138983+0000","last_peered":"2024-02-17T00:37:54.138983+0000","last_clean":"2024-02-17T00:37:54.138983+0000","last_became_active":"2024-02-17T00:37:50.704781+0000","last_became_peered":"2024-02-17T00:37:50.704781+0000","last_unstale":"2024-02-17T00:37:54.138983+0000","last_undegraded":"2024-02-17T00:37:54.138983+0000","last_fullsized":"2024-02-17T00:37:54.138983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:50.198103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139593+0000","last_change":"2024-02-17T00:37:51.717967+0000","last_active":"2024-02-17T00:37:54.139593+0000","last_peered":"2024-02-17T00:37:54.139593+0000","last_clean":"2024-02-17T00:37:54.139593+0000","last_became_active":"2024-02-17T00:37:51.714198+0000","last_became_peered":"2024-02-17T00:37:51.714198+0000","last_unstale":"2024-02-17T00:37:54.139593+0000","last_undegraded":"2024-02-17T00:37:54.139593+0000","last_fullsized":"2024-02-17T00:37:54.139593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:06:52.689176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138700+0000","last_change":"2024-02-17T00:37:50.707754+0000","last_active":"2024-02-17T00:37:54.138700+0000","last_peered":"2024-02-17T00:37:54.138700+0000","last_clean":"2024-02-17T00:37:54.138700+0000","last_became_active":"2024-02-17T00:37:50.707452+0000","last_became_peered":"2024-02-17T00:37:50.707452+0000","last_unstale":"2024-02-17T00:37:54.138700+0000","last_undegraded":"2024-02-17T00:37:54.138700+0000","last_fullsized":"2024-02-17T00:37:54.138700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:29.190786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693238+0000","last_change":"2024-02-17T00:37:51.713383+0000","last_active":"2024-02-17T00:37:53.693238+0000","last_peered":"2024-02-17T00:37:53.693238+0000","last_clean":"2024-02-17T00:37:53.693238+0000","last_became_active":"2024-02-17T00:37:51.713092+0000","last_became_peered":"2024-02-17T00:37:51.713092+0000","last_unstale":"2024-02-17T00:37:53.693238+0000","last_undegraded":"2024-02-17T00:37:53.693238+0000","last_fullsized":"2024-02-17T00:37:53.693238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:21:21.672973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692529+0000","last_change":"2024-02-17T00:37:50.709448+0000","last_active":"2024-02-17T00:37:52.692529+0000","last_peered":"2024-02-17T00:37:52.692529+0000","last_clean":"2024-02-17T00:37:52.692529+0000","last_became_active":"2024-02-17T00:37:50.709176+0000","last_became_peered":"2024-02-17T00:37:50.709176+0000","last_unstale":"2024-02-17T00:37:52.692529+0000","last_undegraded":"2024-02-17T00:37:52.692529+0000","last_fullsized":"2024-02-17T00:37:52.692529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:04:44.514209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139343+0000","last_change":"2024-02-17T00:37:51.711719+0000","last_active":"2024-02-17T00:37:54.139343+0000","last_peered":"2024-02-17T00:37:54.139343+0000","last_clean":"2024-02-17T00:37:54.139343+0000","last_became_active":"2024-02-17T00:37:51.711428+0000","last_became_peered":"2024-02-17T00:37:51.711428+0000","last_unstale":"2024-02-17T00:37:54.139343+0000","last_undegraded":"2024-02-17T00:37:54.139343+0000","last_fullsized":"2024-02-17T00:37:54.139343+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:50:58.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139804+0000","last_change":"2024-02-17T00:37:50.708963+0000","last_active":"2024-02-17T00:37:54.139804+0000","last_peered":"2024-02-17T00:37:54.139804+0000","last_clean":"2024-02-17T00:37:54.139804+0000","last_became_active":"2024-02-17T00:37:50.708613+0000","last_became_peered":"2024-02-17T00:37:50.708613+0000","last_unstale":"2024-02-17T00:37:54.139804+0000","last_undegraded":"2024-02-17T00:37:54.139804+0000","last_fullsized":"2024-02-17T00:37:54.139804+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:03:58.770505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692488+0000","last_change":"2024-02-17T00:37:51.710023+0000","last_active":"2024-02-17T00:37:52.692488+0000","last_peered":"2024-02-17T00:37:52.692488+0000","last_clean":"2024-02-17T00:37:52.692488+0000","last_became_active":"2024-02-17T00:37:51.708800+0000","last_became_peered":"2024-02-17T00:37:51.708800+0000","last_unstale":"2024-02-17T00:37:52.692488+0000","last_undegraded":"2024-02-17T00:37:52.692488+0000","last_fullsized":"2024-02-17T00:37:52.692488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:21:21.672973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692484+0000","last_change":"2024-02-17T00:37:50.703015+0000","last_active":"2024-02-17T00:37:52.692484+0000","last_peered":"2024-02-17T00:37:52.692484+0000","last_clean":"2024-02-17T00:37:52.692484+0000","last_became_active":"2024-02-17T00:37:50.702382+0000","last_became_peered":"2024-02-17T00:37:50.702382+0000","last_unstale":"2024-02-17T00:37:52.692484+0000","last_undegraded":"2024-02-17T00:37:52.692484+0000","last_fullsized":"2024-02-17T00:37:52.692484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:09:10.315447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140072+0000","last_change":"2024-02-17T00:37:51.720728+0000","last_active":"2024-02-17T00:37:54.140072+0000","last_peered":"2024-02-17T00:37:54.140072+0000","last_clean":"2024-02-17T00:37:54.140072+0000","last_became_active":"2024-02-17T00:37:51.719830+0000","last_became_peered":"2024-02-17T00:37:51.719830+0000","last_unstale":"2024-02-17T00:37:54.140072+0000","last_undegraded":"2024-02-17T00:37:54.140072+0000","last_fullsized":"2024-02-17T00:37:54.140072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:49:14.453244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140102+0000","last_change":"2024-02-17T00:37:50.705108+0000","last_active":"2024-02-17T00:37:54.140102+0000","last_peered":"2024-02-17T00:37:54.140102+0000","last_clean":"2024-02-17T00:37:54.140102+0000","last_became_active":"2024-02-17T00:37:50.704784+0000","last_became_peered":"2024-02-17T00:37:50.704784+0000","last_unstale":"2024-02-17T00:37:54.140102+0000","last_undegraded":"2024-02-17T00:37:54.140102+0000","last_fullsized":"2024-02-17T00:37:54.140102+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:41:31.931489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138841+0000","last_change":"2024-02-17T00:37:51.707091+0000","last_active":"2024-02-17T00:37:54.138841+0000","last_peered":"2024-02-17T00:37:54.138841+0000","last_clean":"2024-02-17T00:37:54.138841+0000","last_became_active":"2024-02-17T00:37:51.706791+0000","last_became_peered":"2024-02-17T00:37:51.706791+0000","last_unstale":"2024-02-17T00:37:54.138841+0000","last_undegraded":"2024-02-17T00:37:54.138841+0000","last_fullsized":"2024-02-17T00:37:54.138841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:23:06.201525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139377+0000","last_change":"2024-02-17T00:37:50.703886+0000","last_active":"2024-02-17T00:37:54.139377+0000","last_peered":"2024-02-17T00:37:54.139377+0000","last_clean":"2024-02-17T00:37:54.139377+0000","last_became_active":"2024-02-17T00:37:50.703591+0000","last_became_peered":"2024-02-17T00:37:50.703591+0000","last_unstale":"2024-02-17T00:37:54.139377+0000","last_undegraded":"2024-02-17T00:37:54.139377+0000","last_fullsized":"2024-02-17T00:37:54.139377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:42:35.448263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140025+0000","last_change":"2024-02-17T00:37:51.712731+0000","last_active":"2024-02-17T00:37:54.140025+0000","last_peered":"2024-02-17T00:37:54.140025+0000","last_clean":"2024-02-17T00:37:54.140025+0000","last_became_active":"2024-02-17T00:37:51.712478+0000","last_became_peered":"2024-02-17T00:37:51.712478+0000","last_unstale":"2024-02-17T00:37:54.140025+0000","last_undegraded":"2024-02-17T00:37:54.140025+0000","last_fullsized":"2024-02-17T00:37:54.140025+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:06:40.870602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138898+0000","last_change":"2024-02-17T00:37:50.711303+0000","last_active":"2024-02-17T00:37:54.138898+0000","last_peered":"2024-02-17T00:37:54.138898+0000","last_clean":"2024-02-17T00:37:54.138898+0000","last_became_active":"2024-02-17T00:37:50.710966+0000","last_became_peered":"2024-02-17T00:37:50.710966+0000","last_unstale":"2024-02-17T00:37:54.138898+0000","last_undegraded":"2024-02-17T00:37:54.138898+0000","last_fullsized":"2024-02-17T00:37:54.138898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:49.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692905+0000","last_change":"2024-02-17T00:37:51.716614+0000","last_active":"2024-02-17T00:37:52.692905+0000","last_peered":"2024-02-17T00:37:52.692905+0000","last_clean":"2024-02-17T00:37:52.692905+0000","last_became_active":"2024-02-17T00:37:51.716325+0000","last_became_peered":"2024-02-17T00:37:51.716325+0000","last_unstale":"2024-02-17T00:37:52.692905+0000","last_undegraded":"2024-02-17T00:37:52.692905+0000","last_fullsized":"2024-02-17T00:37:52.692905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:30.193212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139943+0000","last_change":"2024-02-17T00:37:50.706314+0000","last_active":"2024-02-17T00:37:54.139943+0000","last_peered":"2024-02-17T00:37:54.139943+0000","last_clean":"2024-02-17T00:37:54.139943+0000","last_became_active":"2024-02-17T00:37:50.705955+0000","last_became_peered":"2024-02-17T00:37:50.705955+0000","last_unstale":"2024-02-17T00:37:54.139943+0000","last_undegraded":"2024-02-17T00:37:54.139943+0000","last_fullsized":"2024-02-17T00:37:54.139943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:23:05.199099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140026+0000","last_change":"2024-02-17T00:37:51.718120+0000","last_active":"2024-02-17T00:37:54.140026+0000","last_peered":"2024-02-17T00:37:54.140026+0000","last_clean":"2024-02-17T00:37:54.140026+0000","last_became_active":"2024-02-17T00:37:51.714614+0000","last_became_peered":"2024-02-17T00:37:51.714614+0000","last_unstale":"2024-02-17T00:37:54.140026+0000","last_undegraded":"2024-02-17T00:37:54.140026+0000","last_fullsized":"2024-02-17T00:37:54.140026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:25:25.581637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139658+0000","last_change":"2024-02-17T00:37:50.704248+0000","last_active":"2024-02-17T00:37:54.139658+0000","last_peered":"2024-02-17T00:37:54.139658+0000","last_clean":"2024-02-17T00:37:54.139658+0000","last_became_active":"2024-02-17T00:37:50.703929+0000","last_became_peered":"2024-02-17T00:37:50.703929+0000","last_unstale":"2024-02-17T00:37:54.139658+0000","last_undegraded":"2024-02-17T00:37:54.139658+0000","last_fullsized":"2024-02-17T00:37:54.139658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:15:23.482338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692422+0000","last_change":"2024-02-17T00:37:51.714358+0000","last_active":"2024-02-17T00:37:52.692422+0000","last_peered":"2024-02-17T00:37:52.692422+0000","last_clean":"2024-02-17T00:37:52.692422+0000","last_became_active":"2024-02-17T00:37:51.713509+0000","last_became_peered":"2024-02-17T00:37:51.713509+0000","last_unstale":"2024-02-17T00:37:52.692422+0000","last_undegraded":"2024-02-17T00:37:52.692422+0000","last_fullsized":"2024-02-17T00:37:52.692422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:54:58.706505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692833+0000","last_change":"2024-02-17T00:37:50.699504+0000","last_active":"2024-02-17T00:37:52.692833+0000","last_peered":"2024-02-17T00:37:52.692833+0000","last_clean":"2024-02-17T00:37:52.692833+0000","last_became_active":"2024-02-17T00:37:50.698654+0000","last_became_peered":"2024-02-17T00:37:50.698654+0000","last_unstale":"2024-02-17T00:37:52.692833+0000","last_undegraded":"2024-02-17T00:37:52.692833+0000","last_fullsized":"2024-02-17T00:37:52.692833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:55:36.145339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693595+0000","last_change":"2024-02-17T00:37:51.712364+0000","last_active":"2024-02-17T00:37:53.693595+0000","last_peered":"2024-02-17T00:37:53.693595+0000","last_clean":"2024-02-17T00:37:53.693595+0000","last_became_active":"2024-02-17T00:37:51.712047+0000","last_became_peered":"2024-02-17T00:37:51.712047+0000","last_unstale":"2024-02-17T00:37:53.693595+0000","last_undegraded":"2024-02-17T00:37:53.693595+0000","last_fullsized":"2024-02-17T00:37:53.693595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:03:50.470764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138970+0000","last_change":"2024-02-17T00:37:50.707953+0000","last_active":"2024-02-17T00:37:54.138970+0000","last_peered":"2024-02-17T00:37:54.138970+0000","last_clean":"2024-02-17T00:37:54.138970+0000","last_became_active":"2024-02-17T00:37:50.707684+0000","last_became_peered":"2024-02-17T00:37:50.707684+0000","last_unstale":"2024-02-17T00:37:54.138970+0000","last_undegraded":"2024-02-17T00:37:54.138970+0000","last_fullsized":"2024-02-17T00:37:54.138970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:02:19.796533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693589+0000","last_change":"2024-02-17T00:37:51.716454+0000","last_active":"2024-02-17T00:37:52.693589+0000","last_peered":"2024-02-17T00:37:52.693589+0000","last_clean":"2024-02-17T00:37:52.693589+0000","last_became_active":"2024-02-17T00:37:51.716112+0000","last_became_peered":"2024-02-17T00:37:51.716112+0000","last_unstale":"2024-02-17T00:37:52.693589+0000","last_undegraded":"2024-02-17T00:37:52.693589+0000","last_fullsized":"2024-02-17T00:37:52.693589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:17:58.554817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138673+0000","last_change":"2024-02-17T00:37:50.698934+0000","last_active":"2024-02-17T00:37:54.138673+0000","last_peered":"2024-02-17T00:37:54.138673+0000","last_clean":"2024-02-17T00:37:54.138673+0000","last_became_active":"2024-02-17T00:37:50.698575+0000","last_became_peered":"2024-02-17T00:37:50.698575+0000","last_unstale":"2024-02-17T00:37:54.138673+0000","last_undegraded":"2024-02-17T00:37:54.138673+0000","last_fullsized":"2024-02-17T00:37:54.138673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:55:36.145339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692270+0000","last_change":"2024-02-17T00:37:51.717801+0000","last_active":"2024-02-17T00:37:52.692270+0000","last_peered":"2024-02-17T00:37:52.692270+0000","last_clean":"2024-02-17T00:37:52.692270+0000","last_became_active":"2024-02-17T00:37:51.717465+0000","last_became_peered":"2024-02-17T00:37:51.717465+0000","last_unstale":"2024-02-17T00:37:52.692270+0000","last_undegraded":"2024-02-17T00:37:52.692270+0000","last_fullsized":"2024-02-17T00:37:52.692270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:50:01.036630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692813+0000","last_change":"2024-02-17T00:37:50.708483+0000","last_active":"2024-02-17T00:37:52.692813+0000","last_peered":"2024-02-17T00:37:52.692813+0000","last_clean":"2024-02-17T00:37:52.692813+0000","last_became_active":"2024-02-17T00:37:50.708165+0000","last_became_peered":"2024-02-17T00:37:50.708165+0000","last_unstale":"2024-02-17T00:37:52.692813+0000","last_undegraded":"2024-02-17T00:37:52.692813+0000","last_fullsized":"2024-02-17T00:37:52.692813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:59:01.626008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692842+0000","last_change":"2024-02-17T00:37:51.722325+0000","last_active":"2024-02-17T00:37:52.692842+0000","last_peered":"2024-02-17T00:37:52.692842+0000","last_clean":"2024-02-17T00:37:52.692842+0000","last_became_active":"2024-02-17T00:37:51.722020+0000","last_became_peered":"2024-02-17T00:37:51.722020+0000","last_unstale":"2024-02-17T00:37:52.692842+0000","last_undegraded":"2024-02-17T00:37:52.692842+0000","last_fullsized":"2024-02-17T00:37:52.692842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:42:22.571747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139473+0000","last_change":"2024-02-17T00:37:50.711187+0000","last_active":"2024-02-17T00:37:54.139473+0000","last_peered":"2024-02-17T00:37:54.139473+0000","last_clean":"2024-02-17T00:37:54.139473+0000","last_became_active":"2024-02-17T00:37:50.710262+0000","last_became_peered":"2024-02-17T00:37:50.710262+0000","last_unstale":"2024-02-17T00:37:54.139473+0000","last_undegraded":"2024-02-17T00:37:54.139473+0000","last_fullsized":"2024-02-17T00:37:54.139473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:18:40.263624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692887+0000","last_change":"2024-02-17T00:37:51.716091+0000","last_active":"2024-02-17T00:37:52.692887+0000","last_peered":"2024-02-17T00:37:52.692887+0000","last_clean":"2024-02-17T00:37:52.692887+0000","last_became_active":"2024-02-17T00:37:51.715824+0000","last_became_peered":"2024-02-17T00:37:51.715824+0000","last_unstale":"2024-02-17T00:37:52.692887+0000","last_undegraded":"2024-02-17T00:37:52.692887+0000","last_fullsized":"2024-02-17T00:37:52.692887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:51.200529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693431+0000","last_change":"2024-02-17T00:37:50.707696+0000","last_active":"2024-02-17T00:37:52.693431+0000","last_peered":"2024-02-17T00:37:52.693431+0000","last_clean":"2024-02-17T00:37:52.693431+0000","last_became_active":"2024-02-17T00:37:50.707097+0000","last_became_peered":"2024-02-17T00:37:50.707097+0000","last_unstale":"2024-02-17T00:37:52.693431+0000","last_undegraded":"2024-02-17T00:37:52.693431+0000","last_fullsized":"2024-02-17T00:37:52.693431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:30:26.693300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139829+0000","last_change":"2024-02-17T00:37:51.715769+0000","last_active":"2024-02-17T00:37:54.139829+0000","last_peered":"2024-02-17T00:37:54.139829+0000","last_clean":"2024-02-17T00:37:54.139829+0000","last_became_active":"2024-02-17T00:37:51.715481+0000","last_became_peered":"2024-02-17T00:37:51.715481+0000","last_unstale":"2024-02-17T00:37:54.139829+0000","last_undegraded":"2024-02-17T00:37:54.139829+0000","last_fullsized":"2024-02-17T00:37:54.139829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:36:59.123131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139395+0000","last_change":"2024-02-17T00:37:50.702648+0000","last_active":"2024-02-17T00:37:54.139395+0000","last_peered":"2024-02-17T00:37:54.139395+0000","last_clean":"2024-02-17T00:37:54.139395+0000","last_became_active":"2024-02-17T00:37:50.702347+0000","last_became_peered":"2024-02-17T00:37:50.702347+0000","last_unstale":"2024-02-17T00:37:54.139395+0000","last_undegraded":"2024-02-17T00:37:54.139395+0000","last_fullsized":"2024-02-17T00:37:54.139395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:15:23.482338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138682+0000","last_change":"2024-02-17T00:37:51.708320+0000","last_active":"2024-02-17T00:37:54.138682+0000","last_peered":"2024-02-17T00:37:54.138682+0000","last_clean":"2024-02-17T00:37:54.138682+0000","last_became_active":"2024-02-17T00:37:51.707249+0000","last_became_peered":"2024-02-17T00:37:51.707249+0000","last_unstale":"2024-02-17T00:37:54.138682+0000","last_undegraded":"2024-02-17T00:37:54.138682+0000","last_fullsized":"2024-02-17T00:37:54.138682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:04:37.721865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139632+0000","last_change":"2024-02-17T00:37:50.707588+0000","last_active":"2024-02-17T00:37:54.139632+0000","last_peered":"2024-02-17T00:37:54.139632+0000","last_clean":"2024-02-17T00:37:54.139632+0000","last_became_active":"2024-02-17T00:37:50.707254+0000","last_became_peered":"2024-02-17T00:37:50.707254+0000","last_unstale":"2024-02-17T00:37:54.139632+0000","last_undegraded":"2024-02-17T00:37:54.139632+0000","last_fullsized":"2024-02-17T00:37:54.139632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:22:42.427321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139359+0000","last_change":"2024-02-17T00:37:51.719200+0000","last_active":"2024-02-17T00:37:54.139359+0000","last_peered":"2024-02-17T00:37:54.139359+0000","last_clean":"2024-02-17T00:37:54.139359+0000","last_became_active":"2024-02-17T00:37:51.718967+0000","last_became_peered":"2024-02-17T00:37:51.718967+0000","last_unstale":"2024-02-17T00:37:54.139359+0000","last_undegraded":"2024-02-17T00:37:54.139359+0000","last_fullsized":"2024-02-17T00:37:54.139359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:02:42.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692971+0000","last_change":"2024-02-17T00:37:50.708699+0000","last_active":"2024-02-17T00:37:52.692971+0000","last_peered":"2024-02-17T00:37:52.692971+0000","last_clean":"2024-02-17T00:37:52.692971+0000","last_became_active":"2024-02-17T00:37:50.708213+0000","last_became_peered":"2024-02-17T00:37:50.708213+0000","last_unstale":"2024-02-17T00:37:52.692971+0000","last_undegraded":"2024-02-17T00:37:52.692971+0000","last_fullsized":"2024-02-17T00:37:52.692971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:50.198103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693276+0000","last_change":"2024-02-17T00:37:51.715118+0000","last_active":"2024-02-17T00:37:53.693276+0000","last_peered":"2024-02-17T00:37:53.693276+0000","last_clean":"2024-02-17T00:37:53.693276+0000","last_became_active":"2024-02-17T00:37:51.714827+0000","last_became_peered":"2024-02-17T00:37:51.714827+0000","last_unstale":"2024-02-17T00:37:53.693276+0000","last_undegraded":"2024-02-17T00:37:53.693276+0000","last_fullsized":"2024-02-17T00:37:53.693276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:57:25.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692635+0000","last_change":"2024-02-17T00:37:50.709208+0000","last_active":"2024-02-17T00:37:52.692635+0000","last_peered":"2024-02-17T00:37:52.692635+0000","last_clean":"2024-02-17T00:37:52.692635+0000","last_became_active":"2024-02-17T00:37:50.708872+0000","last_became_peered":"2024-02-17T00:37:50.708872+0000","last_unstale":"2024-02-17T00:37:52.692635+0000","last_undegraded":"2024-02-17T00:37:52.692635+0000","last_fullsized":"2024-02-17T00:37:52.692635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:49.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139961+0000","last_change":"2024-02-17T00:37:51.720975+0000","last_active":"2024-02-17T00:37:54.139961+0000","last_peered":"2024-02-17T00:37:54.139961+0000","last_clean":"2024-02-17T00:37:54.139961+0000","last_became_active":"2024-02-17T00:37:51.720385+0000","last_became_peered":"2024-02-17T00:37:51.720385+0000","last_unstale":"2024-02-17T00:37:54.139961+0000","last_undegraded":"2024-02-17T00:37:54.139961+0000","last_fullsized":"2024-02-17T00:37:54.139961+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:45:32.200839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692054+0000","last_change":"2024-02-17T00:37:50.702166+0000","last_active":"2024-02-17T00:37:52.692054+0000","last_peered":"2024-02-17T00:37:52.692054+0000","last_clean":"2024-02-17T00:37:52.692054+0000","last_became_active":"2024-02-17T00:37:50.701904+0000","last_became_peered":"2024-02-17T00:37:50.701904+0000","last_unstale":"2024-02-17T00:37:52.692054+0000","last_undegraded":"2024-02-17T00:37:52.692054+0000","last_fullsized":"2024-02-17T00:37:52.692054+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:29.190786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693612+0000","last_change":"2024-02-17T00:37:51.715709+0000","last_active":"2024-02-17T00:37:52.693612+0000","last_peered":"2024-02-17T00:37:52.693612+0000","last_clean":"2024-02-17T00:37:52.693612+0000","last_became_active":"2024-02-17T00:37:51.715427+0000","last_became_peered":"2024-02-17T00:37:51.715427+0000","last_unstale":"2024-02-17T00:37:52.693612+0000","last_undegraded":"2024-02-17T00:37:52.693612+0000","last_fullsized":"2024-02-17T00:37:52.693612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:01:01.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139377+0000","last_change":"2024-02-17T00:37:50.709632+0000","last_active":"2024-02-17T00:37:54.139377+0000","last_peered":"2024-02-17T00:37:54.139377+0000","last_clean":"2024-02-17T00:37:54.139377+0000","last_became_active":"2024-02-17T00:37:50.709328+0000","last_became_peered":"2024-02-17T00:37:50.709328+0000","last_unstale":"2024-02-17T00:37:54.139377+0000","last_undegraded":"2024-02-17T00:37:54.139377+0000","last_fullsized":"2024-02-17T00:37:54.139377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:02:41.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693678+0000","last_change":"2024-02-17T00:37:51.715839+0000","last_active":"2024-02-17T00:37:53.693678+0000","last_peered":"2024-02-17T00:37:53.693678+0000","last_clean":"2024-02-17T00:37:53.693678+0000","last_became_active":"2024-02-17T00:37:51.715303+0000","last_became_peered":"2024-02-17T00:37:51.715303+0000","last_unstale":"2024-02-17T00:37:53.693678+0000","last_undegraded":"2024-02-17T00:37:53.693678+0000","last_fullsized":"2024-02-17T00:37:53.693678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:08:44.947732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693673+0000","last_change":"2024-02-17T00:37:50.707462+0000","last_active":"2024-02-17T00:37:52.693673+0000","last_peered":"2024-02-17T00:37:52.693673+0000","last_clean":"2024-02-17T00:37:52.693673+0000","last_became_active":"2024-02-17T00:37:50.707079+0000","last_became_peered":"2024-02-17T00:37:50.707079+0000","last_unstale":"2024-02-17T00:37:52.693673+0000","last_undegraded":"2024-02-17T00:37:52.693673+0000","last_fullsized":"2024-02-17T00:37:52.693673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:48.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139481+0000","last_change":"2024-02-17T00:37:51.710691+0000","last_active":"2024-02-17T00:37:54.139481+0000","last_peered":"2024-02-17T00:37:54.139481+0000","last_clean":"2024-02-17T00:37:54.139481+0000","last_became_active":"2024-02-17T00:37:51.710406+0000","last_became_peered":"2024-02-17T00:37:51.710406+0000","last_unstale":"2024-02-17T00:37:54.139481+0000","last_undegraded":"2024-02-17T00:37:54.139481+0000","last_fullsized":"2024-02-17T00:37:54.139481+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:50:01.036630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693584+0000","last_change":"2024-02-17T00:37:50.709902+0000","last_active":"2024-02-17T00:37:52.693584+0000","last_peered":"2024-02-17T00:37:52.693584+0000","last_clean":"2024-02-17T00:37:52.693584+0000","last_became_active":"2024-02-17T00:37:50.709574+0000","last_became_peered":"2024-02-17T00:37:50.709574+0000","last_unstale":"2024-02-17T00:37:52.693584+0000","last_undegraded":"2024-02-17T00:37:52.693584+0000","last_fullsized":"2024-02-17T00:37:52.693584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:58.955350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693416+0000","last_change":"2024-02-17T00:37:51.720548+0000","last_active":"2024-02-17T00:37:52.693416+0000","last_peered":"2024-02-17T00:37:52.693416+0000","last_clean":"2024-02-17T00:37:52.693416+0000","last_became_active":"2024-02-17T00:37:51.720050+0000","last_became_peered":"2024-02-17T00:37:51.720050+0000","last_unstale":"2024-02-17T00:37:52.693416+0000","last_undegraded":"2024-02-17T00:37:52.693416+0000","last_fullsized":"2024-02-17T00:37:52.693416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:41.301414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139969+0000","last_change":"2024-02-17T00:37:50.702160+0000","last_active":"2024-02-17T00:37:54.139969+0000","last_peered":"2024-02-17T00:37:54.139969+0000","last_clean":"2024-02-17T00:37:54.139969+0000","last_became_active":"2024-02-17T00:37:50.701464+0000","last_became_peered":"2024-02-17T00:37:50.701464+0000","last_unstale":"2024-02-17T00:37:54.139969+0000","last_undegraded":"2024-02-17T00:37:54.139969+0000","last_fullsized":"2024-02-17T00:37:54.139969+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:22:42.427321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692273+0000","last_change":"2024-02-17T00:37:51.706948+0000","last_active":"2024-02-17T00:37:52.692273+0000","last_peered":"2024-02-17T00:37:52.692273+0000","last_clean":"2024-02-17T00:37:52.692273+0000","last_became_active":"2024-02-17T00:37:51.706476+0000","last_became_peered":"2024-02-17T00:37:51.706476+0000","last_unstale":"2024-02-17T00:37:52.692273+0000","last_undegraded":"2024-02-17T00:37:52.692273+0000","last_fullsized":"2024-02-17T00:37:52.692273+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:36:59.123131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693455+0000","last_change":"2024-02-17T00:37:50.707220+0000","last_active":"2024-02-17T00:37:53.693455+0000","last_peered":"2024-02-17T00:37:53.693455+0000","last_clean":"2024-02-17T00:37:53.693455+0000","last_became_active":"2024-02-17T00:37:50.706927+0000","last_became_peered":"2024-02-17T00:37:50.706927+0000","last_unstale":"2024-02-17T00:37:53.693455+0000","last_undegraded":"2024-02-17T00:37:53.693455+0000","last_fullsized":"2024-02-17T00:37:53.693455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:29.190786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139399+0000","last_change":"2024-02-17T00:37:51.718924+0000","last_active":"2024-02-17T00:37:54.139399+0000","last_peered":"2024-02-17T00:37:54.139399+0000","last_clean":"2024-02-17T00:37:54.139399+0000","last_became_active":"2024-02-17T00:37:51.718664+0000","last_became_peered":"2024-02-17T00:37:51.718664+0000","last_unstale":"2024-02-17T00:37:54.139399+0000","last_undegraded":"2024-02-17T00:37:54.139399+0000","last_fullsized":"2024-02-17T00:37:54.139399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:04:27.585531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139061+0000","last_change":"2024-02-17T00:37:50.706685+0000","last_active":"2024-02-17T00:37:54.139061+0000","last_peered":"2024-02-17T00:37:54.139061+0000","last_clean":"2024-02-17T00:37:54.139061+0000","last_became_active":"2024-02-17T00:37:50.706376+0000","last_became_peered":"2024-02-17T00:37:50.706376+0000","last_unstale":"2024-02-17T00:37:54.139061+0000","last_undegraded":"2024-02-17T00:37:54.139061+0000","last_fullsized":"2024-02-17T00:37:54.139061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:06:51.686750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693405+0000","last_change":"2024-02-17T00:37:51.715442+0000","last_active":"2024-02-17T00:37:53.693405+0000","last_peered":"2024-02-17T00:37:53.693405+0000","last_clean":"2024-02-17T00:37:53.693405+0000","last_became_active":"2024-02-17T00:37:51.715147+0000","last_became_peered":"2024-02-17T00:37:51.715147+0000","last_unstale":"2024-02-17T00:37:53.693405+0000","last_undegraded":"2024-02-17T00:37:53.693405+0000","last_fullsized":"2024-02-17T00:37:53.693405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:31.093234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140037+0000","last_change":"2024-02-17T00:37:50.706237+0000","last_active":"2024-02-17T00:37:54.140037+0000","last_peered":"2024-02-17T00:37:54.140037+0000","last_clean":"2024-02-17T00:37:54.140037+0000","last_became_active":"2024-02-17T00:37:50.705993+0000","last_became_peered":"2024-02-17T00:37:50.705993+0000","last_unstale":"2024-02-17T00:37:54.140037+0000","last_undegraded":"2024-02-17T00:37:54.140037+0000","last_fullsized":"2024-02-17T00:37:54.140037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:33:45.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139322+0000","last_change":"2024-02-17T00:37:51.708361+0000","last_active":"2024-02-17T00:37:54.139322+0000","last_peered":"2024-02-17T00:37:54.139322+0000","last_clean":"2024-02-17T00:37:54.139322+0000","last_became_active":"2024-02-17T00:37:51.708026+0000","last_became_peered":"2024-02-17T00:37:51.708026+0000","last_unstale":"2024-02-17T00:37:54.139322+0000","last_undegraded":"2024-02-17T00:37:54.139322+0000","last_fullsized":"2024-02-17T00:37:54.139322+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:51.243894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693258+0000","last_change":"2024-02-17T00:37:50.707905+0000","last_active":"2024-02-17T00:37:53.693258+0000","last_peered":"2024-02-17T00:37:53.693258+0000","last_clean":"2024-02-17T00:37:53.693258+0000","last_became_active":"2024-02-17T00:37:50.707589+0000","last_became_peered":"2024-02-17T00:37:50.707589+0000","last_unstale":"2024-02-17T00:37:53.693258+0000","last_undegraded":"2024-02-17T00:37:53.693258+0000","last_fullsized":"2024-02-17T00:37:53.693258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:50.198103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":201,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692574+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:37:52.692574+0000","last_peered":"2024-02-17T00:37:52.692574+0000","last_clean":"2024-02-17T00:37:52.692574+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:37:52.692574+0000","last_undegraded":"2024-02-17T00:37:52.692574+0000","last_fullsized":"2024-02-17T00:37:52.692574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":471040,"data_stored":199487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.499}]},{"osd":1,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.44800000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.38},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33600000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1064960,"data_stored":790403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72199999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":487424,"data_stored":201189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.753},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72499999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.372},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.51100000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56200000000000006}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":483328,"data_stored":201647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.26300000000000001}]},{"osd":1,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.315},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.67000000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1064960,"data_stored":789843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73699999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":475136,"data_stored":199545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.377}]},{"osd":2,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.27000000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78200000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.629},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.0839999999999996,"5min":6.0839999999999996,"15min":6.0839999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:59.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T00:37:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.248+0000 7f42432b5640 1 Processor -- start 2024-02-17T00:37:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.248+0000 7f42432b5640 1 -- start start 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f42432b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15da60 0x7f423c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f42432b5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f423c15e2a0 0x7f423c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f42432b5640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c15e8a0 con 0x7f423c15de40 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f42432b5640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c161640 con 0x7f423c15e2a0 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f42432b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c15eb80 con 0x7f423c15da60 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f4241852640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f423c15e2a0 0x7f423c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f4241852640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f423c15e2a0 0x7f423c0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42246/0 (socket says 172.21.15.32:42246) 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f4241852640 1 -- 172.21.15.32:0/284748401 learned_addr learned my addr 172.21.15.32:0/284748401 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.249+0000 7f4241051640 1 --2- 172.21.15.32:0/284748401 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15da60 0x7f423c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.250+0000 7f4241852640 1 -- 172.21.15.32:0/284748401 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15da60 msgr2=0x7f423c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.250+0000 7f4241852640 1 --2- 172.21.15.32:0/284748401 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15da60 0x7f423c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.250+0000 7f4241852640 1 -- 172.21.15.32:0/284748401 >> v1:172.21.15.39:6789/0 conn(0x7f423c15de40 legacy=0x7f423c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.250+0000 7f4241852640 1 -- 172.21.15.32:0/284748401 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c15ee60 con 0x7f423c15e2a0 2024-02-17T00:37:59.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.250+0000 7f4241852640 1 --2- 172.21.15.32:0/284748401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15e2a0 0x7f423c0ce520 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f422c009e50 tx=0x7f422c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a9ca4c239b1192 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f423bfff640 1 -- 172.21.15.32:0/284748401 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c02ca70 con 0x7f423c15e2a0 2024-02-17T00:37:59.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f423bfff640 1 -- 172.21.15.32:0/284748401 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c02cbd0 con 0x7f423c15e2a0 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f423bfff640 1 -- 172.21.15.32:0/284748401 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0343f0 con 0x7f423c15e2a0 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 -- 172.21.15.32:0/284748401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15e2a0 msgr2=0x7f423c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 --2- 172.21.15.32:0/284748401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15e2a0 0x7f423c0ce520 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f422c009e50 tx=0x7f422c02bed0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 -- 172.21.15.32:0/284748401 shutdown_connections 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 --2- 172.21.15.32:0/284748401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15e2a0 0x7f423c0ce520 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 --2- 172.21.15.32:0/284748401 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15da60 0x7f423c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 -- 172.21.15.32:0/284748401 >> 172.21.15.32:0/284748401 conn(0x7f423c06bfe0 msgr2=0x7f423c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 -- 172.21.15.32:0/284748401 shutdown_connections 2024-02-17T00:37:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.251+0000 7f42432b5640 1 -- 172.21.15.32:0/284748401 wait complete. 2024-02-17T00:37:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.252+0000 7f42432b5640 1 Processor -- start 2024-02-17T00:37:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.252+0000 7f42432b5640 1 -- start start 2024-02-17T00:37:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f42432b5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 0x7f423c14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f42432b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15de40 0x7f423c0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f42432b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c15e2a0 0x7f423c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f42432b5640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0cd800 con 0x7f423c15da60 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f42432b5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c14e1b0 con 0x7f423c15e2a0 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f42432b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0ca9c0 con 0x7f423c15de40 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f4241051640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 0x7f423c14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f4241051640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 0x7f423c14dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42258/0 (socket says 172.21.15.32:42258) 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f4241051640 1 -- 172.21.15.32:0/1655527095 learned_addr learned my addr 172.21.15.32:0/1655527095 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f4240850640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15de40 0x7f423c0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.253+0000 7f4241852640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c15e2a0 0x7f423c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241051640 1 -- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15de40 msgr2=0x7f423c0b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241051640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15de40 0x7f423c0b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241051640 1 -- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c15e2a0 msgr2=0x7f423c0b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241051640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c15e2a0 0x7f423c0b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241051640 1 -- 172.21.15.32:0/1655527095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009b30 con 0x7f423c15da60 2024-02-17T00:37:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241852640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c15e2a0 0x7f423c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4240850640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15de40 0x7f423c0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4241051640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 0x7f423c14dc70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f423400d800 tx=0x7f423400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423400b6c0 con 0x7f423c15da60 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423400b820 con 0x7f423c15da60 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c162600 con 0x7f423c15da60 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423400bbb0 con 0x7f423c15da60 2024-02-17T00:37:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.254+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0b5270 con 0x7f423c15da60 2024-02-17T00:37:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.255+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0680c0 con 0x7f423c15da60 2024-02-17T00:37:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.256+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f423400bd10 con 0x7f423c15da60 2024-02-17T00:37:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.256+0000 7f4239ffb640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f422806b810 0x7f422806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.256+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f423408a860 con 0x7f423c15da60 2024-02-17T00:37:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.256+0000 7f4240850640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f422806b810 0x7f422806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.257+0000 7f4240850640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f422806b810 0x7f422806dcd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4230007fd0 tx=0x7f4230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.260+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4234055180 con 0x7f423c15da60 2024-02-17T00:37:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.441+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 --> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f423c0cea60 con 0x7f422806b810 2024-02-17T00:37:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.449+0000 7f4239ffb640 1 -- 172.21.15.32:0/1655527095 <== mgr.4100 v2:172.21.15.39:6832/2740259094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289435 (secure 0 0 0) 0x7f42300013e0 con 0x7f422806b810 2024-02-17T00:37:59.454 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:37:59.455 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-02-17T00:37:59.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f422806b810 msgr2=0x7f422806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f422806b810 0x7f422806dcd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4230007fd0 tx=0x7f4230009040 comp rx=0 tx=0).stop 2024-02-17T00:37:59.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 msgr2=0x7f423c14dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 0x7f423c14dc70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f423400d800 tx=0x7f423400dcc0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 shutdown_connections 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f423c15e2a0 0x7f423c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f422806b810 0x7f422806dcd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f423c15de40 0x7f423c0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 --2- 172.21.15.32:0/1655527095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f423c15da60 0x7f423c14dc70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 >> 172.21.15.32:0/1655527095 conn(0x7f423c06bfe0 msgr2=0x7f423c0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 shutdown_connections 2024-02-17T00:37:59.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.452+0000 7f42432b5640 1 -- 172.21.15.32:0/1655527095 wait complete. 2024-02-17T00:37:59.465 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-02-17T00:37:57.967194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254328,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720392,"statfs":{"total":773094113280,"available":772833681408,"internally_reserved":0,"allocated":4988928,"data_stored":2781180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.278525"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140133+0000","last_change":"2024-02-17T00:37:51.717625+0000","last_active":"2024-02-17T00:37:54.140133+0000","last_peered":"2024-02-17T00:37:54.140133+0000","last_clean":"2024-02-17T00:37:54.140133+0000","last_became_active":"2024-02-17T00:37:51.714612+0000","last_became_peered":"2024-02-17T00:37:51.714612+0000","last_unstale":"2024-02-17T00:37:54.140133+0000","last_undegraded":"2024-02-17T00:37:54.140133+0000","last_fullsized":"2024-02-17T00:37:54.140133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:02:59.384871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692701+0000","last_change":"2024-02-17T00:37:51.710917+0000","last_active":"2024-02-17T00:37:52.692701+0000","last_peered":"2024-02-17T00:37:52.692701+0000","last_clean":"2024-02-17T00:37:52.692701+0000","last_became_active":"2024-02-17T00:37:51.710468+0000","last_became_peered":"2024-02-17T00:37:51.710468+0000","last_unstale":"2024-02-17T00:37:52.692701+0000","last_undegraded":"2024-02-17T00:37:52.692701+0000","last_fullsized":"2024-02-17T00:37:52.692701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:27:59.319843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139723+0000","last_change":"2024-02-17T00:37:51.708158+0000","last_active":"2024-02-17T00:37:54.139723+0000","last_peered":"2024-02-17T00:37:54.139723+0000","last_clean":"2024-02-17T00:37:54.139723+0000","last_became_active":"2024-02-17T00:37:51.707869+0000","last_became_peered":"2024-02-17T00:37:51.707869+0000","last_unstale":"2024-02-17T00:37:54.139723+0000","last_undegraded":"2024-02-17T00:37:54.139723+0000","last_fullsized":"2024-02-17T00:37:54.139723+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:00:22.916904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139796+0000","last_change":"2024-02-17T00:37:51.721194+0000","last_active":"2024-02-17T00:37:54.139796+0000","last_peered":"2024-02-17T00:37:54.139796+0000","last_clean":"2024-02-17T00:37:54.139796+0000","last_became_active":"2024-02-17T00:37:51.720870+0000","last_became_peered":"2024-02-17T00:37:51.720870+0000","last_unstale":"2024-02-17T00:37:54.139796+0000","last_undegraded":"2024-02-17T00:37:54.139796+0000","last_fullsized":"2024-02-17T00:37:54.139796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:37:41.785028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693441+0000","last_change":"2024-02-17T00:37:51.711548+0000","last_active":"2024-02-17T00:37:52.693441+0000","last_peered":"2024-02-17T00:37:52.693441+0000","last_clean":"2024-02-17T00:37:52.693441+0000","last_became_active":"2024-02-17T00:37:51.711260+0000","last_became_peered":"2024-02-17T00:37:51.711260+0000","last_unstale":"2024-02-17T00:37:52.693441+0000","last_undegraded":"2024-02-17T00:37:52.693441+0000","last_fullsized":"2024-02-17T00:37:52.693441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:45:34.889730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692895+0000","last_change":"2024-02-17T00:37:51.705032+0000","last_active":"2024-02-17T00:37:52.692895+0000","last_peered":"2024-02-17T00:37:52.692895+0000","last_clean":"2024-02-17T00:37:52.692895+0000","last_became_active":"2024-02-17T00:37:51.704373+0000","last_became_peered":"2024-02-17T00:37:51.704373+0000","last_unstale":"2024-02-17T00:37:52.692895+0000","last_undegraded":"2024-02-17T00:37:52.692895+0000","last_fullsized":"2024-02-17T00:37:52.692895+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:10:02.739213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692573+0000","last_change":"2024-02-17T00:37:51.712389+0000","last_active":"2024-02-17T00:37:52.692573+0000","last_peered":"2024-02-17T00:37:52.692573+0000","last_clean":"2024-02-17T00:37:52.692573+0000","last_became_active":"2024-02-17T00:37:51.712088+0000","last_became_peered":"2024-02-17T00:37:51.712088+0000","last_unstale":"2024-02-17T00:37:52.692573+0000","last_undegraded":"2024-02-17T00:37:52.692573+0000","last_fullsized":"2024-02-17T00:37:52.692573+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:24:06.413498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139328+0000","last_change":"2024-02-17T00:37:51.719469+0000","last_active":"2024-02-17T00:37:54.139328+0000","last_peered":"2024-02-17T00:37:54.139328+0000","last_clean":"2024-02-17T00:37:54.139328+0000","last_became_active":"2024-02-17T00:37:51.719168+0000","last_became_peered":"2024-02-17T00:37:51.719168+0000","last_unstale":"2024-02-17T00:37:54.139328+0000","last_undegraded":"2024-02-17T00:37:54.139328+0000","last_fullsized":"2024-02-17T00:37:54.139328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:50.004321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693811+0000","last_change":"2024-02-17T00:37:51.714730+0000","last_active":"2024-02-17T00:37:52.693811+0000","last_peered":"2024-02-17T00:37:52.693811+0000","last_clean":"2024-02-17T00:37:52.693811+0000","last_became_active":"2024-02-17T00:37:51.714431+0000","last_became_peered":"2024-02-17T00:37:51.714431+0000","last_unstale":"2024-02-17T00:37:52.693811+0000","last_undegraded":"2024-02-17T00:37:52.693811+0000","last_fullsized":"2024-02-17T00:37:52.693811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:21:44.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692842+0000","last_change":"2024-02-17T00:37:51.720581+0000","last_active":"2024-02-17T00:37:52.692842+0000","last_peered":"2024-02-17T00:37:52.692842+0000","last_clean":"2024-02-17T00:37:52.692842+0000","last_became_active":"2024-02-17T00:37:51.720314+0000","last_became_peered":"2024-02-17T00:37:51.720314+0000","last_unstale":"2024-02-17T00:37:52.692842+0000","last_undegraded":"2024-02-17T00:37:52.692842+0000","last_fullsized":"2024-02-17T00:37:52.692842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:55:37.147765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693629+0000","last_change":"2024-02-17T00:37:51.715664+0000","last_active":"2024-02-17T00:37:53.693629+0000","last_peered":"2024-02-17T00:37:53.693629+0000","last_clean":"2024-02-17T00:37:53.693629+0000","last_became_active":"2024-02-17T00:37:51.715127+0000","last_became_peered":"2024-02-17T00:37:51.715127+0000","last_unstale":"2024-02-17T00:37:53.693629+0000","last_undegraded":"2024-02-17T00:37:53.693629+0000","last_fullsized":"2024-02-17T00:37:53.693629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:36:50.193978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693557+0000","last_change":"2024-02-17T00:37:51.718977+0000","last_active":"2024-02-17T00:37:52.693557+0000","last_peered":"2024-02-17T00:37:52.693557+0000","last_clean":"2024-02-17T00:37:52.693557+0000","last_became_active":"2024-02-17T00:37:51.718689+0000","last_became_peered":"2024-02-17T00:37:51.718689+0000","last_unstale":"2024-02-17T00:37:52.693557+0000","last_undegraded":"2024-02-17T00:37:52.693557+0000","last_fullsized":"2024-02-17T00:37:52.693557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:39:22.812319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692667+0000","last_change":"2024-02-17T00:37:51.709096+0000","last_active":"2024-02-17T00:37:52.692667+0000","last_peered":"2024-02-17T00:37:52.692667+0000","last_clean":"2024-02-17T00:37:52.692667+0000","last_became_active":"2024-02-17T00:37:51.708813+0000","last_became_peered":"2024-02-17T00:37:51.708813+0000","last_unstale":"2024-02-17T00:37:52.692667+0000","last_undegraded":"2024-02-17T00:37:52.692667+0000","last_fullsized":"2024-02-17T00:37:52.692667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:07:37.127918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138755+0000","last_change":"2024-02-17T00:37:51.697693+0000","last_active":"2024-02-17T00:37:54.138755+0000","last_peered":"2024-02-17T00:37:54.138755+0000","last_clean":"2024-02-17T00:37:54.138755+0000","last_became_active":"2024-02-17T00:37:51.697444+0000","last_became_peered":"2024-02-17T00:37:51.697444+0000","last_unstale":"2024-02-17T00:37:54.138755+0000","last_undegraded":"2024-02-17T00:37:54.138755+0000","last_fullsized":"2024-02-17T00:37:54.138755+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:22:43.429747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138719+0000","last_change":"2024-02-17T00:37:51.702072+0000","last_active":"2024-02-17T00:37:54.138719+0000","last_peered":"2024-02-17T00:37:54.138719+0000","last_clean":"2024-02-17T00:37:54.138719+0000","last_became_active":"2024-02-17T00:37:51.701817+0000","last_became_peered":"2024-02-17T00:37:51.701817+0000","last_unstale":"2024-02-17T00:37:54.138719+0000","last_undegraded":"2024-02-17T00:37:54.138719+0000","last_fullsized":"2024-02-17T00:37:54.138719+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:30:11.319762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692518+0000","last_change":"2024-02-17T00:37:51.722844+0000","last_active":"2024-02-17T00:37:52.692518+0000","last_peered":"2024-02-17T00:37:52.692518+0000","last_clean":"2024-02-17T00:37:52.692518+0000","last_became_active":"2024-02-17T00:37:51.722561+0000","last_became_peered":"2024-02-17T00:37:51.722561+0000","last_unstale":"2024-02-17T00:37:52.692518+0000","last_undegraded":"2024-02-17T00:37:52.692518+0000","last_fullsized":"2024-02-17T00:37:52.692518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:13:25.617988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139384+0000","last_change":"2024-02-17T00:37:51.709647+0000","last_active":"2024-02-17T00:37:54.139384+0000","last_peered":"2024-02-17T00:37:54.139384+0000","last_clean":"2024-02-17T00:37:54.139384+0000","last_became_active":"2024-02-17T00:37:51.709390+0000","last_became_peered":"2024-02-17T00:37:51.709390+0000","last_unstale":"2024-02-17T00:37:54.139384+0000","last_undegraded":"2024-02-17T00:37:54.139384+0000","last_fullsized":"2024-02-17T00:37:54.139384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:20:10.535744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139269+0000","last_change":"2024-02-17T00:37:51.713338+0000","last_active":"2024-02-17T00:37:54.139269+0000","last_peered":"2024-02-17T00:37:54.139269+0000","last_clean":"2024-02-17T00:37:54.139269+0000","last_became_active":"2024-02-17T00:37:51.713067+0000","last_became_peered":"2024-02-17T00:37:51.713067+0000","last_unstale":"2024-02-17T00:37:54.139269+0000","last_undegraded":"2024-02-17T00:37:54.139269+0000","last_fullsized":"2024-02-17T00:37:54.139269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:20:46.149412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139850+0000","last_change":"2024-02-17T00:37:51.715816+0000","last_active":"2024-02-17T00:37:54.139850+0000","last_peered":"2024-02-17T00:37:54.139850+0000","last_clean":"2024-02-17T00:37:54.139850+0000","last_became_active":"2024-02-17T00:37:51.715520+0000","last_became_peered":"2024-02-17T00:37:51.715520+0000","last_unstale":"2024-02-17T00:37:54.139850+0000","last_undegraded":"2024-02-17T00:37:54.139850+0000","last_fullsized":"2024-02-17T00:37:54.139850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:54:58.706505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693319+0000","last_change":"2024-02-17T00:37:51.720407+0000","last_active":"2024-02-17T00:37:53.693319+0000","last_peered":"2024-02-17T00:37:53.693319+0000","last_clean":"2024-02-17T00:37:53.693319+0000","last_became_active":"2024-02-17T00:37:51.720105+0000","last_became_peered":"2024-02-17T00:37:51.720105+0000","last_unstale":"2024-02-17T00:37:53.693319+0000","last_undegraded":"2024-02-17T00:37:53.693319+0000","last_fullsized":"2024-02-17T00:37:53.693319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:27:59.319843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693503+0000","last_change":"2024-02-17T00:37:51.723237+0000","last_active":"2024-02-17T00:37:53.693503+0000","last_peered":"2024-02-17T00:37:53.693503+0000","last_clean":"2024-02-17T00:37:53.693503+0000","last_became_active":"2024-02-17T00:37:51.721350+0000","last_became_peered":"2024-02-17T00:37:51.721350+0000","last_unstale":"2024-02-17T00:37:53.693503+0000","last_undegraded":"2024-02-17T00:37:53.693503+0000","last_fullsized":"2024-02-17T00:37:53.693503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:10:02.739213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693231+0000","last_change":"2024-02-17T00:37:51.712808+0000","last_active":"2024-02-17T00:37:53.693231+0000","last_peered":"2024-02-17T00:37:53.693231+0000","last_clean":"2024-02-17T00:37:53.693231+0000","last_became_active":"2024-02-17T00:37:51.712523+0000","last_became_peered":"2024-02-17T00:37:51.712523+0000","last_unstale":"2024-02-17T00:37:53.693231+0000","last_undegraded":"2024-02-17T00:37:53.693231+0000","last_fullsized":"2024-02-17T00:37:53.693231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:54:58.706505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138851+0000","last_change":"2024-02-17T00:37:51.706785+0000","last_active":"2024-02-17T00:37:54.138851+0000","last_peered":"2024-02-17T00:37:54.138851+0000","last_clean":"2024-02-17T00:37:54.138851+0000","last_became_active":"2024-02-17T00:37:51.706375+0000","last_became_peered":"2024-02-17T00:37:51.706375+0000","last_unstale":"2024-02-17T00:37:54.138851+0000","last_undegraded":"2024-02-17T00:37:54.138851+0000","last_fullsized":"2024-02-17T00:37:54.138851+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:47:52.017880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139393+0000","last_change":"2024-02-17T00:37:51.718214+0000","last_active":"2024-02-17T00:37:54.139393+0000","last_peered":"2024-02-17T00:37:54.139393+0000","last_clean":"2024-02-17T00:37:54.139393+0000","last_became_active":"2024-02-17T00:37:51.717689+0000","last_became_peered":"2024-02-17T00:37:51.717689+0000","last_unstale":"2024-02-17T00:37:54.139393+0000","last_undegraded":"2024-02-17T00:37:54.139393+0000","last_fullsized":"2024-02-17T00:37:54.139393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:02:20.798959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139126+0000","last_change":"2024-02-17T00:37:51.704125+0000","last_active":"2024-02-17T00:37:54.139126+0000","last_peered":"2024-02-17T00:37:54.139126+0000","last_clean":"2024-02-17T00:37:54.139126+0000","last_became_active":"2024-02-17T00:37:51.703615+0000","last_became_peered":"2024-02-17T00:37:51.703615+0000","last_unstale":"2024-02-17T00:37:54.139126+0000","last_undegraded":"2024-02-17T00:37:54.139126+0000","last_fullsized":"2024-02-17T00:37:54.139126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:03:59.772931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139584+0000","last_change":"2024-02-17T00:37:51.713824+0000","last_active":"2024-02-17T00:37:54.139584+0000","last_peered":"2024-02-17T00:37:54.139584+0000","last_clean":"2024-02-17T00:37:54.139584+0000","last_became_active":"2024-02-17T00:37:51.713450+0000","last_became_peered":"2024-02-17T00:37:51.713450+0000","last_unstale":"2024-02-17T00:37:54.139584+0000","last_undegraded":"2024-02-17T00:37:54.139584+0000","last_fullsized":"2024-02-17T00:37:54.139584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:18:41.266050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693730+0000","last_change":"2024-02-17T00:37:51.715911+0000","last_active":"2024-02-17T00:37:53.693730+0000","last_peered":"2024-02-17T00:37:53.693730+0000","last_clean":"2024-02-17T00:37:53.693730+0000","last_became_active":"2024-02-17T00:37:51.715549+0000","last_became_peered":"2024-02-17T00:37:51.715549+0000","last_unstale":"2024-02-17T00:37:53.693730+0000","last_undegraded":"2024-02-17T00:37:53.693730+0000","last_fullsized":"2024-02-17T00:37:53.693730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:37:15.067883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692761+0000","last_change":"2024-02-17T00:37:51.721791+0000","last_active":"2024-02-17T00:37:52.692761+0000","last_peered":"2024-02-17T00:37:52.692761+0000","last_clean":"2024-02-17T00:37:52.692761+0000","last_became_active":"2024-02-17T00:37:51.721528+0000","last_became_peered":"2024-02-17T00:37:51.721528+0000","last_unstale":"2024-02-17T00:37:52.692761+0000","last_undegraded":"2024-02-17T00:37:52.692761+0000","last_fullsized":"2024-02-17T00:37:52.692761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:53:49.192425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138909+0000","last_change":"2024-02-17T00:37:51.707329+0000","last_active":"2024-02-17T00:37:54.138909+0000","last_peered":"2024-02-17T00:37:54.138909+0000","last_clean":"2024-02-17T00:37:54.138909+0000","last_became_active":"2024-02-17T00:37:51.706973+0000","last_became_peered":"2024-02-17T00:37:51.706973+0000","last_unstale":"2024-02-17T00:37:54.138909+0000","last_undegraded":"2024-02-17T00:37:54.138909+0000","last_fullsized":"2024-02-17T00:37:54.138909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:54:46.360178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139257+0000","last_change":"2024-02-17T00:37:51.707734+0000","last_active":"2024-02-17T00:37:54.139257+0000","last_peered":"2024-02-17T00:37:54.139257+0000","last_clean":"2024-02-17T00:37:54.139257+0000","last_became_active":"2024-02-17T00:37:51.707296+0000","last_became_peered":"2024-02-17T00:37:51.707296+0000","last_unstale":"2024-02-17T00:37:54.139257+0000","last_undegraded":"2024-02-17T00:37:54.139257+0000","last_fullsized":"2024-02-17T00:37:54.139257+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:20:04.075543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692594+0000","last_change":"2024-02-17T00:37:51.711731+0000","last_active":"2024-02-17T00:37:52.692594+0000","last_peered":"2024-02-17T00:37:52.692594+0000","last_clean":"2024-02-17T00:37:52.692594+0000","last_became_active":"2024-02-17T00:37:51.711448+0000","last_became_peered":"2024-02-17T00:37:51.711448+0000","last_unstale":"2024-02-17T00:37:52.692594+0000","last_undegraded":"2024-02-17T00:37:52.692594+0000","last_fullsized":"2024-02-17T00:37:52.692594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:53:51.108087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139542+0000","last_change":"2024-02-17T00:37:51.719992+0000","last_active":"2024-02-17T00:37:54.139542+0000","last_peered":"2024-02-17T00:37:54.139542+0000","last_clean":"2024-02-17T00:37:54.139542+0000","last_became_active":"2024-02-17T00:37:51.719733+0000","last_became_peered":"2024-02-17T00:37:51.719733+0000","last_unstale":"2024-02-17T00:37:54.139542+0000","last_undegraded":"2024-02-17T00:37:54.139542+0000","last_fullsized":"2024-02-17T00:37:54.139542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:42:36.450689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139102+0000","last_change":"2024-02-17T00:37:51.697017+0000","last_active":"2024-02-17T00:37:54.139102+0000","last_peered":"2024-02-17T00:37:54.139102+0000","last_clean":"2024-02-17T00:37:54.139102+0000","last_became_active":"2024-02-17T00:37:51.696734+0000","last_became_peered":"2024-02-17T00:37:51.696734+0000","last_unstale":"2024-02-17T00:37:54.139102+0000","last_undegraded":"2024-02-17T00:37:54.139102+0000","last_fullsized":"2024-02-17T00:37:54.139102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:26:51.731446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139066+0000","last_change":"2024-02-17T00:37:50.700432+0000","last_active":"2024-02-17T00:37:54.139066+0000","last_peered":"2024-02-17T00:37:54.139066+0000","last_clean":"2024-02-17T00:37:54.139066+0000","last_became_active":"2024-02-17T00:37:50.700148+0000","last_became_peered":"2024-02-17T00:37:50.700148+0000","last_unstale":"2024-02-17T00:37:54.139066+0000","last_undegraded":"2024-02-17T00:37:54.139066+0000","last_fullsized":"2024-02-17T00:37:54.139066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:02:52.343817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692539+0000","last_change":"2024-02-17T00:37:51.708681+0000","last_active":"2024-02-17T00:37:52.692539+0000","last_peered":"2024-02-17T00:37:52.692539+0000","last_clean":"2024-02-17T00:37:52.692539+0000","last_became_active":"2024-02-17T00:37:51.708402+0000","last_became_peered":"2024-02-17T00:37:51.708402+0000","last_unstale":"2024-02-17T00:37:52.692539+0000","last_undegraded":"2024-02-17T00:37:52.692539+0000","last_fullsized":"2024-02-17T00:37:52.692539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:57:25.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692632+0000","last_change":"2024-02-17T00:37:50.700499+0000","last_active":"2024-02-17T00:37:52.692632+0000","last_peered":"2024-02-17T00:37:52.692632+0000","last_clean":"2024-02-17T00:37:52.692632+0000","last_became_active":"2024-02-17T00:37:50.700107+0000","last_became_peered":"2024-02-17T00:37:50.700107+0000","last_unstale":"2024-02-17T00:37:52.692632+0000","last_undegraded":"2024-02-17T00:37:52.692632+0000","last_fullsized":"2024-02-17T00:37:52.692632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:42:21.569321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139474+0000","last_change":"2024-02-17T00:37:51.698298+0000","last_active":"2024-02-17T00:37:54.139474+0000","last_peered":"2024-02-17T00:37:54.139474+0000","last_clean":"2024-02-17T00:37:54.139474+0000","last_became_active":"2024-02-17T00:37:51.698030+0000","last_became_peered":"2024-02-17T00:37:51.698030+0000","last_unstale":"2024-02-17T00:37:54.139474+0000","last_undegraded":"2024-02-17T00:37:54.139474+0000","last_fullsized":"2024-02-17T00:37:54.139474+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:59:28.032618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139668+0000","last_change":"2024-02-17T00:37:50.701177+0000","last_active":"2024-02-17T00:37:54.139668+0000","last_peered":"2024-02-17T00:37:54.139668+0000","last_clean":"2024-02-17T00:37:54.139668+0000","last_became_active":"2024-02-17T00:37:50.700836+0000","last_became_peered":"2024-02-17T00:37:50.700836+0000","last_unstale":"2024-02-17T00:37:54.139668+0000","last_undegraded":"2024-02-17T00:37:54.139668+0000","last_fullsized":"2024-02-17T00:37:54.139668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:06:48.764698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692819+0000","last_change":"2024-02-17T00:37:51.707948+0000","last_active":"2024-02-17T00:37:52.692819+0000","last_peered":"2024-02-17T00:37:52.692819+0000","last_clean":"2024-02-17T00:37:52.692819+0000","last_became_active":"2024-02-17T00:37:51.707621+0000","last_became_peered":"2024-02-17T00:37:51.707621+0000","last_unstale":"2024-02-17T00:37:52.692819+0000","last_undegraded":"2024-02-17T00:37:52.692819+0000","last_fullsized":"2024-02-17T00:37:52.692819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:31.093234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138983+0000","last_change":"2024-02-17T00:37:50.705103+0000","last_active":"2024-02-17T00:37:54.138983+0000","last_peered":"2024-02-17T00:37:54.138983+0000","last_clean":"2024-02-17T00:37:54.138983+0000","last_became_active":"2024-02-17T00:37:50.704781+0000","last_became_peered":"2024-02-17T00:37:50.704781+0000","last_unstale":"2024-02-17T00:37:54.138983+0000","last_undegraded":"2024-02-17T00:37:54.138983+0000","last_fullsized":"2024-02-17T00:37:54.138983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:50.198103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139593+0000","last_change":"2024-02-17T00:37:51.717967+0000","last_active":"2024-02-17T00:37:54.139593+0000","last_peered":"2024-02-17T00:37:54.139593+0000","last_clean":"2024-02-17T00:37:54.139593+0000","last_became_active":"2024-02-17T00:37:51.714198+0000","last_became_peered":"2024-02-17T00:37:51.714198+0000","last_unstale":"2024-02-17T00:37:54.139593+0000","last_undegraded":"2024-02-17T00:37:54.139593+0000","last_fullsized":"2024-02-17T00:37:54.139593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:06:52.689176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138700+0000","last_change":"2024-02-17T00:37:50.707754+0000","last_active":"2024-02-17T00:37:54.138700+0000","last_peered":"2024-02-17T00:37:54.138700+0000","last_clean":"2024-02-17T00:37:54.138700+0000","last_became_active":"2024-02-17T00:37:50.707452+0000","last_became_peered":"2024-02-17T00:37:50.707452+0000","last_unstale":"2024-02-17T00:37:54.138700+0000","last_undegraded":"2024-02-17T00:37:54.138700+0000","last_fullsized":"2024-02-17T00:37:54.138700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:29.190786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693238+0000","last_change":"2024-02-17T00:37:51.713383+0000","last_active":"2024-02-17T00:37:53.693238+0000","last_peered":"2024-02-17T00:37:53.693238+0000","last_clean":"2024-02-17T00:37:53.693238+0000","last_became_active":"2024-02-17T00:37:51.713092+0000","last_became_peered":"2024-02-17T00:37:51.713092+0000","last_unstale":"2024-02-17T00:37:53.693238+0000","last_undegraded":"2024-02-17T00:37:53.693238+0000","last_fullsized":"2024-02-17T00:37:53.693238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:21:21.672973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692529+0000","last_change":"2024-02-17T00:37:50.709448+0000","last_active":"2024-02-17T00:37:52.692529+0000","last_peered":"2024-02-17T00:37:52.692529+0000","last_clean":"2024-02-17T00:37:52.692529+0000","last_became_active":"2024-02-17T00:37:50.709176+0000","last_became_peered":"2024-02-17T00:37:50.709176+0000","last_unstale":"2024-02-17T00:37:52.692529+0000","last_undegraded":"2024-02-17T00:37:52.692529+0000","last_fullsized":"2024-02-17T00:37:52.692529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:04:44.514209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139343+0000","last_change":"2024-02-17T00:37:51.711719+0000","last_active":"2024-02-17T00:37:54.139343+0000","last_peered":"2024-02-17T00:37:54.139343+0000","last_clean":"2024-02-17T00:37:54.139343+0000","last_became_active":"2024-02-17T00:37:51.711428+0000","last_became_peered":"2024-02-17T00:37:51.711428+0000","last_unstale":"2024-02-17T00:37:54.139343+0000","last_undegraded":"2024-02-17T00:37:54.139343+0000","last_fullsized":"2024-02-17T00:37:54.139343+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:50:58.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139804+0000","last_change":"2024-02-17T00:37:50.708963+0000","last_active":"2024-02-17T00:37:54.139804+0000","last_peered":"2024-02-17T00:37:54.139804+0000","last_clean":"2024-02-17T00:37:54.139804+0000","last_became_active":"2024-02-17T00:37:50.708613+0000","last_became_peered":"2024-02-17T00:37:50.708613+0000","last_unstale":"2024-02-17T00:37:54.139804+0000","last_undegraded":"2024-02-17T00:37:54.139804+0000","last_fullsized":"2024-02-17T00:37:54.139804+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:03:58.770505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692488+0000","last_change":"2024-02-17T00:37:51.710023+0000","last_active":"2024-02-17T00:37:52.692488+0000","last_peered":"2024-02-17T00:37:52.692488+0000","last_clean":"2024-02-17T00:37:52.692488+0000","last_became_active":"2024-02-17T00:37:51.708800+0000","last_became_peered":"2024-02-17T00:37:51.708800+0000","last_unstale":"2024-02-17T00:37:52.692488+0000","last_undegraded":"2024-02-17T00:37:52.692488+0000","last_fullsized":"2024-02-17T00:37:52.692488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:21:21.672973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692484+0000","last_change":"2024-02-17T00:37:50.703015+0000","last_active":"2024-02-17T00:37:52.692484+0000","last_peered":"2024-02-17T00:37:52.692484+0000","last_clean":"2024-02-17T00:37:52.692484+0000","last_became_active":"2024-02-17T00:37:50.702382+0000","last_became_peered":"2024-02-17T00:37:50.702382+0000","last_unstale":"2024-02-17T00:37:52.692484+0000","last_undegraded":"2024-02-17T00:37:52.692484+0000","last_fullsized":"2024-02-17T00:37:52.692484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:09:10.315447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140072+0000","last_change":"2024-02-17T00:37:51.720728+0000","last_active":"2024-02-17T00:37:54.140072+0000","last_peered":"2024-02-17T00:37:54.140072+0000","last_clean":"2024-02-17T00:37:54.140072+0000","last_became_active":"2024-02-17T00:37:51.719830+0000","last_became_peered":"2024-02-17T00:37:51.719830+0000","last_unstale":"2024-02-17T00:37:54.140072+0000","last_undegraded":"2024-02-17T00:37:54.140072+0000","last_fullsized":"2024-02-17T00:37:54.140072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:49:14.453244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140102+0000","last_change":"2024-02-17T00:37:50.705108+0000","last_active":"2024-02-17T00:37:54.140102+0000","last_peered":"2024-02-17T00:37:54.140102+0000","last_clean":"2024-02-17T00:37:54.140102+0000","last_became_active":"2024-02-17T00:37:50.704784+0000","last_became_peered":"2024-02-17T00:37:50.704784+0000","last_unstale":"2024-02-17T00:37:54.140102+0000","last_undegraded":"2024-02-17T00:37:54.140102+0000","last_fullsized":"2024-02-17T00:37:54.140102+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:41:31.931489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138841+0000","last_change":"2024-02-17T00:37:51.707091+0000","last_active":"2024-02-17T00:37:54.138841+0000","last_peered":"2024-02-17T00:37:54.138841+0000","last_clean":"2024-02-17T00:37:54.138841+0000","last_became_active":"2024-02-17T00:37:51.706791+0000","last_became_peered":"2024-02-17T00:37:51.706791+0000","last_unstale":"2024-02-17T00:37:54.138841+0000","last_undegraded":"2024-02-17T00:37:54.138841+0000","last_fullsized":"2024-02-17T00:37:54.138841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:23:06.201525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139377+0000","last_change":"2024-02-17T00:37:50.703886+0000","last_active":"2024-02-17T00:37:54.139377+0000","last_peered":"2024-02-17T00:37:54.139377+0000","last_clean":"2024-02-17T00:37:54.139377+0000","last_became_active":"2024-02-17T00:37:50.703591+0000","last_became_peered":"2024-02-17T00:37:50.703591+0000","last_unstale":"2024-02-17T00:37:54.139377+0000","last_undegraded":"2024-02-17T00:37:54.139377+0000","last_fullsized":"2024-02-17T00:37:54.139377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:42:35.448263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140025+0000","last_change":"2024-02-17T00:37:51.712731+0000","last_active":"2024-02-17T00:37:54.140025+0000","last_peered":"2024-02-17T00:37:54.140025+0000","last_clean":"2024-02-17T00:37:54.140025+0000","last_became_active":"2024-02-17T00:37:51.712478+0000","last_became_peered":"2024-02-17T00:37:51.712478+0000","last_unstale":"2024-02-17T00:37:54.140025+0000","last_undegraded":"2024-02-17T00:37:54.140025+0000","last_fullsized":"2024-02-17T00:37:54.140025+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:06:40.870602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138898+0000","last_change":"2024-02-17T00:37:50.711303+0000","last_active":"2024-02-17T00:37:54.138898+0000","last_peered":"2024-02-17T00:37:54.138898+0000","last_clean":"2024-02-17T00:37:54.138898+0000","last_became_active":"2024-02-17T00:37:50.710966+0000","last_became_peered":"2024-02-17T00:37:50.710966+0000","last_unstale":"2024-02-17T00:37:54.138898+0000","last_undegraded":"2024-02-17T00:37:54.138898+0000","last_fullsized":"2024-02-17T00:37:54.138898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T08:12:49.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692905+0000","last_change":"2024-02-17T00:37:51.716614+0000","last_active":"2024-02-17T00:37:52.692905+0000","last_peered":"2024-02-17T00:37:52.692905+0000","last_clean":"2024-02-17T00:37:52.692905+0000","last_became_active":"2024-02-17T00:37:51.716325+0000","last_became_peered":"2024-02-17T00:37:51.716325+0000","last_unstale":"2024-02-17T00:37:52.692905+0000","last_undegraded":"2024-02-17T00:37:52.692905+0000","last_fullsized":"2024-02-17T00:37:52.692905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:30.193212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139943+0000","last_change":"2024-02-17T00:37:50.706314+0000","last_active":"2024-02-17T00:37:54.139943+0000","last_peered":"2024-02-17T00:37:54.139943+0000","last_clean":"2024-02-17T00:37:54.139943+0000","last_became_active":"2024-02-17T00:37:50.705955+0000","last_became_peered":"2024-02-17T00:37:50.705955+0000","last_unstale":"2024-02-17T00:37:54.139943+0000","last_undegraded":"2024-02-17T00:37:54.139943+0000","last_fullsized":"2024-02-17T00:37:54.139943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:23:05.199099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140026+0000","last_change":"2024-02-17T00:37:51.718120+0000","last_active":"2024-02-17T00:37:54.140026+0000","last_peered":"2024-02-17T00:37:54.140026+0000","last_clean":"2024-02-17T00:37:54.140026+0000","last_became_active":"2024-02-17T00:37:51.714614+0000","last_became_peered":"2024-02-17T00:37:51.714614+0000","last_unstale":"2024-02-17T00:37:54.140026+0000","last_undegraded":"2024-02-17T00:37:54.140026+0000","last_fullsized":"2024-02-17T00:37:54.140026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T01:25:25.581637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139658+0000","last_change":"2024-02-17T00:37:50.704248+0000","last_active":"2024-02-17T00:37:54.139658+0000","last_peered":"2024-02-17T00:37:54.139658+0000","last_clean":"2024-02-17T00:37:54.139658+0000","last_became_active":"2024-02-17T00:37:50.703929+0000","last_became_peered":"2024-02-17T00:37:50.703929+0000","last_unstale":"2024-02-17T00:37:54.139658+0000","last_undegraded":"2024-02-17T00:37:54.139658+0000","last_fullsized":"2024-02-17T00:37:54.139658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:15:23.482338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692422+0000","last_change":"2024-02-17T00:37:51.714358+0000","last_active":"2024-02-17T00:37:52.692422+0000","last_peered":"2024-02-17T00:37:52.692422+0000","last_clean":"2024-02-17T00:37:52.692422+0000","last_became_active":"2024-02-17T00:37:51.713509+0000","last_became_peered":"2024-02-17T00:37:51.713509+0000","last_unstale":"2024-02-17T00:37:52.692422+0000","last_undegraded":"2024-02-17T00:37:52.692422+0000","last_fullsized":"2024-02-17T00:37:52.692422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:54:58.706505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692833+0000","last_change":"2024-02-17T00:37:50.699504+0000","last_active":"2024-02-17T00:37:52.692833+0000","last_peered":"2024-02-17T00:37:52.692833+0000","last_clean":"2024-02-17T00:37:52.692833+0000","last_became_active":"2024-02-17T00:37:50.698654+0000","last_became_peered":"2024-02-17T00:37:50.698654+0000","last_unstale":"2024-02-17T00:37:52.692833+0000","last_undegraded":"2024-02-17T00:37:52.692833+0000","last_fullsized":"2024-02-17T00:37:52.692833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:55:36.145339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693595+0000","last_change":"2024-02-17T00:37:51.712364+0000","last_active":"2024-02-17T00:37:53.693595+0000","last_peered":"2024-02-17T00:37:53.693595+0000","last_clean":"2024-02-17T00:37:53.693595+0000","last_became_active":"2024-02-17T00:37:51.712047+0000","last_became_peered":"2024-02-17T00:37:51.712047+0000","last_unstale":"2024-02-17T00:37:53.693595+0000","last_undegraded":"2024-02-17T00:37:53.693595+0000","last_fullsized":"2024-02-17T00:37:53.693595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:03:50.470764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138970+0000","last_change":"2024-02-17T00:37:50.707953+0000","last_active":"2024-02-17T00:37:54.138970+0000","last_peered":"2024-02-17T00:37:54.138970+0000","last_clean":"2024-02-17T00:37:54.138970+0000","last_became_active":"2024-02-17T00:37:50.707684+0000","last_became_peered":"2024-02-17T00:37:50.707684+0000","last_unstale":"2024-02-17T00:37:54.138970+0000","last_undegraded":"2024-02-17T00:37:54.138970+0000","last_fullsized":"2024-02-17T00:37:54.138970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:02:19.796533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693589+0000","last_change":"2024-02-17T00:37:51.716454+0000","last_active":"2024-02-17T00:37:52.693589+0000","last_peered":"2024-02-17T00:37:52.693589+0000","last_clean":"2024-02-17T00:37:52.693589+0000","last_became_active":"2024-02-17T00:37:51.716112+0000","last_became_peered":"2024-02-17T00:37:51.716112+0000","last_unstale":"2024-02-17T00:37:52.693589+0000","last_undegraded":"2024-02-17T00:37:52.693589+0000","last_fullsized":"2024-02-17T00:37:52.693589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T04:17:58.554817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138673+0000","last_change":"2024-02-17T00:37:50.698934+0000","last_active":"2024-02-17T00:37:54.138673+0000","last_peered":"2024-02-17T00:37:54.138673+0000","last_clean":"2024-02-17T00:37:54.138673+0000","last_became_active":"2024-02-17T00:37:50.698575+0000","last_became_peered":"2024-02-17T00:37:50.698575+0000","last_unstale":"2024-02-17T00:37:54.138673+0000","last_undegraded":"2024-02-17T00:37:54.138673+0000","last_fullsized":"2024-02-17T00:37:54.138673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:55:36.145339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692270+0000","last_change":"2024-02-17T00:37:51.717801+0000","last_active":"2024-02-17T00:37:52.692270+0000","last_peered":"2024-02-17T00:37:52.692270+0000","last_clean":"2024-02-17T00:37:52.692270+0000","last_became_active":"2024-02-17T00:37:51.717465+0000","last_became_peered":"2024-02-17T00:37:51.717465+0000","last_unstale":"2024-02-17T00:37:52.692270+0000","last_undegraded":"2024-02-17T00:37:52.692270+0000","last_fullsized":"2024-02-17T00:37:52.692270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:50:01.036630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692813+0000","last_change":"2024-02-17T00:37:50.708483+0000","last_active":"2024-02-17T00:37:52.692813+0000","last_peered":"2024-02-17T00:37:52.692813+0000","last_clean":"2024-02-17T00:37:52.692813+0000","last_became_active":"2024-02-17T00:37:50.708165+0000","last_became_peered":"2024-02-17T00:37:50.708165+0000","last_unstale":"2024-02-17T00:37:52.692813+0000","last_undegraded":"2024-02-17T00:37:52.692813+0000","last_fullsized":"2024-02-17T00:37:52.692813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:59:01.626008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692842+0000","last_change":"2024-02-17T00:37:51.722325+0000","last_active":"2024-02-17T00:37:52.692842+0000","last_peered":"2024-02-17T00:37:52.692842+0000","last_clean":"2024-02-17T00:37:52.692842+0000","last_became_active":"2024-02-17T00:37:51.722020+0000","last_became_peered":"2024-02-17T00:37:51.722020+0000","last_unstale":"2024-02-17T00:37:52.692842+0000","last_undegraded":"2024-02-17T00:37:52.692842+0000","last_fullsized":"2024-02-17T00:37:52.692842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T00:42:22.571747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139473+0000","last_change":"2024-02-17T00:37:50.711187+0000","last_active":"2024-02-17T00:37:54.139473+0000","last_peered":"2024-02-17T00:37:54.139473+0000","last_clean":"2024-02-17T00:37:54.139473+0000","last_became_active":"2024-02-17T00:37:50.710262+0000","last_became_peered":"2024-02-17T00:37:50.710262+0000","last_unstale":"2024-02-17T00:37:54.139473+0000","last_undegraded":"2024-02-17T00:37:54.139473+0000","last_fullsized":"2024-02-17T00:37:54.139473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:18:40.263624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692887+0000","last_change":"2024-02-17T00:37:51.716091+0000","last_active":"2024-02-17T00:37:52.692887+0000","last_peered":"2024-02-17T00:37:52.692887+0000","last_clean":"2024-02-17T00:37:52.692887+0000","last_became_active":"2024-02-17T00:37:51.715824+0000","last_became_peered":"2024-02-17T00:37:51.715824+0000","last_unstale":"2024-02-17T00:37:52.692887+0000","last_undegraded":"2024-02-17T00:37:52.692887+0000","last_fullsized":"2024-02-17T00:37:52.692887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:51.200529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693431+0000","last_change":"2024-02-17T00:37:50.707696+0000","last_active":"2024-02-17T00:37:52.693431+0000","last_peered":"2024-02-17T00:37:52.693431+0000","last_clean":"2024-02-17T00:37:52.693431+0000","last_became_active":"2024-02-17T00:37:50.707097+0000","last_became_peered":"2024-02-17T00:37:50.707097+0000","last_unstale":"2024-02-17T00:37:52.693431+0000","last_undegraded":"2024-02-17T00:37:52.693431+0000","last_fullsized":"2024-02-17T00:37:52.693431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:30:26.693300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139829+0000","last_change":"2024-02-17T00:37:51.715769+0000","last_active":"2024-02-17T00:37:54.139829+0000","last_peered":"2024-02-17T00:37:54.139829+0000","last_clean":"2024-02-17T00:37:54.139829+0000","last_became_active":"2024-02-17T00:37:51.715481+0000","last_became_peered":"2024-02-17T00:37:51.715481+0000","last_unstale":"2024-02-17T00:37:54.139829+0000","last_undegraded":"2024-02-17T00:37:54.139829+0000","last_fullsized":"2024-02-17T00:37:54.139829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:36:59.123131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139395+0000","last_change":"2024-02-17T00:37:50.702648+0000","last_active":"2024-02-17T00:37:54.139395+0000","last_peered":"2024-02-17T00:37:54.139395+0000","last_clean":"2024-02-17T00:37:54.139395+0000","last_became_active":"2024-02-17T00:37:50.702347+0000","last_became_peered":"2024-02-17T00:37:50.702347+0000","last_unstale":"2024-02-17T00:37:54.139395+0000","last_undegraded":"2024-02-17T00:37:54.139395+0000","last_fullsized":"2024-02-17T00:37:54.139395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:15:23.482338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.138682+0000","last_change":"2024-02-17T00:37:51.708320+0000","last_active":"2024-02-17T00:37:54.138682+0000","last_peered":"2024-02-17T00:37:54.138682+0000","last_clean":"2024-02-17T00:37:54.138682+0000","last_became_active":"2024-02-17T00:37:51.707249+0000","last_became_peered":"2024-02-17T00:37:51.707249+0000","last_unstale":"2024-02-17T00:37:54.138682+0000","last_undegraded":"2024-02-17T00:37:54.138682+0000","last_fullsized":"2024-02-17T00:37:54.138682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T09:04:37.721865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139632+0000","last_change":"2024-02-17T00:37:50.707588+0000","last_active":"2024-02-17T00:37:54.139632+0000","last_peered":"2024-02-17T00:37:54.139632+0000","last_clean":"2024-02-17T00:37:54.139632+0000","last_became_active":"2024-02-17T00:37:50.707254+0000","last_became_peered":"2024-02-17T00:37:50.707254+0000","last_unstale":"2024-02-17T00:37:54.139632+0000","last_undegraded":"2024-02-17T00:37:54.139632+0000","last_fullsized":"2024-02-17T00:37:54.139632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:22:42.427321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139359+0000","last_change":"2024-02-17T00:37:51.719200+0000","last_active":"2024-02-17T00:37:54.139359+0000","last_peered":"2024-02-17T00:37:54.139359+0000","last_clean":"2024-02-17T00:37:54.139359+0000","last_became_active":"2024-02-17T00:37:51.718967+0000","last_became_peered":"2024-02-17T00:37:51.718967+0000","last_unstale":"2024-02-17T00:37:54.139359+0000","last_undegraded":"2024-02-17T00:37:54.139359+0000","last_fullsized":"2024-02-17T00:37:54.139359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:02:42.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692971+0000","last_change":"2024-02-17T00:37:50.708699+0000","last_active":"2024-02-17T00:37:52.692971+0000","last_peered":"2024-02-17T00:37:52.692971+0000","last_clean":"2024-02-17T00:37:52.692971+0000","last_became_active":"2024-02-17T00:37:50.708213+0000","last_became_peered":"2024-02-17T00:37:50.708213+0000","last_unstale":"2024-02-17T00:37:52.692971+0000","last_undegraded":"2024-02-17T00:37:52.692971+0000","last_fullsized":"2024-02-17T00:37:52.692971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:50.198103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693276+0000","last_change":"2024-02-17T00:37:51.715118+0000","last_active":"2024-02-17T00:37:53.693276+0000","last_peered":"2024-02-17T00:37:53.693276+0000","last_clean":"2024-02-17T00:37:53.693276+0000","last_became_active":"2024-02-17T00:37:51.714827+0000","last_became_peered":"2024-02-17T00:37:51.714827+0000","last_unstale":"2024-02-17T00:37:53.693276+0000","last_undegraded":"2024-02-17T00:37:53.693276+0000","last_fullsized":"2024-02-17T00:37:53.693276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:57:25.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692635+0000","last_change":"2024-02-17T00:37:50.709208+0000","last_active":"2024-02-17T00:37:52.692635+0000","last_peered":"2024-02-17T00:37:52.692635+0000","last_clean":"2024-02-17T00:37:52.692635+0000","last_became_active":"2024-02-17T00:37:50.708872+0000","last_became_peered":"2024-02-17T00:37:50.708872+0000","last_unstale":"2024-02-17T00:37:52.692635+0000","last_undegraded":"2024-02-17T00:37:52.692635+0000","last_fullsized":"2024-02-17T00:37:52.692635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:10:49.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139961+0000","last_change":"2024-02-17T00:37:51.720975+0000","last_active":"2024-02-17T00:37:54.139961+0000","last_peered":"2024-02-17T00:37:54.139961+0000","last_clean":"2024-02-17T00:37:54.139961+0000","last_became_active":"2024-02-17T00:37:51.720385+0000","last_became_peered":"2024-02-17T00:37:51.720385+0000","last_unstale":"2024-02-17T00:37:54.139961+0000","last_undegraded":"2024-02-17T00:37:54.139961+0000","last_fullsized":"2024-02-17T00:37:54.139961+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:45:32.200839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692054+0000","last_change":"2024-02-17T00:37:50.702166+0000","last_active":"2024-02-17T00:37:52.692054+0000","last_peered":"2024-02-17T00:37:52.692054+0000","last_clean":"2024-02-17T00:37:52.692054+0000","last_became_active":"2024-02-17T00:37:50.701904+0000","last_became_peered":"2024-02-17T00:37:50.701904+0000","last_unstale":"2024-02-17T00:37:52.692054+0000","last_undegraded":"2024-02-17T00:37:52.692054+0000","last_fullsized":"2024-02-17T00:37:52.692054+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:29.190786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693612+0000","last_change":"2024-02-17T00:37:51.715709+0000","last_active":"2024-02-17T00:37:52.693612+0000","last_peered":"2024-02-17T00:37:52.693612+0000","last_clean":"2024-02-17T00:37:52.693612+0000","last_became_active":"2024-02-17T00:37:51.715427+0000","last_became_peered":"2024-02-17T00:37:51.715427+0000","last_unstale":"2024-02-17T00:37:52.693612+0000","last_undegraded":"2024-02-17T00:37:52.693612+0000","last_fullsized":"2024-02-17T00:37:52.693612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:01:01.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139377+0000","last_change":"2024-02-17T00:37:50.709632+0000","last_active":"2024-02-17T00:37:54.139377+0000","last_peered":"2024-02-17T00:37:54.139377+0000","last_clean":"2024-02-17T00:37:54.139377+0000","last_became_active":"2024-02-17T00:37:50.709328+0000","last_became_peered":"2024-02-17T00:37:50.709328+0000","last_unstale":"2024-02-17T00:37:54.139377+0000","last_undegraded":"2024-02-17T00:37:54.139377+0000","last_fullsized":"2024-02-17T00:37:54.139377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T11:02:41.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693678+0000","last_change":"2024-02-17T00:37:51.715839+0000","last_active":"2024-02-17T00:37:53.693678+0000","last_peered":"2024-02-17T00:37:53.693678+0000","last_clean":"2024-02-17T00:37:53.693678+0000","last_became_active":"2024-02-17T00:37:51.715303+0000","last_became_peered":"2024-02-17T00:37:51.715303+0000","last_unstale":"2024-02-17T00:37:53.693678+0000","last_undegraded":"2024-02-17T00:37:53.693678+0000","last_fullsized":"2024-02-17T00:37:53.693678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:08:44.947732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693673+0000","last_change":"2024-02-17T00:37:50.707462+0000","last_active":"2024-02-17T00:37:52.693673+0000","last_peered":"2024-02-17T00:37:52.693673+0000","last_clean":"2024-02-17T00:37:52.693673+0000","last_became_active":"2024-02-17T00:37:50.707079+0000","last_became_peered":"2024-02-17T00:37:50.707079+0000","last_unstale":"2024-02-17T00:37:52.693673+0000","last_undegraded":"2024-02-17T00:37:52.693673+0000","last_fullsized":"2024-02-17T00:37:52.693673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:48.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139481+0000","last_change":"2024-02-17T00:37:51.710691+0000","last_active":"2024-02-17T00:37:54.139481+0000","last_peered":"2024-02-17T00:37:54.139481+0000","last_clean":"2024-02-17T00:37:54.139481+0000","last_became_active":"2024-02-17T00:37:51.710406+0000","last_became_peered":"2024-02-17T00:37:51.710406+0000","last_unstale":"2024-02-17T00:37:54.139481+0000","last_undegraded":"2024-02-17T00:37:54.139481+0000","last_fullsized":"2024-02-17T00:37:54.139481+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:50:01.036630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693584+0000","last_change":"2024-02-17T00:37:50.709902+0000","last_active":"2024-02-17T00:37:52.693584+0000","last_peered":"2024-02-17T00:37:52.693584+0000","last_clean":"2024-02-17T00:37:52.693584+0000","last_became_active":"2024-02-17T00:37:50.709574+0000","last_became_peered":"2024-02-17T00:37:50.709574+0000","last_unstale":"2024-02-17T00:37:52.693584+0000","last_undegraded":"2024-02-17T00:37:52.693584+0000","last_fullsized":"2024-02-17T00:37:52.693584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:58.955350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.693416+0000","last_change":"2024-02-17T00:37:51.720548+0000","last_active":"2024-02-17T00:37:52.693416+0000","last_peered":"2024-02-17T00:37:52.693416+0000","last_clean":"2024-02-17T00:37:52.693416+0000","last_became_active":"2024-02-17T00:37:51.720050+0000","last_became_peered":"2024-02-17T00:37:51.720050+0000","last_unstale":"2024-02-17T00:37:52.693416+0000","last_undegraded":"2024-02-17T00:37:52.693416+0000","last_fullsized":"2024-02-17T00:37:52.693416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:31:41.301414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139969+0000","last_change":"2024-02-17T00:37:50.702160+0000","last_active":"2024-02-17T00:37:54.139969+0000","last_peered":"2024-02-17T00:37:54.139969+0000","last_clean":"2024-02-17T00:37:54.139969+0000","last_became_active":"2024-02-17T00:37:50.701464+0000","last_became_peered":"2024-02-17T00:37:50.701464+0000","last_unstale":"2024-02-17T00:37:54.139969+0000","last_undegraded":"2024-02-17T00:37:54.139969+0000","last_fullsized":"2024-02-17T00:37:54.139969+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T03:22:42.427321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692273+0000","last_change":"2024-02-17T00:37:51.706948+0000","last_active":"2024-02-17T00:37:52.692273+0000","last_peered":"2024-02-17T00:37:52.692273+0000","last_clean":"2024-02-17T00:37:52.692273+0000","last_became_active":"2024-02-17T00:37:51.706476+0000","last_became_peered":"2024-02-17T00:37:51.706476+0000","last_unstale":"2024-02-17T00:37:52.692273+0000","last_undegraded":"2024-02-17T00:37:52.692273+0000","last_fullsized":"2024-02-17T00:37:52.692273+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:36:59.123131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693455+0000","last_change":"2024-02-17T00:37:50.707220+0000","last_active":"2024-02-17T00:37:53.693455+0000","last_peered":"2024-02-17T00:37:53.693455+0000","last_clean":"2024-02-17T00:37:53.693455+0000","last_became_active":"2024-02-17T00:37:50.706927+0000","last_became_peered":"2024-02-17T00:37:50.706927+0000","last_unstale":"2024-02-17T00:37:53.693455+0000","last_undegraded":"2024-02-17T00:37:53.693455+0000","last_fullsized":"2024-02-17T00:37:53.693455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T06:16:29.190786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139399+0000","last_change":"2024-02-17T00:37:51.718924+0000","last_active":"2024-02-17T00:37:54.139399+0000","last_peered":"2024-02-17T00:37:54.139399+0000","last_clean":"2024-02-17T00:37:54.139399+0000","last_became_active":"2024-02-17T00:37:51.718664+0000","last_became_peered":"2024-02-17T00:37:51.718664+0000","last_unstale":"2024-02-17T00:37:54.139399+0000","last_undegraded":"2024-02-17T00:37:54.139399+0000","last_fullsized":"2024-02-17T00:37:54.139399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T02:04:27.585531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139061+0000","last_change":"2024-02-17T00:37:50.706685+0000","last_active":"2024-02-17T00:37:54.139061+0000","last_peered":"2024-02-17T00:37:54.139061+0000","last_clean":"2024-02-17T00:37:54.139061+0000","last_became_active":"2024-02-17T00:37:50.706376+0000","last_became_peered":"2024-02-17T00:37:50.706376+0000","last_unstale":"2024-02-17T00:37:54.139061+0000","last_undegraded":"2024-02-17T00:37:54.139061+0000","last_fullsized":"2024-02-17T00:37:54.139061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:06:51.686750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693405+0000","last_change":"2024-02-17T00:37:51.715442+0000","last_active":"2024-02-17T00:37:53.693405+0000","last_peered":"2024-02-17T00:37:53.693405+0000","last_clean":"2024-02-17T00:37:53.693405+0000","last_became_active":"2024-02-17T00:37:51.715147+0000","last_became_peered":"2024-02-17T00:37:51.715147+0000","last_unstale":"2024-02-17T00:37:53.693405+0000","last_undegraded":"2024-02-17T00:37:53.693405+0000","last_fullsized":"2024-02-17T00:37:53.693405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:34:31.093234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.140037+0000","last_change":"2024-02-17T00:37:50.706237+0000","last_active":"2024-02-17T00:37:54.140037+0000","last_peered":"2024-02-17T00:37:54.140037+0000","last_clean":"2024-02-17T00:37:54.140037+0000","last_became_active":"2024-02-17T00:37:50.705993+0000","last_became_peered":"2024-02-17T00:37:50.705993+0000","last_unstale":"2024-02-17T00:37:54.140037+0000","last_undegraded":"2024-02-17T00:37:54.140037+0000","last_fullsized":"2024-02-17T00:37:54.140037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:33:45.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:54.139322+0000","last_change":"2024-02-17T00:37:51.708361+0000","last_active":"2024-02-17T00:37:54.139322+0000","last_peered":"2024-02-17T00:37:54.139322+0000","last_clean":"2024-02-17T00:37:54.139322+0000","last_became_active":"2024-02-17T00:37:51.708026+0000","last_became_peered":"2024-02-17T00:37:51.708026+0000","last_unstale":"2024-02-17T00:37:54.139322+0000","last_undegraded":"2024-02-17T00:37:54.139322+0000","last_fullsized":"2024-02-17T00:37:54.139322+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:50.681530+0000","last_clean_scrub_stamp":"2024-02-17T00:37:50.681530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T10:25:51.243894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:53.693258+0000","last_change":"2024-02-17T00:37:50.707905+0000","last_active":"2024-02-17T00:37:53.693258+0000","last_peered":"2024-02-17T00:37:53.693258+0000","last_clean":"2024-02-17T00:37:53.693258+0000","last_became_active":"2024-02-17T00:37:50.707589+0000","last_became_peered":"2024-02-17T00:37:50.707589+0000","last_unstale":"2024-02-17T00:37:53.693258+0000","last_undegraded":"2024-02-17T00:37:53.693258+0000","last_fullsized":"2024-02-17T00:37:53.693258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:37:49.679104+0000","last_clean_scrub_stamp":"2024-02-17T00:37:49.679104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:56:50.198103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":201,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-17T00:37:52.692574+0000","last_change":"2024-02-17T00:36:27.889828+0000","last_active":"2024-02-17T00:37:52.692574+0000","last_peered":"2024-02-17T00:37:52.692574+0000","last_clean":"2024-02-17T00:37:52.692574+0000","last_became_active":"2024-02-17T00:36:27.889573+0000","last_became_peered":"2024-02-17T00:36:27.889573+0000","last_unstale":"2024-02-17T00:37:52.692574+0000","last_undegraded":"2024-02-17T00:37:52.692574+0000","last_fullsized":"2024-02-17T00:37:52.692574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T00:36:26.877139+0000","last_clean_scrub_stamp":"2024-02-17T00:36:26.877139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T07:43:23.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":471040,"data_stored":199487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.499}]},{"osd":1,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.44800000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.38},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33600000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1064960,"data_stored":790403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72199999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":487424,"data_stored":201189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.753},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Feb 17 00:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72499999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.372},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.51100000000000001}]},{"osd":5,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Feb 17 00:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56200000000000006}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":483328,"data_stored":201647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.26300000000000001}]},{"osd":1,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.315},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Feb 17 00:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.67000000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1064960,"data_stored":789843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Feb 17 00:37:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73699999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":475136,"data_stored":199545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.377}]},{"osd":2,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.27000000000000002}]},{"osd":3,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Feb 17 00:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78200000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":199523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.629},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.0839999999999996,"5min":6.0839999999999996,"15min":6.0839999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Feb 17 00:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T00:37:59.470 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T00:37:59.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-17T00:37:59.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.611+0000 7fe0cbc8d640 1 Processor -- start 2024-02-17T00:37:59.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.611+0000 7fe0cbc8d640 1 -- start start 2024-02-17T00:37:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0cbc8d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 0x7fe0c40d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0cbc8d640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40d10a0 con 0x7fe0c40b9130 2024-02-17T00:37:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0cbc8d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40b7ef0 con 0x7fe0c40b9590 2024-02-17T00:37:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0cbc8d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b81d0 con 0x7fe0c40d0780 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c9228640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe0c40b9130 0x7fe0c40d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51796/0 (socket says 172.21.15.32:51796) 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c9228640 1 -- 172.21.15.32:0/1879942980 learned_addr learned my addr 172.21.15.32:0/1879942980 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c9a29640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 0x7fe0c40d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431412933 0 0) 0x7fe0c40d10a0 con 0x7fe0c40b9130 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b0003520 con 0x7fe0c40b9130 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059080895 0 0) 0x7fe0b0003520 con 0x7fe0c40b9130 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 msgr2=0x7fe0c40d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 0x7fe0c40d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 >> v1:172.21.15.39:6789/0 conn(0x7fe0c40b9590 legacy=0x7fe0c40d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40b84b0 con 0x7fe0c40b9130 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fe0b4001670 con 0x7fe0c40b9130 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 >> v1:172.21.15.32:6789/0 conn(0x7fe0c40b9130 legacy=0x7fe0c40d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.612+0000 7fe0c8a27640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 0x7fe0b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c8a27640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0b0003ee0 0x7fe0b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c8a27640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0004d00 0x7fe0b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b81d0 con 0x7fe0b0003ee0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b000b9e0 con 0x7fe0b0004d00 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b000bba0 con 0x7fe0c40d0780 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9228640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0b0003ee0 0x7fe0b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9a29640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 0x7fe0b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0ca22a640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0004d00 0x7fe0b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9228640 1 -- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 msgr2=0x7fe0b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9228640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c40d0780 0x7fe0b00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9228640 1 -- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0004d00 msgr2=0x7fe0b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9228640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0004d00 0x7fe0b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.613+0000 7fe0c9228640 1 -- 172.21.15.32:0/1879942980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0003520 con 0x7fe0b0003ee0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0c9228640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0b0003ee0 0x7fe0b00047c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c210 tx=0x7fe0b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3999d1dadcda78b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4005ad0 con 0x7fe0b0003ee0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4005c50 con 0x7fe0b0003ee0 2024-02-17T00:37:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0c8a27640 1 -- 172.21.15.32:0/1879942980 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b402c810 con 0x7fe0b0003ee0 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/1879942980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0b0003ee0 msgr2=0x7fe0b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/1879942980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0b0003ee0 0x7fe0b00047c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c210 tx=0x7fe0b00057f0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0ca22a640 1 -- 172.21.15.32:0/1879942980 reap_dead start 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/1879942980 shutdown_connections 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/1879942980 >> 172.21.15.32:0/1879942980 conn(0x7fe0c40726b0 msgr2=0x7fe0c4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/1879942980 shutdown_connections 2024-02-17T00:37:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.614+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/1879942980 wait complete. 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 Processor -- start 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 -- start start 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0003ee0 0x7fe0c40c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 0x7fe0c4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c415fcc0 0x7fe0c4160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c41606b0 con 0x7fe0c40c9810 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c41597f0 con 0x7fe0b0003ee0 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0cbc8d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40ca8f0 con 0x7fe0c415fcc0 2024-02-17T00:37:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0c9228640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 0x7fe0c4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0c9228640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 0x7fe0c4157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42270/0 (socket says 172.21.15.32:42270) 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.616+0000 7fe0c9228640 1 -- 172.21.15.32:0/3912615683 learned_addr learned my addr 172.21.15.32:0/3912615683 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9a29640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0003ee0 0x7fe0c40c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0ca22a640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c415fcc0 0x7fe0c4160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9228640 1 -- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c415fcc0 msgr2=0x7fe0c4160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9228640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c415fcc0 0x7fe0c4160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9228640 1 -- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0003ee0 msgr2=0x7fe0c40c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9228640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0003ee0 0x7fe0c40c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9228640 1 -- 172.21.15.32:0/3912615683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40c84e0 con 0x7fe0c40c9810 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9a29640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0003ee0 0x7fe0c40c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0ca22a640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c415fcc0 0x7fe0c4160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0c9228640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 0x7fe0c4157e90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c270 tx=0x7fe0b4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4039070 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b402cc20 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c40c87c0 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b403c040 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.617+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c40c8d80 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.618+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c40685d0 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.619+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe0b4032070 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.619+0000 7fe0ba7fc640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe0a806b840 0x7fe0a806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.619+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe0b40ab750 con 0x7fe0c40c9810 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.619+0000 7fe0c9a29640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe0a806b840 0x7fe0a806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.620+0000 7fe0c9a29640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe0a806b840 0x7fe0a806dd00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009ab0 tx=0x7fe0c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.623+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0b4075ff0 con 0x7fe0c40c9810 2024-02-17T00:37:59.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.874+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe0c40c8f40 con 0x7fe0c40c9810 2024-02-17T00:37:59.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.876+0000 7fe0ba7fc640 1 -- 172.21.15.32:0/3912615683 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe0b40796b0 con 0x7fe0c40c9810 2024-02-17T00:37:59.879 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-02-17T00:37:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBa/89lSZN9LBAAKBrV6Z7gz+HGueThsfRO3A== 2024-02-17T00:37:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-02-17T00:37:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-02-17T00:37:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-17T00:37:59.879 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe0a806b840 msgr2=0x7fe0a806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe0a806b840 0x7fe0a806dd00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009ab0 tx=0x7fe0c0008040 comp rx=0 tx=0).stop 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 msgr2=0x7fe0c4157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 0x7fe0c4157e90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c270 tx=0x7fe0b4001a00 comp rx=0 tx=0).stop 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 shutdown_connections 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fe0a806b840 0x7fe0a806dd00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe0c415fcc0 0x7fe0c4160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c40c9810 0x7fe0c4157e90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 --2- 172.21.15.32:0/3912615683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0b0003ee0 0x7fe0c40c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 >> 172.21.15.32:0/3912615683 conn(0x7fe0c40726b0 msgr2=0x7fe0c415e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:59.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 shutdown_connections 2024-02-17T00:37:59.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.878+0000 7fe0cbc8d640 1 -- 172.21.15.32:0/3912615683 wait complete. 2024-02-17T00:37:59.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T00:37:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.990+0000 7f804fa64640 1 Processor -- start 2024-02-17T00:37:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.991+0000 7f804fa64640 1 -- start start 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.991+0000 7f804fa64640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80480d0a50 0x7f80480d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.991+0000 7f804fa64640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80480b53b0 0x7f80480d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.991+0000 7f804fa64640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80480d1e80 con 0x7f804815db00 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.991+0000 7f804fa64640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480b5930 con 0x7f80480d0a50 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.991+0000 7f804fa64640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480b5c10 con 0x7f80480b53b0 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80480d0a50 0x7f80480d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80480d0a50 0x7f80480d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42284/0 (socket says 172.21.15.32:42284) 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 -- 172.21.15.32:0/181405110 learned_addr learned my addr 172.21.15.32:0/181405110 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804e001640 1 --2- 172.21.15.32:0/181405110 >> v2:172.21.15.39:3300/0 conn(0x7f80480b53b0 0x7f80480d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 -- 172.21.15.32:0/181405110 >> v2:172.21.15.39:3300/0 conn(0x7f80480b53b0 msgr2=0x7f80480d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:37:59.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 --2- 172.21.15.32:0/181405110 >> v2:172.21.15.39:3300/0 conn(0x7f80480b53b0 0x7f80480d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 -- 172.21.15.32:0/181405110 >> v1:172.21.15.32:6789/0 conn(0x7f804815db00 legacy=0x7f80480d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.992+0000 7f804cfff640 1 -- 172.21.15.32:0/181405110 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480b5ef0 con 0x7f80480d0a50 2024-02-17T00:37:59.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804cfff640 1 --2- 172.21.15.32:0/181405110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80480d0a50 0x7f80480d2330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f80480cdf10 tx=0x7f804402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b167e246f0d480b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f803ffff640 1 -- 172.21.15.32:0/181405110 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044030860 con 0x7f80480d0a50 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f803ffff640 1 -- 172.21.15.32:0/181405110 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80440309c0 con 0x7f80480d0a50 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f803ffff640 1 -- 172.21.15.32:0/181405110 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044030d50 con 0x7f80480d0a50 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804fa64640 1 -- 172.21.15.32:0/181405110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80480d0a50 msgr2=0x7f80480d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804fa64640 1 --2- 172.21.15.32:0/181405110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80480d0a50 0x7f80480d2330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f80480cdf10 tx=0x7f804402b9a0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804fa64640 1 -- 172.21.15.32:0/181405110 shutdown_connections 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804fa64640 1 --2- 172.21.15.32:0/181405110 >> v2:172.21.15.39:3300/0 conn(0x7f80480b53b0 0x7f80480d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804fa64640 1 --2- 172.21.15.32:0/181405110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80480d0a50 0x7f80480d2330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:37:59.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.993+0000 7f804fa64640 1 -- 172.21.15.32:0/181405110 >> 172.21.15.32:0/181405110 conn(0x7f8048072290 msgr2=0x7f80480726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:37:59.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.994+0000 7f804fa64640 1 -- 172.21.15.32:0/181405110 shutdown_connections 2024-02-17T00:37:59.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.994+0000 7f804fa64640 1 -- 172.21.15.32:0/181405110 wait complete. 2024-02-17T00:37:59.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 Processor -- start 2024-02-17T00:37:59.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 -- start start 2024-02-17T00:37:59.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80480b53b0 0x7f804815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80480d0a50 0x7f80480b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 0x7f804814d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480c7720 con 0x7f804815db00 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80481605c0 con 0x7f80480b53b0 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.995+0000 7f804fa64640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80481608a0 con 0x7f80480d0a50 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 0x7f804814d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 0x7f804814d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42298/0 (socket says 172.21.15.32:42298) 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 -- 172.21.15.32:0/1742358358 learned_addr learned my addr 172.21.15.32:0/1742358358 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804cfff640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80480d0a50 0x7f80480b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804d800640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80480b53b0 0x7f804815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 -- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80480d0a50 msgr2=0x7f80480b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80480d0a50 0x7f80480b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 -- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80480b53b0 msgr2=0x7f804815fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80480b53b0 0x7f804815fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 -- 172.21.15.32:0/1742358358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440094d0 con 0x7f804815db00 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804d800640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80480b53b0 0x7f804815fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804e001640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 0x7f804814d9d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8040007e30 tx=0x7f804000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8040014620 con 0x7f804815db00 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804000ee90 con 0x7f804815db00 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8048160b80 con 0x7f804815db00 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400149c0 con 0x7f804815db00 2024-02-17T00:38:00.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.996+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80481f3870 con 0x7f804815db00 2024-02-17T00:38:00.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.997+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8048068fd0 con 0x7f804815db00 2024-02-17T00:38:00.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.998+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8040014b20 con 0x7f804815db00 2024-02-17T00:38:00.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.998+0000 7f803dffb640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f803406b810 0x7f803406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.998+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f804008ac90 con 0x7f804815db00 2024-02-17T00:38:00.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.998+0000 7f804d800640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f803406b810 0x7f803406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:37:59.999+0000 7f804d800640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f803406b810 0x7f803406dcd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f80380015e0 tx=0x7f8038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.002+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80400555b0 con 0x7f804815db00 2024-02-17T00:38:00.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.222+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80480d16b0 con 0x7f804815db00 2024-02-17T00:38:00.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.222+0000 7f803dffb640 1 -- 172.21.15.32:0/1742358358 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f8040058c70 con 0x7f804815db00 2024-02-17T00:38:00.225 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:00.225 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/4067364288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":4067364288},{"type":"v1","addr":"172.21.15.39:6836","nonce":4067364288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5182,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/2995424971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2995424971},{"type":"v1","addr":"172.21.15.32:6834","nonce":2995424971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3597184782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3597184782},{"type":"v1","addr":"172.21.15.32:6835","nonce":3597184782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T00:37:51.052969+0000","modified":"2024-02-17T00:37:53.052790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/3098499346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":3098499346},{"type":"v1","addr":"172.21.15.39:6837","nonce":3098499346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-17T00:38:00.225 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 15 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f803406b810 msgr2=0x7f803406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f803406b810 0x7f803406dcd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f80380015e0 tx=0x7f8038009040 comp rx=0 tx=0).stop 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 msgr2=0x7f804814d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 0x7f804814d9d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8040007e30 tx=0x7f804000e4b0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 shutdown_connections 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f804815db00 0x7f804814d9d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f803406b810 0x7f803406dcd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f80480d0a50 0x7f80480b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 --2- 172.21.15.32:0/1742358358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80480b53b0 0x7f804815fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 >> 172.21.15.32:0/1742358358 conn(0x7f8048072290 msgr2=0x7f804815c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 shutdown_connections 2024-02-17T00:38:00.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.224+0000 7f804fa64640 1 -- 172.21.15.32:0/1742358358 wait complete. 2024-02-17T00:38:00.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T00:37:51.052969+0000', 'modified': '2024-02-17T00:37:53.052790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5349}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5349': {'gid': 5349, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6837/3098499346', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6835', 'nonce': 3098499346}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 3098499346}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T00:38:00.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T00:38:00.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-17T00:38:00.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.746+0000 7f30ca6b5640 1 Processor -- start 2024-02-17T00:38:00.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.746+0000 7f30ca6b5640 1 -- start start 2024-02-17T00:38:00.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30ca6b5640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30c415ed50 0x7f30c406f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30ca6b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c40724b0 0x7f30c4072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30ca6b5640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c415f130 con 0x7f30c406eba0 2024-02-17T00:38:00.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30ca6b5640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40cfb40 con 0x7f30c415ed50 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30ca6b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40af2b0 con 0x7f30c40724b0 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30c415ed50 0x7f30c406f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30c415ed50 0x7f30c406f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42308/0 (socket says 172.21.15.32:42308) 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 -- 172.21.15.32:0/2741083683 learned_addr learned my addr 172.21.15.32:0/2741083683 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c8c52640 1 --2- 172.21.15.32:0/2741083683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c40724b0 0x7f30c4072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 -- 172.21.15.32:0/2741083683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c40724b0 msgr2=0x7f30c4072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 --2- 172.21.15.32:0/2741083683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c40724b0 0x7f30c4072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 -- 172.21.15.32:0/2741083683 >> v1:172.21.15.39:6789/0 conn(0x7f30c406eba0 legacy=0x7f30c40ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.747+0000 7f30c3fff640 1 -- 172.21.15.32:0/2741083683 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c406f870 con 0x7f30c415ed50 2024-02-17T00:38:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.748+0000 7f30c3fff640 1 --2- 172.21.15.32:0/2741083683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c415ed50 0x7f30c406f330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009870 tx=0x7f30b402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c57e02f691fdd6d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.748+0000 7f30c2ffd640 1 -- 172.21.15.32:0/2741083683 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40317c0 con 0x7f30c415ed50 2024-02-17T00:38:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.748+0000 7f30c2ffd640 1 -- 172.21.15.32:0/2741083683 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4031920 con 0x7f30c415ed50 2024-02-17T00:38:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.748+0000 7f30c2ffd640 1 -- 172.21.15.32:0/2741083683 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4031cb0 con 0x7f30c415ed50 2024-02-17T00:38:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2741083683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c415ed50 msgr2=0x7f30c406f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2741083683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c415ed50 0x7f30c406f330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009870 tx=0x7f30b402b860 comp rx=0 tx=0).stop 2024-02-17T00:38:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2741083683 shutdown_connections 2024-02-17T00:38:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2741083683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c40724b0 0x7f30c4072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2741083683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c415ed50 0x7f30c406f330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2741083683 >> 172.21.15.32:0/2741083683 conn(0x7f30c40719c0 msgr2=0x7f30c4071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2741083683 shutdown_connections 2024-02-17T00:38:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.749+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2741083683 wait complete. 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.750+0000 7f30ca6b5640 1 Processor -- start 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.750+0000 7f30ca6b5640 1 -- start start 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30ca6b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30c406eba0 0x7f30c40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30ca6b5640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 0x7f30c414f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30ca6b5640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c415ed50 0x7f30c40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30ca6b5640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40ca490 con 0x7f30c40724b0 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30ca6b5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40ca770 con 0x7f30c406eba0 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30ca6b5640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40caa50 con 0x7f30c415ed50 2024-02-17T00:38:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30c37fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 0x7f30c414f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30c37fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 0x7f30c414f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42324/0 (socket says 172.21.15.32:42324) 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30c37fe640 1 -- 172.21.15.32:0/2459093789 learned_addr learned my addr 172.21.15.32:0/2459093789 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30c3fff640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30c406eba0 0x7f30c40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.751+0000 7f30c8c52640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c415ed50 0x7f30c40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c37fe640 1 -- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c415ed50 msgr2=0x7f30c40b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c37fe640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c415ed50 0x7f30c40b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c37fe640 1 -- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30c406eba0 msgr2=0x7f30c40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c37fe640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30c406eba0 0x7f30c40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c37fe640 1 -- 172.21.15.32:0/2459093789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40094d0 con 0x7f30c40724b0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c37fe640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 0x7f30c414f4f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00c3c0 tx=0x7f30ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c0ff9640 1 -- 172.21.15.32:0/2459093789 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0052d0 con 0x7f30c40724b0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c0ff9640 1 -- 172.21.15.32:0/2459093789 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac005450 con 0x7f30c40724b0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40cad30 con 0x7f30c40724b0 2024-02-17T00:38:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30c0ff9640 1 -- 172.21.15.32:0/2459093789 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac007260 con 0x7f30c40724b0 2024-02-17T00:38:00.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.752+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c40b3f40 con 0x7f30c40724b0 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.753+0000 7f30c0ff9640 1 -- 172.21.15.32:0/2459093789 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f30ac0073c0 con 0x7f30c40724b0 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.754+0000 7f30c0ff9640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30a406b810 0x7f30a406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.754+0000 7f30c0ff9640 1 -- 172.21.15.32:0/2459093789 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f30ac089660 con 0x7f30c40724b0 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.754+0000 7f30c3fff640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30a406b810 0x7f30a406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.755+0000 7f30c3fff640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30a406b810 0x7f30a406dcd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f30b4036000 tx=0x7f30b403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.755+0000 7f30cd365740 1 Processor -- start 2024-02-17T00:38:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.755+0000 7f30cd365740 1 -- start start 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30cd365740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 0x55aeee758480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7280c0 0x55aeee755310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee755850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30cd365740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee6e8dc0 con 0x55aeee7580a0 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee69bf20 con 0x55aeee7280c0 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aeee699450 con 0x55aeee72bc20 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 0x55aeee758480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 0x55aeee758480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42340/0 (socket says 172.21.15.32:42340) 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 -- 172.21.15.32:0/3918610374 learned_addr learned my addr 172.21.15.32:0/3918610374 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c37fe640 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7280c0 0x55aeee755310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c8c52640 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee755850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 -- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 msgr2=0x55aeee755850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee755850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 -- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7280c0 msgr2=0x55aeee755310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7280c0 0x55aeee755310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 -- 172.21.15.32:0/3918610374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aeee649f20 con 0x55aeee7580a0 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c8c52640 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee755850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30c3fff640 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 0x55aeee758480 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f30b4034040 tx=0x7f30b4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51933a21eb88ff6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30b9ffb640 1 -- 172.21.15.32:0/3918610374 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b404a070 con 0x55aeee7580a0 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.756+0000 7f30b9ffb640 1 -- 172.21.15.32:0/3918610374 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4032aa0 con 0x55aeee7580a0 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30b9ffb640 1 -- 172.21.15.32:0/3918610374 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4032e30 con 0x55aeee7580a0 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 -- 172.21.15.32:0/3918610374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 msgr2=0x55aeee758480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 0x55aeee758480 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f30b4034040 tx=0x7f30b4030000 comp rx=0 tx=0).stop 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 -- 172.21.15.32:0/3918610374 shutdown_connections 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee755850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7280c0 0x55aeee755310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 --2- 172.21.15.32:0/3918610374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee7580a0 0x55aeee758480 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 -- 172.21.15.32:0/3918610374 >> 172.21.15.32:0/3918610374 conn(0x55aeee72a330 msgr2=0x55aeee772eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 -- 172.21.15.32:0/3918610374 shutdown_connections 2024-02-17T00:38:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.757+0000 7f30cd365740 1 -- 172.21.15.32:0/3918610374 wait complete. 2024-02-17T00:38:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.758+0000 7f30cd365740 1 -- start start 2024-02-17T00:38:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.758+0000 7f30cd365740 1 Processor -- start 2024-02-17T00:38:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee72bc20 0x55aeee7732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee7580a0 0x55aeee752710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee75e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee694c30 con 0x55aeee75c0a0 2024-02-17T00:38:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee639d30 con 0x55aeee72bc20 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aeee368310 con 0x55aeee7580a0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30cd365740 10 client.0 _ll_register_callbacks cb 0x55aeee641d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee75e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee75e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42354/0 (socket says 172.21.15.32:42354) 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 -- 172.21.15.32:0/1962440138 learned_addr learned my addr 172.21.15.32:0/1962440138 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c3fff640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee72bc20 0x55aeee7732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c37fe640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee7580a0 0x55aeee752710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 -- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee7580a0 msgr2=0x55aeee752710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee7580a0 0x55aeee752710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 -- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee72bc20 msgr2=0x55aeee7732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee72bc20 0x55aeee7732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 -- 172.21.15.32:0/1962440138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c406f870 con 0x55aeee75c0a0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30c8c52640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee75e260 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0040f0 tx=0x7f30bc0045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e4f43d892cc795 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-02-17T00:38:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.759+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1962440138 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc004800 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1962440138 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f30bc007ac0 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aeee3946c0 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1962440138 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30bc007c80 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 10 client.5529 fetch_fsmap learned FSMap version 15 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55aeee6932b0 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1962440138 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aeee3946c0 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1962440138 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f30bc016400 con 0x55aeee75c0a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 10 client.5529 fetch_fsmap finished waiting for FSMap version 15 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 10 client.5529 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 20 client.5529 populate_metadata read hostname 'smithi032' 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee7597a0 0x55aeee75c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 4 client.5529 mds_command: new command op to 5349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 --> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aeee3e5270 con 0x55aeee7597a0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.760+0000 7f30c3fff640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee7597a0 0x55aeee75c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30a2ffd640 10 client.5529 ms_handle_connect on v2:172.21.15.39:6835/3098499346 2024-02-17T00:38:00.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30c3fff640 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee7597a0 0x55aeee75c8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e835f60abdf7a server_cookie=931b001156dae5f in_seq=0 out_seq=0 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1962440138 <== mds.0 v2:172.21.15.39:6835/3098499346 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aeee3e5270 con 0x55aeee7597a0 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30a2ffd640 10 client.5529 handle_command_reply: tid=0 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30cd365740 1 client.5529 shutdown 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 msgr2=0x55aeee75e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.761+0000 7f30cd365740 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee75e260 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0040f0 tx=0x7f30bc0045b0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 shutdown_connections 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee7597a0 0x55aeee75c8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee75e260 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee7580a0 0x55aeee752710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30a2ffd640 0 client.5529 ms_handle_reset on v2:172.21.15.39:6835/3098499346 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 --2- 172.21.15.32:0/1962440138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee72bc20 0x55aeee7732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 >> 172.21.15.32:0/1962440138 conn(0x55aeee7280c0 msgr2=0x55aeee7763c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 shutdown_connections 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 1 -- 172.21.15.32:0/1962440138 wait complete. 2024-02-17T00:38:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.762+0000 7f30cd365740 20 client.5529 trim_cache size 0 max 16384 2024-02-17T00:38:00.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 Processor -- start 2024-02-17T00:38:00.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 -- start start 2024-02-17T00:38:00.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 0x55aeee729870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee7545e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee75c0a0 0x55aeee72e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee61a490 con 0x55aeee72bc20 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee775f20 con 0x55aeee7580a0 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aeee755540 con 0x55aeee75c0a0 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30c3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 0x55aeee729870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30c3fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 0x55aeee729870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42358/0 (socket says 172.21.15.32:42358) 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.778+0000 7f30c3fff640 1 -- 172.21.15.32:0/667254132 learned_addr learned my addr 172.21.15.32:0/667254132 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c3fff640 1 -- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee75c0a0 msgr2=0x55aeee72e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c3fff640 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee75c0a0 0x55aeee72e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c3fff640 1 -- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 msgr2=0x55aeee7545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c37fe640 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee7545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c3fff640 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee7545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c3fff640 1 -- 172.21.15.32:0/667254132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aeee62fa20 con 0x55aeee72bc20 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30c3fff640 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 0x55aeee729870 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f30b4032040 tx=0x7f30b4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00584c7548d8bfa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30b97fa640 1 -- 172.21.15.32:0/667254132 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b404a040 con 0x55aeee72bc20 2024-02-17T00:38:00.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30b97fa640 1 -- 172.21.15.32:0/667254132 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b40457a0 con 0x55aeee72bc20 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30b97fa640 1 -- 172.21.15.32:0/667254132 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4045b10 con 0x55aeee72bc20 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 -- 172.21.15.32:0/667254132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 msgr2=0x55aeee729870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 0x55aeee729870 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f30b4032040 tx=0x7f30b4009240 comp rx=0 tx=0).stop 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 -- 172.21.15.32:0/667254132 shutdown_connections 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee75c0a0 0x55aeee72e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee7545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 --2- 172.21.15.32:0/667254132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee72bc20 0x55aeee729870 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 -- 172.21.15.32:0/667254132 >> 172.21.15.32:0/667254132 conn(0x55aeee7280c0 msgr2=0x55aeee75aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.779+0000 7f30cd365740 1 -- 172.21.15.32:0/667254132 shutdown_connections 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.780+0000 7f30cd365740 1 -- 172.21.15.32:0/667254132 wait complete. 2024-02-17T00:38:00.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.780+0000 7f30cd365740 1 -- start start 2024-02-17T00:38:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.780+0000 7f30cd365740 1 Processor -- start 2024-02-17T00:38:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee7dcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee773620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee78b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee78c050 con 0x55aeee75c0a0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeee754e10 con 0x55aeee7580a0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aeee754560 con 0x55aeee72bc20 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30cd365740 10 client.0 _ll_register_callbacks cb 0x7f30b40315c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee78b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee78b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42374/0 (socket says 172.21.15.32:42374) 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 -- 172.21.15.32:0/1326716729 learned_addr learned my addr 172.21.15.32:0/1326716729 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c3fff640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee7dcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c37fe640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee773620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 -- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 msgr2=0x55aeee7dcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee7dcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 -- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 msgr2=0x55aeee773620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee773620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c8c52640 1 -- 172.21.15.32:0/1326716729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aeee649f20 con 0x55aeee75c0a0 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.781+0000 7f30c37fe640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee773620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T00:38:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30c8c52640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee78b5d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003db0 tx=0x7f30bc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4a76739425b148 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1326716729 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc009380 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1326716729 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f30bc003e50 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30b4032aa0 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1326716729 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30bc007700 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 10 client.5535 fetch_fsmap learned FSMap version 15 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55aeee655780 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1326716729 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4032aa0 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1326716729 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f30bc02e030 con 0x55aeee75c0a0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 10 client.5535 fetch_fsmap finished waiting for FSMap version 15 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 10 client.5535 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 20 client.5535 populate_metadata read hostname 'smithi032' 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee75c9f0 0x55aeee75cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 4 client.5535 mds_command: new command op to 5349 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.782+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 --> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55aeee3d1610 con 0x55aeee75c9f0 2024-02-17T00:38:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30c3fff640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee75c9f0 0x55aeee75cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30c3fff640 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee75c9f0 0x55aeee75cdd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d24fb18b95a894 server_cookie=956428b5efcb4b64 in_seq=0 out_seq=0 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30a2ffd640 10 client.5535 ms_handle_connect on v2:172.21.15.39:6835/3098499346 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30a2ffd640 1 -- 172.21.15.32:0/1326716729 <== mds.0 v2:172.21.15.39:6835/3098499346 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55aeee3d1610 con 0x55aeee75c9f0 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30a2ffd640 10 client.5535 handle_command_reply: tid=0 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 client.5535 shutdown 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 msgr2=0x55aeee78b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee78b5d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003db0 tx=0x7f30bc004ab0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 shutdown_connections 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:6835/3098499346,v1:172.21.15.39:6837/3098499346] conn(0x55aeee75c9f0 0x55aeee75cdd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aeee75c0a0 0x55aeee78b5d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30a2ffd640 0 client.5535 ms_handle_reset on v2:172.21.15.39:6835/3098499346 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aeee7580a0 0x55aeee773620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 --2- 172.21.15.32:0/1326716729 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55aeee72bc20 0x55aeee7dcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 >> 172.21.15.32:0/1326716729 conn(0x55aeee7280c0 msgr2=0x55aeee72c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 shutdown_connections 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.783+0000 7f30cd365740 1 -- 172.21.15.32:0/1326716729 wait complete. 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30cd365740 20 client.5535 trim_cache size 0 max 16384 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "2fde0ac4-9f5d-41d6-aea9-1575265f7f65", 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5349, 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 9.096410659, 2024-02-17T00:38:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 15, 2024-02-17T00:38:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 41, 2024-02-17T00:38:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 41, 2024-02-17T00:38:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 16.620222727000002 2024-02-17T00:38:00.793 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-02-17T00:38:00.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30a406b810 msgr2=0x7f30a406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30a406b810 0x7f30a406dcd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f30b4036000 tx=0x7f30b403d040 comp rx=0 tx=0).stop 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 msgr2=0x7f30c414f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 0x7f30c414f4f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00c3c0 tx=0x7f30ac00c880 comp rx=0 tx=0).stop 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 shutdown_connections 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f30a406b810 0x7f30a406dcd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f30c415ed50 0x7f30c40b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30c40724b0 0x7f30c414f4f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 --2- 172.21.15.32:0/2459093789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30c406eba0 0x7f30c40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 >> 172.21.15.32:0/2459093789 conn(0x7f30c40719c0 msgr2=0x7f30c40b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 shutdown_connections 2024-02-17T00:38:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.784+0000 7f30ca6b5640 1 -- 172.21.15.32:0/2459093789 wait complete. 2024-02-17T00:38:00.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T00:38:00.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 Processor -- start 2024-02-17T00:38:00.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 -- start start 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f147015da60 0x7f14700d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 0x7f147015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147015e8a0 con 0x7f1470161d70 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1470161640 con 0x7f147015da60 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.896+0000 7f14751c7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147015eb80 con 0x7f147015de40 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146f59e640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1470161d70 0x7f14700ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51810/0 (socket says 172.21.15.32:51810) 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146f59e640 1 -- 172.21.15.32:0/3033135536 learned_addr learned my addr 172.21.15.32:0/3033135536 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:38:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144894410 0 0) 0x7f147015e8a0 con 0x7f1470161d70 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f1467fff640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 0x7f147015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146ed9d640 1 --2- 172.21.15.32:0/3033135536 >> v2:172.21.15.39:3300/0 conn(0x7f147015da60 0x7f14700d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c003520 con 0x7f1470161d70 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1297865251 0 0) 0x7f145c003520 con 0x7f1470161d70 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 msgr2=0x7f147015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 0x7f147015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 >> v2:172.21.15.39:3300/0 conn(0x7f147015da60 msgr2=0x7f14700d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 --2- 172.21.15.32:0/3033135536 >> v2:172.21.15.39:3300/0 conn(0x7f147015da60 0x7f14700d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015ee60 con 0x7f1470161d70 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146ed9d640 1 --2- 172.21.15.32:0/3033135536 >> v2:172.21.15.39:3300/0 conn(0x7f147015da60 0x7f14700d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f14680019f0 con 0x7f1470161d70 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 >> v1:172.21.15.32:6789/0 conn(0x7f1470161d70 legacy=0x7f14700ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f145c003970 0x7f145c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 0x7f145c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f145c004d00 0x7f145c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470161640 con 0x7f145c004d00 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147015eb80 con 0x7f145c003970 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c00ba60 con 0x7f147015de40 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146f59e640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f145c004d00 0x7f145c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f1467fff640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 0x7f145c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.897+0000 7f146ed9d640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f145c003970 0x7f145c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146f59e640 1 -- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 msgr2=0x7f145c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146f59e640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f147015de40 0x7f145c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146f59e640 1 -- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f145c003970 msgr2=0x7f145c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146f59e640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f145c003970 0x7f145c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146f59e640 1 -- 172.21.15.32:0/3033135536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c003520 con 0x7f145c004d00 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146f59e640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f145c004d00 0x7f145c005180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f146800a8d0 tx=0x7f145c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee02489677d1c547 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468034630 con 0x7f145c004d00 2024-02-17T00:38:00.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146802f070 con 0x7f145c004d00 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.898+0000 7f146e59c640 1 -- 172.21.15.32:0/3033135536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680349d0 con 0x7f145c004d00 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f14751c7640 1 -- 172.21.15.32:0/3033135536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f145c004d00 msgr2=0x7f145c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f14751c7640 1 --2- 172.21.15.32:0/3033135536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f145c004d00 0x7f145c005180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f146800a8d0 tx=0x7f145c0057f0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f146f59e640 1 -- 172.21.15.32:0/3033135536 reap_dead start 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f14751c7640 1 -- 172.21.15.32:0/3033135536 shutdown_connections 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f14751c7640 1 -- 172.21.15.32:0/3033135536 >> 172.21.15.32:0/3033135536 conn(0x7f147006bfe0 msgr2=0x7f147006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f14751c7640 1 -- 172.21.15.32:0/3033135536 shutdown_connections 2024-02-17T00:38:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.899+0000 7f14751c7640 1 -- 172.21.15.32:0/3033135536 wait complete. 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.900+0000 7f14751c7640 1 Processor -- start 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.900+0000 7f14751c7640 1 -- start start 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f14751c7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 0x7f14700b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f14751c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14700cc470 0x7f1470155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f14751c7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1470158cf0 0x7f1470155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f14751c7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b6160 con 0x7f1470158910 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f14751c7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b32b0 con 0x7f14700cc470 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f14751c7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700cc970 con 0x7f1470158cf0 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 0x7f14700b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 0x7f14700b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42388/0 (socket says 172.21.15.32:42388) 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f146ed9d640 1 -- 172.21.15.32:0/3594176467 learned_addr learned my addr 172.21.15.32:0/3594176467 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:00.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f146f59e640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1470158cf0 0x7f1470155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.901+0000 7f1467fff640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14700cc470 0x7f1470155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f146ed9d640 1 -- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1470158cf0 msgr2=0x7f1470155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f146ed9d640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1470158cf0 0x7f1470155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f146ed9d640 1 -- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14700cc470 msgr2=0x7f1470155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f146ed9d640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14700cc470 0x7f1470155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f146ed9d640 1 -- 172.21.15.32:0/3594176467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700ccc50 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f146ed9d640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 0x7f14700b5c20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f14600115d0 tx=0x7f14600119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000c070 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460015930 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700ccf30 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460015ca0 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.902+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1470157890 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.903+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700680c0 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.903+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1460013400 con 0x7f1470158910 2024-02-17T00:38:00.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.904+0000 7f14677fe640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f145006b810 0x7f145006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:00.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.904+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f146008a640 con 0x7f1470158910 2024-02-17T00:38:00.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.904+0000 7f1467fff640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f145006b810 0x7f145006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:00.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.904+0000 7f1467fff640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f145006b810 0x7f145006dcd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f147015fd20 tx=0x7f1458009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:00.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:00.908+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1460054f80 con 0x7f1470158910 2024-02-17T00:38:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.125+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1470068fd0 con 0x7f1470158910 2024-02-17T00:38:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.125+0000 7f14677fe640 1 -- 172.21.15.32:0/3594176467 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1460058640 con 0x7f1470158910 2024-02-17T00:38:01.128 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f145006b810 msgr2=0x7f145006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f145006b810 0x7f145006dcd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f147015fd20 tx=0x7f1458009190 comp rx=0 tx=0).stop 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 msgr2=0x7f14700b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 0x7f14700b5c20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f14600115d0 tx=0x7f14600119d0 comp rx=0 tx=0).stop 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 shutdown_connections 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f145006b810 0x7f145006dcd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1470158cf0 0x7f1470155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14700cc470 0x7f1470155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 --2- 172.21.15.32:0/3594176467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1470158910 0x7f14700b5c20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 >> 172.21.15.32:0/3594176467 conn(0x7f147006bfe0 msgr2=0x7f14700d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 shutdown_connections 2024-02-17T00:38:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:01.127+0000 7f14751c7640 1 -- 172.21.15.32:0/3594176467 wait complete. 2024-02-17T00:38:01.140 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T00:38:01.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T00:38:01.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-02-17T00:38:01.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T00:38:01.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T00:38:01.141 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T00:38:01.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T00:38:01.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T00:38:01.141 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T00:38:01.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.141 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-02-17T00:38:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42596sec preferred_lft 42596sec 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link noprefixroute 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-02-17T00:38:01.157 INFO:teuthology.orchestra.run.smithi032.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 32:c1:b5:bf:31:37 brd ff:ff:ff:ff:ff:ff 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5437:81ff:fe0f:c133/64 scope link 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 32:c1:b5:bf:31:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::30c1:b5ff:febf:3137/64 scope link 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 8e:35:d5:e6:35:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::8c35:d5ff:fee6:35dd/64 scope link 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-02-17T00:38:01.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.159 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T00:38:01.221 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-02-17T00:38:01.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.223 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-02-17T00:38:01.279 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-02-17T00:38:01.279 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T00:38:01.279 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-17T00:38:01.280 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-17T00:38:01.280 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T00:38:01.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.280 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-02-17T00:38:01.280 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-02-17T00:38:01.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-17T00:38:01.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-17T00:38:01.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-17T00:38:01.280 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-02-17T00:38:01.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.374 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-02-17T00:38:01.388 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-17T00:38:01.388 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T00:38:01.389 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T00:38:01.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-02-17T00:38:01.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:38:01.455 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T00:38:01.509 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T00:38:01.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T00:38:01.509 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T00:38:01.563 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T00:38:01.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:38:01.647 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:38:01.647 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T00:38:01.647 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:38:01.655 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:38:01.655 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T00:38:01.655 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:38:01.655 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:38:01.655 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.39:3300,172.21.15.39:3301" 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790" 2024-02-17T00:38:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.39:6789,172.21.15.39:6790:/ 2024-02-17T00:38:01.661 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2fde0ac4-9f5d-41d6-aea9-1575265f7f65" will pass to kernel 2024-02-17T00:38:01.664 INFO:teuthology.orchestra.run.smithi032.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-17T00:38:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: You just mounted a file system that supports labels which does not 2024-02-17T00:38:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-17T00:38:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: applications will generate AVC messages and not be allowed access to 2024-02-17T00:38:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-17T00:38:01.664 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T00:38:01.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T00:38:01.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.733 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T00:38:01.794 INFO:teuthology.orchestra.run.smithi032.stdout:client5332 2024-02-17T00:38:01.795 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:38:01.795 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T00:38:01.849 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=xfstests-dev 2024-02-17T00:38:01.903 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.oprNTeITBlxfstests-dev 2024-02-17T00:38:01.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.904 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.oprNTeITBlxfstests-dev) 2024-02-17T00:38:01.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:01.973 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.oprNTeITBlxfstests-dev) 2024-02-17T00:38:02.030 INFO:teuthology.orchestra.run.smithi032.stderr:Cloning into '/tmp/tmp.oprNTeITBlxfstests-dev'... 2024-02-17T00:38:02.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:02.752 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-02-17T00:38:02.813 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=test 2024-02-17T00:38:02.866 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.nBvl8wthmctest 2024-02-17T00:38:02.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:38:02.867 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-02-17T00:38:02.923 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=scratch 2024-02-17T00:38:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:38:02.978 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-02-17T00:38:02.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-02-17T00:38:03.609 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:03:48 ago on Sat 17 Feb 2024 12:34:15 AM UTC. 2024-02-17T00:38:03.730 INFO:teuthology.orchestra.run.smithi032.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-02-17T00:38:03.731 INFO:teuthology.orchestra.run.smithi032.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T00:38:03.732 INFO:teuthology.orchestra.run.smithi032.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-02-17T00:38:03.734 INFO:teuthology.orchestra.run.smithi032.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-02-17T00:38:03.735 INFO:teuthology.orchestra.run.smithi032.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-02-17T00:38:03.737 INFO:teuthology.orchestra.run.smithi032.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-02-17T00:38:03.739 INFO:teuthology.orchestra.run.smithi032.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-02-17T00:38:03.740 INFO:teuthology.orchestra.run.smithi032.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-02-17T00:38:03.742 INFO:teuthology.orchestra.run.smithi032.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-02-17T00:38:03.747 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-02-17T00:38:03.747 INFO:teuthology.orchestra.run.smithi032.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-02-17T00:38:03.749 INFO:teuthology.orchestra.run.smithi032.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-02-17T00:38:03.750 INFO:teuthology.orchestra.run.smithi032.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-02-17T00:38:03.751 INFO:teuthology.orchestra.run.smithi032.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-02-17T00:38:03.752 INFO:teuthology.orchestra.run.smithi032.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-02-17T00:38:03.753 INFO:teuthology.orchestra.run.smithi032.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-02-17T00:38:03.754 INFO:teuthology.orchestra.run.smithi032.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-02-17T00:38:03.756 INFO:teuthology.orchestra.run.smithi032.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-02-17T00:38:03.757 INFO:teuthology.orchestra.run.smithi032.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-02-17T00:38:03.760 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-02-17T00:38:03.829 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-02-17T00:38:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-devel x86_64 5.14.0-421.el9 CentOS-AppStream 22 M 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: cpp x86_64 11.4.1-3.el9 CentOS-AppStream 11 M 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper x86_64 9:1.02.197-2.el9 CentOS-BaseOS 139 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 CentOS-BaseOS 33 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 CentOS-BaseOS 31 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 CentOS-BaseOS 178 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: e2fsprogs x86_64 1.46.5-5.el9 CentOS-BaseOS 1.0 M 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 CentOS-BaseOS 221 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: gcc x86_64 11.4.1-3.el9 CentOS-AppStream 32 M 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: gcc-c++ x86_64 11.4.1-3.el9 CentOS-AppStream 13 M 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 CentOS-AppStream 46 k 2024-02-17T00:38:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: git x86_64 2.43.0-1.el9 CentOS-AppStream 50 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: git-core x86_64 2.43.0-1.el9 CentOS-AppStream 4.4 M 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: git-core-doc noarch 2.43.0-1.el9 CentOS-AppStream 2.6 M 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err x86_64 1.46.5-5.el9 CentOS-BaseOS 25 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: libgcc x86_64 11.4.1-3.el9 CentOS-BaseOS 91 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: libgomp x86_64 11.4.1-3.el9 CentOS-BaseOS 267 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: libss x86_64 1.46.5-5.el9 CentOS-BaseOS 31 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: libstdc++ x86_64 11.4.1-3.el9 CentOS-BaseOS 739 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: libstdc++-devel x86_64 11.4.1-3.el9 CentOS-AppStream 2.2 M 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: lvm2 x86_64 9:2.03.23-2.el9 CentOS-BaseOS 1.5 M 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 CentOS-BaseOS 1.0 M 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: make x86_64 1:4.3-8.el9 CentOS-BaseOS 529 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: perl-Git noarch 2.43.0-1.el9 CentOS-AppStream 37 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-02-17T00:38:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: libnbd x86_64 1.18.1-3.el9 CentOS-AppStream 165 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout:Installing weak dependencies: 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-02-17T00:38:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:03.837 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-02-17T00:38:03.904 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-02-17T00:38:03.904 INFO:teuthology.orchestra.run.smithi032.stdout:Install 17 Packages 2024-02-17T00:38:03.904 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 28 Packages 2024-02-17T00:38:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:03.905 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 108 M 2024-02-17T00:38:03.905 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-02-17T00:38:04.429 INFO:teuthology.orchestra.run.smithi032.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 124 kB/s | 17 kB 00:00 2024-02-17T00:38:04.454 INFO:teuthology.orchestra.run.smithi032.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 89 kB/s | 14 kB 00:00 2024-02-17T00:38:04.621 INFO:teuthology.orchestra.run.smithi032.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 70 kB/s | 13 kB 00:00 2024-02-17T00:38:04.646 INFO:teuthology.orchestra.run.smithi032.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 76 kB/s | 15 kB 00:00 2024-02-17T00:38:04.805 INFO:teuthology.orchestra.run.smithi032.stdout:(5/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 96 kB/s | 15 kB 00:00 2024-02-17T00:38:04.830 INFO:teuthology.orchestra.run.smithi032.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 107 kB/s | 20 kB 00:00 2024-02-17T00:38:04.905 INFO:teuthology.orchestra.run.smithi032.stdout:(7/45): fio-3.35-1.el9.x86_64.rpm 10 MB/s | 6.2 MB 00:00 2024-02-17T00:38:04.939 INFO:teuthology.orchestra.run.smithi032.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 306 kB/s | 33 kB 00:00 2024-02-17T00:38:05.047 INFO:teuthology.orchestra.run.smithi032.stdout:(9/45): libnbd-1.18.1-3.el9.x86_64.rpm 1.1 MB/s | 165 kB 00:00 2024-02-17T00:38:05.089 INFO:teuthology.orchestra.run.smithi032.stdout:(10/45): sqlite-3.34.1-7.el9.x86_64.rpm 4.9 MB/s | 747 kB 00:00 2024-02-17T00:38:05.340 INFO:teuthology.orchestra.run.smithi032.stdout:(11/45): kernel-devel-5.14.0-421.el9.x86_64.rpm 40 MB/s | 22 MB 00:00 2024-02-17T00:38:05.365 INFO:teuthology.orchestra.run.smithi032.stdout:(12/45): udftools-2.2-5.el9.x86_64.rpm 455 kB/s | 144 kB 00:00 2024-02-17T00:38:05.417 INFO:teuthology.orchestra.run.smithi032.stdout:(13/45): rmt-1.6-6.el9.x86_64.rpm 138 kB/s | 45 kB 00:00 2024-02-17T00:38:05.808 INFO:teuthology.orchestra.run.smithi032.stdout:(14/45): dump-0.4-0.51.b47.el9.x86_64.rpm 226 kB/s | 88 kB 00:00 2024-02-17T00:38:05.983 INFO:teuthology.orchestra.run.smithi032.stdout:(15/45): indent-2.2.13-5.el9.x86_64.rpm 1.0 MB/s | 179 kB 00:00 2024-02-17T00:38:06.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:38:06.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:38:06.217 INFO:teuthology.orchestra.run.smithi032.stdout:(16/45): cpp-11.4.1-3.el9.x86_64.rpm 45 MB/s | 11 MB 00:00 2024-02-17T00:38:06.258 INFO:teuthology.orchestra.run.smithi032.stdout:(17/45): gdbm-devel-1.19-4.el9.x86_64.rpm 70 kB/s | 59 kB 00:00 2024-02-17T00:38:06.292 INFO:teuthology.orchestra.run.smithi032.stdout:(18/45): gdbm-1.19-4.el9.x86_64.rpm 139 kB/s | 132 kB 00:00 2024-02-17T00:38:06.442 INFO:teuthology.orchestra.run.smithi032.stdout:(19/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 314 kB/s | 46 kB 00:00 2024-02-17T00:38:06.851 INFO:teuthology.orchestra.run.smithi032.stdout:(20/45): gcc-11.4.1-3.el9.x86_64.rpm 51 MB/s | 32 MB 00:00 2024-02-17T00:38:06.876 INFO:teuthology.orchestra.run.smithi032.stdout:(21/45): git-2.43.0-1.el9.x86_64.rpm 114 kB/s | 50 kB 00:00 2024-02-17T00:38:07.085 INFO:teuthology.orchestra.run.smithi032.stdout:(22/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 16 MB/s | 13 MB 00:00 2024-02-17T00:38:07.169 INFO:teuthology.orchestra.run.smithi032.stdout:(23/45): git-core-2.43.0-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-02-17T00:38:07.227 INFO:teuthology.orchestra.run.smithi032.stdout:(24/45): git-core-doc-2.43.0-1.el9.noarch.rpm 7.6 MB/s | 2.6 MB 00:00 2024-02-17T00:38:07.269 INFO:teuthology.orchestra.run.smithi032.stdout:(25/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 12 MB/s | 2.2 MB 00:00 2024-02-17T00:38:07.294 INFO:teuthology.orchestra.run.smithi032.stdout:(26/45): perl-Git-2.43.0-1.el9.noarch.rpm 299 kB/s | 37 kB 00:00 2024-02-17T00:38:07.311 INFO:teuthology.orchestra.run.smithi032.stdout:(27/45): python-unversioned-command-3.9.18-3.el 101 kB/s | 8.3 kB 00:00 2024-02-17T00:38:07.336 INFO:teuthology.orchestra.run.smithi032.stdout:(28/45): device-mapper-1.02.197-2.el9.x86_64.rp 3.3 MB/s | 139 kB 00:00 2024-02-17T00:38:07.362 INFO:teuthology.orchestra.run.smithi032.stdout:(29/45): python3-devel-3.9.18-3.el9.x86_64.rpm 3.0 MB/s | 204 kB 00:00 2024-02-17T00:38:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:(30/45): device-mapper-event-1.02.197-2.el9.x86 499 kB/s | 33 kB 00:00 2024-02-17T00:38:07.395 INFO:teuthology.orchestra.run.smithi032.stdout:(31/45): device-mapper-event-libs-1.02.197-2.el 532 kB/s | 31 kB 00:00 2024-02-17T00:38:07.420 INFO:teuthology.orchestra.run.smithi032.stdout:(32/45): device-mapper-libs-1.02.197-2.el9.x86_ 4.2 MB/s | 178 kB 00:00 2024-02-17T00:38:07.454 INFO:teuthology.orchestra.run.smithi032.stdout:(33/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-02-17T00:38:07.479 INFO:teuthology.orchestra.run.smithi032.stdout:(34/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-02-17T00:38:07.505 INFO:teuthology.orchestra.run.smithi032.stdout:(35/45): libcom_err-1.46.5-5.el9.x86_64.rpm 306 kB/s | 25 kB 00:00 2024-02-17T00:38:07.522 INFO:teuthology.orchestra.run.smithi032.stdout:(36/45): libgcc-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 91 kB 00:00 2024-02-17T00:38:07.547 INFO:teuthology.orchestra.run.smithi032.stdout:(37/45): libgomp-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 267 kB 00:00 2024-02-17T00:38:07.572 INFO:teuthology.orchestra.run.smithi032.stdout:(38/45): libss-1.46.5-5.el9.x86_64.rpm 463 kB/s | 31 kB 00:00 2024-02-17T00:38:07.605 INFO:teuthology.orchestra.run.smithi032.stdout:(39/45): libstdc++-11.4.1-3.el9.x86_64.rpm 12 MB/s | 739 kB 00:00 2024-02-17T00:38:07.648 INFO:teuthology.orchestra.run.smithi032.stdout:(40/45): lvm2-2.03.23-2.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-02-17T00:38:07.673 INFO:teuthology.orchestra.run.smithi032.stdout:(41/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 9.9 MB/s | 1.0 MB 00:00 2024-02-17T00:38:07.706 INFO:teuthology.orchestra.run.smithi032.stdout:(42/45): make-4.3-8.el9.x86_64.rpm 5.3 MB/s | 529 kB 00:00 2024-02-17T00:38:07.732 INFO:teuthology.orchestra.run.smithi032.stdout:(43/45): python3-3.9.18-3.el9.x86_64.rpm 439 kB/s | 25 kB 00:00 2024-02-17T00:38:07.865 INFO:teuthology.orchestra.run.smithi032.stdout:(44/45): python3-libs-3.9.18-3.el9.x86_64.rpm 38 MB/s | 7.3 MB 00:00 2024-02-17T00:38:07.890 INFO:teuthology.orchestra.run.smithi032.stdout:(45/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 3.4 MB/s | 619 kB 00:00 2024-02-17T00:38:07.894 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-02-17T00:38:07.895 INFO:teuthology.orchestra.run.smithi032.stdout:Total 27 MB/s | 108 MB 00:04 2024-02-17T00:38:07.916 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-02-17T00:38:08.232 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-02-17T00:38:08.232 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-02-17T00:38:09.425 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-02-17T00:38:09.426 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-02-17T00:38:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-02-17T00:38:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-02-17T00:38:12.438 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-02-17T00:38:12.491 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-02-17T00:38:12.555 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-02-17T00:38:12.606 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-02-17T00:38:12.657 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-02-17T00:38:12.707 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-02-17T00:38:12.750 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-02-17T00:38:14.096 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 8/73 2024-02-17T00:38:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 9/73 2024-02-17T00:38:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 10/73 2024-02-17T00:38:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 11/73 2024-02-17T00:38:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : make-1:4.3-8.el9.x86_64 12/73 2024-02-17T00:38:15.498 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 13/73 2024-02-17T00:38:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-02-17T00:38:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-02-17T00:38:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-02-17T00:38:15.700 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-02-17T00:38:15.922 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-02-17T00:38:16.493 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-02-17T00:38:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-02-17T00:38:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-02-17T00:38:17.006 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 21/73 2024-02-17T00:38:18.031 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 22/73 2024-02-17T00:38:18.169 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-02-17T00:38:18.209 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-02-17T00:38:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-02-17T00:38:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rmt-2:1.6-6.el9.x86_64 25/73 2024-02-17T00:38:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 26/73 2024-02-17T00:38:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 27/73 2024-02-17T00:38:18.356 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 28/73 2024-02-17T00:38:18.381 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 29/73 2024-02-17T00:38:18.407 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 30/73 2024-02-17T00:38:18.432 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 31/73 2024-02-17T00:38:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 32/73 2024-02-17T00:38:18.631 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-3.35-1.el9.x86_64 33/73 2024-02-17T00:38:18.661 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-02-17T00:38:28.660 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-02-17T00:38:28.841 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-devel-5.14.0-421.el9.x86_64 36/73 2024-02-17T00:38:36.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:38:36.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:38:39.080 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-devel-5.14.0-421.el9.x86_64 36/73 2024-02-17T00:38:39.141 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-02-17T00:38:39.205 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-02-17T00:38:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-02-17T00:38:40.091 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-02-17T00:38:40.091 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-02-17T00:38:40.091 INFO:teuthology.orchestra.run.smithi032.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-02-17T00:38:40.091 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-02-17T00:38:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-02-17T00:38:40.503 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-02-17T00:38:40.543 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-02-17T00:38:40.593 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-02-17T00:38:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-02-17T00:38:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-02-17T00:38:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 47/73 2024-02-17T00:38:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 48/73 2024-02-17T00:38:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 49/73 2024-02-17T00:38:40.761 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-02-17T00:38:40.787 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-02-17T00:38:40.794 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 52/73 2024-02-17T00:38:40.794 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 52/73 2024-02-17T00:38:40.846 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 52/73 2024-02-17T00:38:40.871 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-02-17T00:38:40.876 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 54/73 2024-02-17T00:38:40.905 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 54/73 2024-02-17T00:38:40.930 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 55/73 2024-02-17T00:38:40.930 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 56/73 2024-02-17T00:38:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 56/73 2024-02-17T00:38:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 57/73 2024-02-17T00:38:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 58/73 2024-02-17T00:38:41.102 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 59/73 2024-02-17T00:38:41.133 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 60/73 2024-02-17T00:38:41.166 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 61/73 2024-02-17T00:38:41.191 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-02-17T00:38:41.216 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-02-17T00:38:41.258 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-02-17T00:38:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-02-17T00:38:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-02-17T00:38:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-02-17T00:38:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-02-17T00:38:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-02-17T00:38:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-02-17T00:38:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 70/73 2024-02-17T00:38:41.565 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 71/73 2024-02-17T00:38:41.601 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : make-1:4.3-7.el9.x86_64 72/73 2024-02-17T00:38:41.677 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 73/73 2024-02-17T00:38:43.996 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: git-core-2.39.3-1.el9.x86_64 73/73 2024-02-17T00:38:43.996 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-02-17T00:38:43.996 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-devel-5.14.0-421.el9.x86_64 8/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 9/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 10/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 11/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 13/73 2024-02-17T00:38:43.997 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 18/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 20/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 22/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 24/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : git-2.43.0-1.el9.x86_64 26/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : git-2.39.3-1.el9.x86_64 27/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 28/73 2024-02-17T00:38:43.998 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 29/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 30/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 31/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 32/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 33/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 34/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 35/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 36/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 37/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 38/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 39/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 40/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 41/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 42/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 43/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 44/73 2024-02-17T00:38:43.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 45/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 46/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 47/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 48/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 49/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 50/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 51/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 52/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 53/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 54/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 55/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 56/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 57/73 2024-02-17T00:38:44.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libss-1.46.5-5.el9.x86_64 58/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libss-1.46.5-3.el9.x86_64 59/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 60/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 61/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 62/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 63/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 64/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 65/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : make-1:4.3-8.el9.x86_64 66/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : make-1:4.3-7.el9.x86_64 67/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-3.9.18-3.el9.x86_64 68/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-3.9.17-2.el9.x86_64 69/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 70/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 71/73 2024-02-17T00:38:44.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 72/73 2024-02-17T00:38:45.076 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 73/73 2024-02-17T00:38:45.076 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:45.076 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2024-02-17T00:38:45.076 INFO:teuthology.orchestra.run.smithi032.stdout: cpp-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: gcc-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: git-2.43.0-1.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: git-core-2.43.0-1.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: libgcc-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.077 INFO:teuthology.orchestra.run.smithi032.stdout: libgomp-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: libss-1.46.5-5.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: make-1:4.3-8.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: perl-Git-2.43.0-1.el9.noarch 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: python3-3.9.18-3.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-02-17T00:38:45.078 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-421.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: udftools-2.2-5.el9.x86_64 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:45.079 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-02-17T00:38:45.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd -m fsgqa 2024-02-17T00:38:45.839 INFO:teuthology.orchestra.run.smithi032.stderr:useradd: user 'fsgqa' already exists 2024-02-17T00:38:45.840 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-17T00:38:45.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo groupadd fsgqa 2024-02-17T00:38:45.905 INFO:teuthology.orchestra.run.smithi032.stderr:groupadd: group 'fsgqa' already exists 2024-02-17T00:38:45.907 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-17T00:38:45.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd fsgqa2 2024-02-17T00:38:46.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd 123456-fsgqa 2024-02-17T00:38:47.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-02-17T00:38:47.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.403+0000 7fb4c68eb640 1 Processor -- start 2024-02-17T00:38:47.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.403+0000 7fb4c68eb640 1 -- start start 2024-02-17T00:38:47.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4c68eb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 0x7fb4c00ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4c68eb640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c006d1f0 con 0x7fb4c015ced0 2024-02-17T00:38:47.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4c68eb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c006d4d0 con 0x7fb4c00ce890 2024-02-17T00:38:47.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4c68eb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c006de70 con 0x7fb4c015ee90 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4bf7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb4c015ced0 0x7fb4c00c5a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56898/0 (socket says 172.21.15.32:56898) 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4bf7fe640 1 -- 172.21.15.32:0/2967211838 learned_addr learned my addr 172.21.15.32:0/2967211838 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4bffff640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 0x7fb4c00ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325012038 0 0) 0x7fb4c006d1f0 con 0x7fb4c015ced0 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a8003520 con 0x7fb4c015ced0 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925573 0 0) 0x7fb4c006d4d0 con 0x7fb4c00ce890 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c006d1f0 con 0x7fb4c00ce890 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908445572 0 0) 0x7fb4a8003520 con 0x7fb4c015ced0 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 msgr2=0x7fb4c00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 0x7fb4c00ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 >> v1:172.21.15.39:6789/0 conn(0x7fb4c00ce890 legacy=0x7fb4c015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c006d7b0 con 0x7fb4c015ced0 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7fb4b0001670 con 0x7fb4c015ced0 2024-02-17T00:38:47.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 >> v1:172.21.15.32:6789/0 conn(0x7fb4c015ced0 legacy=0x7fb4c00c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.404+0000 7fb4beffd640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 0x7fb4a8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4beffd640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4a8004090 0x7fb4a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4beffd640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a8004d00 0x7fb4a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c006de70 con 0x7fb4a8004d00 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a800bb10 con 0x7fb4a8004090 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a800bca0 con 0x7fb4c015ee90 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4c4e88640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a8004d00 0x7fb4a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4bffff640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 0x7fb4a8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4bf7fe640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4a8004090 0x7fb4a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4c4e88640 1 -- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 msgr2=0x7fb4a8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4c4e88640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c015ee90 0x7fb4a8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4c4e88640 1 -- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4a8004090 msgr2=0x7fb4a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:47.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4c4e88640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4a8004090 0x7fb4a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4c4e88640 1 -- 172.21.15.32:0/2967211838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8003520 con 0x7fb4a8004d00 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.405+0000 7fb4bf7fe640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4a8004090 0x7fb4a80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c4e88640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a8004d00 0x7fb4a8005180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8001fd0 tx=0x7fb4a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8fbc34f8e8a85 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8003b70 con 0x7fb4a8004d00 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8003cd0 con 0x7fb4a8004d00 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4beffd640 1 -- 172.21.15.32:0/2967211838 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80052f0 con 0x7fb4a8004d00 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c68eb640 1 -- 172.21.15.32:0/2967211838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a8004d00 msgr2=0x7fb4a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/2967211838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a8004d00 0x7fb4a8005180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8001fd0 tx=0x7fb4a80057f0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c4e88640 1 -- 172.21.15.32:0/2967211838 reap_dead start 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c68eb640 1 -- 172.21.15.32:0/2967211838 shutdown_connections 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c68eb640 1 -- 172.21.15.32:0/2967211838 >> 172.21.15.32:0/2967211838 conn(0x7fb4c0071150 msgr2=0x7fb4c0071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c68eb640 1 -- 172.21.15.32:0/2967211838 shutdown_connections 2024-02-17T00:38:47.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.406+0000 7fb4c68eb640 1 -- 172.21.15.32:0/2967211838 wait complete. 2024-02-17T00:38:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.408+0000 7fb4c68eb640 1 Processor -- start 2024-02-17T00:38:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.408+0000 7fb4c68eb640 1 -- start start 2024-02-17T00:38:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 0x7fb4c00b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4c00b0b20 0x7fb4c00b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c00b2fc0 0x7fb4c00cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c014bb50 con 0x7fb4c014b100 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00b3fc0 con 0x7fb4c00b0b20 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00b25f0 con 0x7fb4c00b2fc0 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 0x7fb4c00b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 0x7fb4c00b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48842/0 (socket says 172.21.15.32:48842) 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 -- 172.21.15.32:0/3304605621 learned_addr learned my addr 172.21.15.32:0/3304605621 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 -- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c00b2fc0 msgr2=0x7fb4c00cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c00b2fc0 0x7fb4c00cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 -- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4c00b0b20 msgr2=0x7fb4c00b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4c00b0b20 0x7fb4c00b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 -- 172.21.15.32:0/3304605621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00b41f0 con 0x7fb4c014b100 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bffff640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 0x7fb4c00b3a80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4011a00 tx=0x7fb4b4011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400fa70 con 0x7fb4c014b100 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400fbd0 con 0x7fb4c014b100 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4014440 con 0x7fb4c014b100 2024-02-17T00:38:47.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c00b44d0 con 0x7fb4c014b100 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.409+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c00b2280 con 0x7fb4c014b100 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.410+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0068fd0 con 0x7fb4c014b100 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.411+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb4b40145a0 con 0x7fb4c014b100 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.411+0000 7fb4bcff9640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb4ac06b810 0x7fb4ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.411+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6188+0+0 (secure 0 0 0) 0x7fb4b408abb0 con 0x7fb4c014b100 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.411+0000 7fb4bf7fe640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb4ac06b810 0x7fb4ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.412+0000 7fb4bf7fe640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb4ac06b810 0x7fb4ac06dcd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001eb0 tx=0x7fb4b0000f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:47.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.415+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb4b40553f0 con 0x7fb4c014b100 2024-02-17T00:38:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.671+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb4c015dd90 con 0x7fb4c014b100 2024-02-17T00:38:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.671+0000 7fb4bcff9640 1 -- 172.21.15.32:0/3304605621 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1277 (secure 0 0 0) 0x7fb4b4058ab0 con 0x7fb4c014b100 2024-02-17T00:38:47.674 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:38:47.675 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":1,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","modified":"2024-02-17T00:35:37.650015Z","created":"2024-02-17T00:35:37.650015Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3301","nonce":0},{"type":"v1","addr":"172.21.15.39:6790","nonce":0}]},"addr":"172.21.15.39:6790/0","public_addr":"172.21.15.39:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-17T00:38:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:dumped monmap epoch 1 2024-02-17T00:38:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb4ac06b810 msgr2=0x7fb4ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb4ac06b810 0x7fb4ac06dcd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001eb0 tx=0x7fb4b0000f50 comp rx=0 tx=0).stop 2024-02-17T00:38:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 msgr2=0x7fb4c00b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 0x7fb4c00b3a80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4011a00 tx=0x7fb4b4011ec0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 shutdown_connections 2024-02-17T00:38:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb4ac06b810 0x7fb4ac06dcd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.673+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4c00b2fc0 0x7fb4c00cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.674+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4c00b0b20 0x7fb4c00b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.674+0000 7fb4c68eb640 1 --2- 172.21.15.32:0/3304605621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4c014b100 0x7fb4c00b3a80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.674+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 >> 172.21.15.32:0/3304605621 conn(0x7fb4c0071150 msgr2=0x7fb4c006e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.674+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 shutdown_connections 2024-02-17T00:38:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.674+0000 7fb4c68eb640 1 -- 172.21.15.32:0/3304605621 wait complete. 2024-02-17T00:38:47.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-02-17T00:38:47.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.790+0000 7f3f46db8640 1 Processor -- start 2024-02-17T00:38:47.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.790+0000 7f3f46db8640 1 -- start start 2024-02-17T00:38:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f46db8640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f46db8640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f400cc300 0x7f3f400999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f46db8640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3f40099f30 0x7f3f4015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f46db8640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f400cd7d0 con 0x7f3f400cc300 2024-02-17T00:38:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f46db8640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4009a340 con 0x7f3f40099f30 2024-02-17T00:38:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f46db8640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400ccbc0 con 0x7f3f4015b8e0 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f3ffff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f400cc300 0x7f3f400999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f3ffff640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f400cc300 0x7f3f400999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48844/0 (socket says 172.21.15.32:48844) 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f3ffff640 1 -- 172.21.15.32:0/2956549541 learned_addr learned my addr 172.21.15.32:0/2956549541 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f45355640 1 --2- 172.21.15.32:0/2956549541 >> v2:172.21.15.39:3300/0 conn(0x7f3f40099f30 0x7f3f4015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.791+0000 7f3f44b54640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f3ffff640 1 -- 172.21.15.32:0/2956549541 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 msgr2=0x7f3f400d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f3ffff640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f3ffff640 1 -- 172.21.15.32:0/2956549541 >> v2:172.21.15.39:3300/0 conn(0x7f3f40099f30 msgr2=0x7f3f4015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f3ffff640 1 --2- 172.21.15.32:0/2956549541 >> v2:172.21.15.39:3300/0 conn(0x7f3f40099f30 0x7f3f4015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f3ffff640 1 -- 172.21.15.32:0/2956549541 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400ccea0 con 0x7f3f400cc300 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f45355640 1 --2- 172.21.15.32:0/2956549541 >> v2:172.21.15.39:3300/0 conn(0x7f3f40099f30 0x7f3f4015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f44b54640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.792+0000 7f3f3ffff640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f400cc300 0x7f3f400999f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3f40072f90 tx=0x7f3f2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c2a10304a86f5b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f3f7fe640 1 -- 172.21.15.32:0/2956549541 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28031870 con 0x7f3f400cc300 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f3f7fe640 1 -- 172.21.15.32:0/2956549541 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f280319d0 con 0x7f3f400cc300 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f3f7fe640 1 -- 172.21.15.32:0/2956549541 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28031d60 con 0x7f3f400cc300 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 -- 172.21.15.32:0/2956549541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f400cc300 msgr2=0x7f3f400999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f400cc300 0x7f3f400999f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3f40072f90 tx=0x7f3f2802b910 comp rx=0 tx=0).stop 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 -- 172.21.15.32:0/2956549541 shutdown_connections 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2956549541 >> v2:172.21.15.39:3300/0 conn(0x7f3f40099f30 0x7f3f4015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f400cc300 0x7f3f400999f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2956549541 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 -- 172.21.15.32:0/2956549541 >> 172.21.15.32:0/2956549541 conn(0x7f3f400b3130 msgr2=0x7f3f400b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 -- 172.21.15.32:0/2956549541 shutdown_connections 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.793+0000 7f3f46db8640 1 -- 172.21.15.32:0/2956549541 wait complete. 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.794+0000 7f3f46db8640 1 Processor -- start 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.794+0000 7f3f46db8640 1 -- start start 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f46db8640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 0x7f3f40156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f46db8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f400cc300 0x7f3f400c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f46db8640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f46db8640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400b5ae0 con 0x7f3f40099f30 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f46db8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40157100 con 0x7f3f400cc300 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f46db8640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400b4ed0 con 0x7f3f4015b8e0 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f44b54640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 0x7f3f40156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f44b54640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 0x7f3f40156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48854/0 (socket says 172.21.15.32:48854) 2024-02-17T00:38:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f44b54640 1 -- 172.21.15.32:0/2151074147 learned_addr learned my addr 172.21.15.32:0/2151074147 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f3ffff640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f400cc300 0x7f3f400c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.795+0000 7f3f45355640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f44b54640 1 -- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 msgr2=0x7f3f400ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f44b54640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f44b54640 1 -- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f400cc300 msgr2=0x7f3f400c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f44b54640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f400cc300 0x7f3f400c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f44b54640 1 -- 172.21.15.32:0/2151074147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280094d0 con 0x7f3f40099f30 2024-02-17T00:38:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f44b54640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 0x7f3f40156bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009fc0 tx=0x7f3f3800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38003b90 con 0x7f3f40099f30 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800f040 con 0x7f3f40099f30 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f400b51b0 con 0x7f3f40099f30 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38004030 con 0x7f3f40099f30 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.796+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f400b5770 con 0x7f3f40099f30 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.797+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40068fd0 con 0x7f3f40099f30 2024-02-17T00:38:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.797+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3f38004190 con 0x7f3f40099f30 2024-02-17T00:38:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.798+0000 7f3f3d7fa640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f2006b810 0x7f3f2006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T00:38:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.798+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6188+0+0 (secure 0 0 0) 0x7f3f3808a660 con 0x7f3f40099f30 2024-02-17T00:38:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.798+0000 7f3f3ffff640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f2006b810 0x7f3f2006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T00:38:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.798+0000 7f3f3ffff640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f2006b810 0x7f3f2006dcd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f28036000 tx=0x7f3f2803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T00:38:47.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:47.802+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f38054f50 con 0x7f3f40099f30 2024-02-17T00:38:48.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.051+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f3f400b0810 con 0x7f3f40099f30 2024-02-17T00:38:48.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.051+0000 7f3f3d7fa640 1 -- 172.21.15.32:0/2151074147 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f3f38058610 con 0x7f3f40099f30 2024-02-17T00:38:48.054 INFO:teuthology.orchestra.run.smithi032.stdout:[client.admin] 2024-02-17T00:38:48.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== 2024-02-17T00:38:48.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f2006b810 msgr2=0x7f3f2006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:48.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f2006b810 0x7f3f2006dcd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f28036000 tx=0x7f3f2803c040 comp rx=0 tx=0).stop 2024-02-17T00:38:48.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 msgr2=0x7f3f40156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T00:38:48.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 0x7f3f40156bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009fc0 tx=0x7f3f3800d560 comp rx=0 tx=0).stop 2024-02-17T00:38:48.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 shutdown_connections 2024-02-17T00:38:48.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3f2006b810 0x7f3f2006dcd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:48.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3f4015b8e0 0x7f3f400ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:48.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f400cc300 0x7f3f400c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:48.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 --2- 172.21.15.32:0/2151074147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f40099f30 0x7f3f40156bc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T00:38:48.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 >> 172.21.15.32:0/2151074147 conn(0x7f3f400b3130 msgr2=0x7f3f40070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T00:38:48.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 shutdown_connections 2024-02-17T00:38:48.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T00:38:48.053+0000 7f3f46db8640 1 -- 172.21.15.32:0/2151074147 wait complete. 2024-02-17T00:38:48.068 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:38:48.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/tmp/tmp.oprNTeITBlxfstests-dev/local.config 2024-02-17T00:38:48.095 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.32:6789:/test export TEST_DIR=/tmp/tmp.nBvl8wthmctest export SCRATCH_DEV=172.21.15.32:6789:/scratch export SCRATCH_MNT=/tmp/tmp.sMg5lrJz2Nscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg==" 2024-02-17T00:38:48.095 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T00:38:48.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/tmp/tmp.oprNTeITBlxfstests-dev/ceph.exclude 2024-02-17T00:38:48.162 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo make) 2024-02-17T00:38:48.233 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize -cfi 2024-02-17T00:38:48.633 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: putting auxiliary files in '.'. 2024-02-17T00:38:48.633 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './config.guess' 2024-02-17T00:38:48.636 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './config.sub' 2024-02-17T00:38:48.639 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './install-sh' 2024-02-17T00:38:48.643 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './ltmain.sh' 2024-02-17T00:38:48.664 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-17T00:38:48.664 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-17T00:38:48.668 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-17T00:38:48.672 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-17T00:38:48.676 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-17T00:38:48.681 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-17T00:38:48.687 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-17T00:38:48.688 INFO:teuthology.orchestra.run.smithi032.stdout:cp include/install-sh . 2024-02-17T00:38:48.689 INFO:teuthology.orchestra.run.smithi032.stdout:aclocal -I m4 2024-02-17T00:38:49.750 INFO:teuthology.orchestra.run.smithi032.stdout:autoheader 2024-02-17T00:38:50.051 INFO:teuthology.orchestra.run.smithi032.stdout:autoconf 2024-02-17T00:38:50.224 INFO:teuthology.orchestra.run.smithi032.stdout:./configure \ 2024-02-17T00:38:50.224 INFO:teuthology.orchestra.run.smithi032.stdout: --libexecdir=/usr/lib \ 2024-02-17T00:38:50.224 INFO:teuthology.orchestra.run.smithi032.stdout: --exec_prefix=/var/lib 2024-02-17T00:38:50.424 INFO:teuthology.orchestra.run.smithi032.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-17T00:38:50.424 INFO:teuthology.orchestra.run.smithi032.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-17T00:38:50.425 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to print strings... printf 2024-02-17T00:38:50.425 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc... gcc 2024-02-17T00:38:50.476 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether the C compiler works... yes 2024-02-17T00:38:50.476 INFO:teuthology.orchestra.run.smithi032.stdout:checking for C compiler default output file name... a.out 2024-02-17T00:38:50.502 INFO:teuthology.orchestra.run.smithi032.stdout:checking for suffix of executables... 2024-02-17T00:38:50.564 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are cross compiling... no 2024-02-17T00:38:50.580 INFO:teuthology.orchestra.run.smithi032.stdout:checking for suffix of object files... o 2024-02-17T00:38:50.595 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are using the GNU C compiler... yes 2024-02-17T00:38:50.610 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc accepts -g... yes 2024-02-17T00:38:50.636 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to accept ISO C89... none needed 2024-02-17T00:38:50.638 INFO:teuthology.orchestra.run.smithi032.stdout:checking for a sed that does not truncate output... /bin/sed 2024-02-17T00:38:50.640 INFO:teuthology.orchestra.run.smithi032.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-02-17T00:38:50.641 INFO:teuthology.orchestra.run.smithi032.stdout:checking for egrep... /bin/grep -E 2024-02-17T00:38:50.642 INFO:teuthology.orchestra.run.smithi032.stdout:checking for fgrep... /bin/grep -F 2024-02-17T00:38:50.645 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ld used by gcc... /bin/ld 2024-02-17T00:38:50.647 INFO:teuthology.orchestra.run.smithi032.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-02-17T00:38:50.659 INFO:teuthology.orchestra.run.smithi032.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-02-17T00:38:51.577 INFO:teuthology.orchestra.run.smithi032.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-02-17T00:38:51.577 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether ln -s works... yes 2024-02-17T00:38:51.595 INFO:teuthology.orchestra.run.smithi032.stdout:checking the maximum length of command line arguments... 1572864 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking for /bin/ld option to reload object files... -r 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking for objdump... objdump 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to recognize dependent libraries... pass_all 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dlltool... no 2024-02-17T00:38:51.599 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-17T00:38:51.600 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ar... ar 2024-02-17T00:38:51.649 INFO:teuthology.orchestra.run.smithi032.stdout:checking for archiver @FILE support... @ 2024-02-17T00:38:51.649 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strip... strip 2024-02-17T00:38:51.650 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ranlib... ranlib 2024-02-17T00:38:51.650 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gawk... gawk 2024-02-17T00:38:51.715 INFO:teuthology.orchestra.run.smithi032.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-02-17T00:38:51.716 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sysroot... no 2024-02-17T00:38:51.719 INFO:teuthology.orchestra.run.smithi032.stdout:checking for a working dd... /bin/dd 2024-02-17T00:38:51.721 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-02-17T00:38:51.734 INFO:teuthology.orchestra.run.smithi032.stdout:checking for mt... no 2024-02-17T00:38:51.736 INFO:teuthology.orchestra.run.smithi032.stdout:checking if : is a manifest tool... no 2024-02-17T00:38:51.775 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to run the C preprocessor... gcc -E 2024-02-17T00:38:51.928 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ANSI C header files... yes 2024-02-17T00:38:51.948 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/types.h... yes 2024-02-17T00:38:51.979 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/stat.h... yes 2024-02-17T00:38:52.001 INFO:teuthology.orchestra.run.smithi032.stdout:checking for stdlib.h... yes 2024-02-17T00:38:52.025 INFO:teuthology.orchestra.run.smithi032.stdout:checking for string.h... yes 2024-02-17T00:38:52.053 INFO:teuthology.orchestra.run.smithi032.stdout:checking for memory.h... yes 2024-02-17T00:38:52.077 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strings.h... yes 2024-02-17T00:38:52.109 INFO:teuthology.orchestra.run.smithi032.stdout:checking for inttypes.h... yes 2024-02-17T00:38:52.133 INFO:teuthology.orchestra.run.smithi032.stdout:checking for stdint.h... yes 2024-02-17T00:38:52.163 INFO:teuthology.orchestra.run.smithi032.stdout:checking for unistd.h... yes 2024-02-17T00:38:52.194 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dlfcn.h... yes 2024-02-17T00:38:52.197 INFO:teuthology.orchestra.run.smithi032.stdout:checking for objdir... .libs 2024-02-17T00:38:52.257 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-17T00:38:52.257 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-17T00:38:52.271 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-17T00:38:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc static flag -static works... no 2024-02-17T00:38:52.321 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -c -o file.o... yes 2024-02-17T00:38:52.322 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-17T00:38:52.328 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-17T00:38:52.353 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether -lc should be explicitly linked in... no 2024-02-17T00:38:52.411 INFO:teuthology.orchestra.run.smithi032.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-17T00:38:52.411 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to hardcode library paths into programs... immediate 2024-02-17T00:38:52.412 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether stripping libraries is possible... yes 2024-02-17T00:38:52.412 INFO:teuthology.orchestra.run.smithi032.stdout:checking if libtool supports shared libraries... yes 2024-02-17T00:38:52.412 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether to build shared libraries... yes 2024-02-17T00:38:52.413 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether to build static libraries... yes 2024-02-17T00:38:52.418 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc... (cached) gcc 2024-02-17T00:38:52.433 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-17T00:38:52.433 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-17T00:38:52.433 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-17T00:38:52.433 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gmake... /usr/bin/gmake 2024-02-17T00:38:52.434 INFO:teuthology.orchestra.run.smithi032.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2024-02-17T00:38:52.434 INFO:teuthology.orchestra.run.smithi032.stdout:checking for tar... /bin/tar 2024-02-17T00:38:52.434 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gzip... /bin/gzip 2024-02-17T00:38:52.442 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc -MM is supported... yes 2024-02-17T00:38:52.442 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sort... /bin/sort 2024-02-17T00:38:52.442 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether ln -s works... yes 2024-02-17T00:38:52.443 INFO:teuthology.orchestra.run.smithi032.stdout:checking for rpm... /bin/rpm 2024-02-17T00:38:52.445 INFO:teuthology.orchestra.run.smithi032.stdout:checking for rpmbuild... no 2024-02-17T00:38:52.469 INFO:teuthology.orchestra.run.smithi032.stdout:checking assert.h usability... yes 2024-02-17T00:38:52.477 INFO:teuthology.orchestra.run.smithi032.stdout:checking assert.h presence... yes 2024-02-17T00:38:52.477 INFO:teuthology.orchestra.run.smithi032.stdout:checking for assert.h... yes 2024-02-17T00:38:52.502 INFO:teuthology.orchestra.run.smithi032.stdout:checking bstring.h usability... no 2024-02-17T00:38:52.512 INFO:teuthology.orchestra.run.smithi032.stdout:checking bstring.h presence... no 2024-02-17T00:38:52.512 INFO:teuthology.orchestra.run.smithi032.stdout:checking for bstring.h... no 2024-02-17T00:38:52.537 INFO:teuthology.orchestra.run.smithi032.stdout:checking libgen.h usability... yes 2024-02-17T00:38:52.545 INFO:teuthology.orchestra.run.smithi032.stdout:checking libgen.h presence... yes 2024-02-17T00:38:52.545 INFO:teuthology.orchestra.run.smithi032.stdout:checking for libgen.h... yes 2024-02-17T00:38:52.575 INFO:teuthology.orchestra.run.smithi032.stdout:checking dirent.h usability... yes 2024-02-17T00:38:52.583 INFO:teuthology.orchestra.run.smithi032.stdout:checking dirent.h presence... yes 2024-02-17T00:38:52.583 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dirent.h... yes 2024-02-17T00:38:52.637 INFO:teuthology.orchestra.run.smithi032.stdout:checking errno.h usability... yes 2024-02-17T00:38:52.645 INFO:teuthology.orchestra.run.smithi032.stdout:checking errno.h presence... yes 2024-02-17T00:38:52.645 INFO:teuthology.orchestra.run.smithi032.stdout:checking for errno.h... yes 2024-02-17T00:38:52.680 INFO:teuthology.orchestra.run.smithi032.stdout:checking malloc.h usability... yes 2024-02-17T00:38:52.689 INFO:teuthology.orchestra.run.smithi032.stdout:checking malloc.h presence... yes 2024-02-17T00:38:52.689 INFO:teuthology.orchestra.run.smithi032.stdout:checking for malloc.h... yes 2024-02-17T00:38:52.715 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid.h usability... no 2024-02-17T00:38:52.726 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid.h presence... no 2024-02-17T00:38:52.726 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid.h... no 2024-02-17T00:38:52.766 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid/uuid.h usability... yes 2024-02-17T00:38:52.776 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid/uuid.h presence... yes 2024-02-17T00:38:52.776 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid/uuid.h... yes 2024-02-17T00:38:52.801 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/uuid.h usability... no 2024-02-17T00:38:52.812 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/uuid.h presence... no 2024-02-17T00:38:52.812 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/uuid.h... no 2024-02-17T00:38:52.837 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/file.h usability... yes 2024-02-17T00:38:52.846 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/file.h presence... yes 2024-02-17T00:38:52.846 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/file.h... yes 2024-02-17T00:38:52.881 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fcntl.h usability... yes 2024-02-17T00:38:52.889 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fcntl.h presence... yes 2024-02-17T00:38:52.890 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fcntl.h... yes 2024-02-17T00:38:52.915 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/syssgi.h usability... no 2024-02-17T00:38:52.925 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/syssgi.h presence... no 2024-02-17T00:38:52.926 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/syssgi.h... no 2024-02-17T00:38:52.961 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/param.h usability... yes 2024-02-17T00:38:52.972 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/param.h presence... yes 2024-02-17T00:38:52.973 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/param.h... yes 2024-02-17T00:38:52.977 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/stat.h... (cached) yes 2024-02-17T00:38:53.003 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/statvfs.h usability... yes 2024-02-17T00:38:53.012 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/statvfs.h presence... yes 2024-02-17T00:38:53.012 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/statvfs.h... yes 2024-02-17T00:38:53.038 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/time.h usability... yes 2024-02-17T00:38:53.046 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/time.h presence... yes 2024-02-17T00:38:53.046 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/time.h... yes 2024-02-17T00:38:53.084 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/ioctl.h usability... yes 2024-02-17T00:38:53.093 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/ioctl.h presence... yes 2024-02-17T00:38:53.093 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/ioctl.h... yes 2024-02-17T00:38:53.130 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/wait.h usability... yes 2024-02-17T00:38:53.140 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/wait.h presence... yes 2024-02-17T00:38:53.140 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/wait.h... yes 2024-02-17T00:38:53.145 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/types.h... (cached) yes 2024-02-17T00:38:53.149 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strings.h... (cached) yes 2024-02-17T00:38:53.176 INFO:teuthology.orchestra.run.smithi032.stdout:checking err.h usability... yes 2024-02-17T00:38:53.184 INFO:teuthology.orchestra.run.smithi032.stdout:checking err.h presence... yes 2024-02-17T00:38:53.184 INFO:teuthology.orchestra.run.smithi032.stdout:checking for err.h... yes 2024-02-17T00:38:53.211 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/falloc.h usability... yes 2024-02-17T00:38:53.218 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/falloc.h presence... yes 2024-02-17T00:38:53.218 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/falloc.h... yes 2024-02-17T00:38:53.244 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-02-17T00:38:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-02-17T00:38:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fs/xfs_fsops.h... no 2024-02-17T00:38:53.277 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_itable.h usability... no 2024-02-17T00:38:53.287 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_itable.h presence... no 2024-02-17T00:38:53.287 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fs/xfs_itable.h... no 2024-02-17T00:38:53.310 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/platform_defs.h usability... no 2024-02-17T00:38:53.320 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/platform_defs.h presence... no 2024-02-17T00:38:53.320 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/platform_defs.h... no 2024-02-17T00:38:53.343 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfs/ioctl.h usability... no 2024-02-17T00:38:53.354 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfs/ioctl.h presence... no 2024-02-17T00:38:53.354 INFO:teuthology.orchestra.run.smithi032.stdout:checking for btrfs/ioctl.h... no 2024-02-17T00:38:53.377 INFO:teuthology.orchestra.run.smithi032.stdout:checking cifs/ioctl.h usability... no 2024-02-17T00:38:53.387 INFO:teuthology.orchestra.run.smithi032.stdout:checking cifs/ioctl.h presence... no 2024-02-17T00:38:53.387 INFO:teuthology.orchestra.run.smithi032.stdout:checking for cifs/ioctl.h... no 2024-02-17T00:38:53.413 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/mman.h usability... yes 2024-02-17T00:38:53.421 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/mman.h presence... yes 2024-02-17T00:38:53.421 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/mman.h... yes 2024-02-17T00:38:53.435 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xfs_log_format.h... no 2024-02-17T00:38:53.468 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid_compare... no 2024-02-17T00:38:53.498 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid_compare in -luuid... yes 2024-02-17T00:38:53.558 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xfs.h... yes 2024-02-17T00:38:53.570 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/libxfs.h... no 2024-02-17T00:38:53.584 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether xlog_assign_lsn is declared... no 2024-02-17T00:38:53.613 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xqm.h... yes 2024-02-17T00:38:53.660 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfsctl from xfs/xfs.h... ok 2024-02-17T00:38:53.682 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/handle.h usability... yes 2024-02-17T00:38:53.690 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/handle.h presence... yes 2024-02-17T00:38:53.690 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/handle.h... yes 2024-02-17T00:38:53.721 INFO:teuthology.orchestra.run.smithi032.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-02-17T00:38:53.744 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/acl.h usability... yes 2024-02-17T00:38:53.753 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/acl.h presence... yes 2024-02-17T00:38:53.753 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/acl.h... yes 2024-02-17T00:38:53.776 INFO:teuthology.orchestra.run.smithi032.stdout:checking acl/libacl.h usability... yes 2024-02-17T00:38:53.785 INFO:teuthology.orchestra.run.smithi032.stdout:checking acl/libacl.h presence... yes 2024-02-17T00:38:53.785 INFO:teuthology.orchestra.run.smithi032.stdout:checking for acl/libacl.h... yes 2024-02-17T00:38:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:checking for acl_init in -lacl... yes 2024-02-17T00:38:53.838 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm-ndbm.h usability... no 2024-02-17T00:38:53.849 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm-ndbm.h presence... no 2024-02-17T00:38:53.849 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gdbm-ndbm.h... no 2024-02-17T00:38:53.871 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm/ndbm.h usability... yes 2024-02-17T00:38:53.880 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm/ndbm.h presence... yes 2024-02-17T00:38:53.880 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gdbm/ndbm.h... yes 2024-02-17T00:38:53.914 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_open in -lgdbm... no 2024-02-17T00:38:53.947 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_fetch in -lgdbm... no 2024-02-17T00:38:53.980 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_store in -lgdbm... no 2024-02-17T00:38:54.014 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_close in -lgdbm... no 2024-02-17T00:38:54.051 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-02-17T00:38:54.081 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-02-17T00:38:54.112 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-02-17T00:38:54.144 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-02-17T00:38:54.167 INFO:teuthology.orchestra.run.smithi032.stdout:checking libaio.h usability... yes 2024-02-17T00:38:54.177 INFO:teuthology.orchestra.run.smithi032.stdout:checking libaio.h presence... yes 2024-02-17T00:38:54.177 INFO:teuthology.orchestra.run.smithi032.stdout:checking for libaio.h... yes 2024-02-17T00:38:54.200 INFO:teuthology.orchestra.run.smithi032.stdout:checking liburing.h usability... no 2024-02-17T00:38:54.210 INFO:teuthology.orchestra.run.smithi032.stdout:checking liburing.h presence... no 2024-02-17T00:38:54.210 INFO:teuthology.orchestra.run.smithi032.stdout:checking for liburing.h... no 2024-02-17T00:38:54.233 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/capability.h usability... yes 2024-02-17T00:38:54.243 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/capability.h presence... yes 2024-02-17T00:38:54.243 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/capability.h... yes 2024-02-17T00:38:54.267 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fiemap.h usability... yes 2024-02-17T00:38:54.274 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fiemap.h presence... yes 2024-02-17T00:38:54.274 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/fiemap.h... yes 2024-02-17T00:38:54.307 INFO:teuthology.orchestra.run.smithi032.stdout:checking for fallocate... yes 2024-02-17T00:38:54.340 INFO:teuthology.orchestra.run.smithi032.stdout:checking for open_by_handle_at... yes 2024-02-17T00:38:54.367 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/prctl.h usability... yes 2024-02-17T00:38:54.376 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/prctl.h presence... yes 2024-02-17T00:38:54.376 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/prctl.h... yes 2024-02-17T00:38:54.399 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fs.h usability... yes 2024-02-17T00:38:54.407 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fs.h presence... yes 2024-02-17T00:38:54.407 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/fs.h... yes 2024-02-17T00:38:54.429 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfsutil.h usability... no 2024-02-17T00:38:54.439 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfsutil.h presence... no 2024-02-17T00:38:54.439 INFO:teuthology.orchestra.run.smithi032.stdout:checking for btrfsutil.h... no 2024-02-17T00:38:54.475 INFO:teuthology.orchestra.run.smithi032.stdout:checking for copy_file_range... yes 2024-02-17T00:38:54.510 INFO:teuthology.orchestra.run.smithi032.stdout:checking for SEEK_DATA... yes 2024-02-17T00:38:54.559 INFO:teuthology.orchestra.run.smithi032.stdout:checking for BMV_OF_SHARED... yes 2024-02-17T00:38:54.595 INFO:teuthology.orchestra.run.smithi032.stdout:checking for nftw... yes 2024-02-17T00:38:54.637 INFO:teuthology.orchestra.run.smithi032.stdout:checking for RLIMIT_NOFILE... yes 2024-02-17T00:38:54.668 INFO:teuthology.orchestra.run.smithi032.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-02-17T00:38:54.701 INFO:teuthology.orchestra.run.smithi032.stdout:checking for FICLONE... yes 2024-02-17T00:38:54.734 INFO:teuthology.orchestra.run.smithi032.stdout:checking for renameat2... yes 2024-02-17T00:38:54.767 INFO:teuthology.orchestra.run.smithi032.stdout:checking for reallocarray... yes 2024-02-17T00:38:54.797 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct mount_attr... yes 2024-02-17T00:38:54.828 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_qgroup_limit... yes 2024-02-17T00:38:54.859 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-02-17T00:38:54.890 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-02-17T00:38:54.921 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-02-17T00:38:54.952 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-02-17T00:38:54.983 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-02-17T00:38:55.016 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-02-17T00:38:55.044 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs.h usability... yes 2024-02-17T00:38:55.062 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs.h presence... yes 2024-02-17T00:38:55.063 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/btrfs.h... yes 2024-02-17T00:38:55.081 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs_tree.h usability... yes 2024-02-17T00:38:55.089 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs_tree.h presence... yes 2024-02-17T00:38:55.089 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/btrfs_tree.h... yes 2024-02-17T00:38:55.109 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-02-17T00:38:55.125 INFO:teuthology.orchestra.run.smithi032.stdout:configure: creating ./config.status 2024-02-17T00:38:55.409 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: creating include/builddefs 2024-02-17T00:38:55.419 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: creating include/config.h 2024-02-17T00:38:55.427 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: executing libtool commands 2024-02-17T00:38:55.464 INFO:teuthology.orchestra.run.smithi032.stdout:Building include 2024-02-17T00:38:55.467 INFO:teuthology.orchestra.run.smithi032.stdout:Building lib 2024-02-17T00:38:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: [LTDEP] 2024-02-17T00:38:55.603 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dataascii.lo 2024-02-17T00:38:55.710 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] databin.lo 2024-02-17T00:38:55.843 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] datapid.lo 2024-02-17T00:38:55.935 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] file_lock.lo 2024-02-17T00:38:56.066 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] forker.lo 2024-02-17T00:38:56.185 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] pattern.lo 2024-02-17T00:38:56.293 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] open_flags.lo 2024-02-17T00:38:56.420 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] random_range.lo 2024-02-17T00:38:56.630 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] string_to_tokens.lo 2024-02-17T00:38:56.720 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] str_to_bytes.lo 2024-02-17T00:38:56.839 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] tlibio.lo 2024-02-17T00:38:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] write_log.lo 2024-02-17T00:38:57.278 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] random.lo 2024-02-17T00:38:57.372 INFO:teuthology.orchestra.run.smithi032.stdout: [LD] 2024-02-17T00:38:57.449 INFO:teuthology.orchestra.run.smithi032.stdout:Building ltp 2024-02-17T00:38:57.452 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2024-02-17T00:38:57.586 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] doio 2024-02-17T00:38:58.210 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsstress 2024-02-17T00:38:59.580 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsx 2024-02-17T00:39:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] growfiles 2024-02-17T00:39:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] iogen 2024-02-17T00:39:01.064 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-stress 2024-02-17T00:39:01.451 INFO:teuthology.orchestra.run.smithi032.stdout:Building src 2024-02-17T00:39:01.456 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2024-02-17T00:39:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2024-02-17T00:39:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2024-02-17T00:39:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2024-02-17T00:39:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2024-02-17T00:39:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirstress 2024-02-17T00:39:03.613 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fill 2024-02-17T00:39:03.743 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fill2 2024-02-17T00:39:03.943 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] getpagesize 2024-02-17T00:39:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] holes 2024-02-17T00:39:04.223 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] lstat64 2024-02-17T00:39:04.379 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] nametest 2024-02-17T00:39:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] permname 2024-02-17T00:39:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] randholes 2024-02-17T00:39:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] runas 2024-02-17T00:39:05.123 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] truncfile 2024-02-17T00:39:05.276 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] usemem 2024-02-17T00:39:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmapcat 2024-02-17T00:39:05.527 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] append_reader 2024-02-17T00:39:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] append_writer 2024-02-17T00:39:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirperf 2024-02-17T00:39:05.977 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] metaperf 2024-02-17T00:39:06.218 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] devzero 2024-02-17T00:39:06.310 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:39:06.313 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:39:06.367 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] feature 2024-02-17T00:39:06.556 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] alloc 2024-02-17T00:39:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fault 2024-02-17T00:39:06.872 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fstest 2024-02-17T00:39:07.078 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_access_root 2024-02-17T00:39:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] godown 2024-02-17T00:39:07.349 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] resvtest 2024-02-17T00:39:07.505 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] writemod 2024-02-17T00:39:07.626 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] writev_on_pagefault 2024-02-17T00:39:07.759 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] makeextents 2024-02-17T00:39:07.910 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] itrash 2024-02-17T00:39:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] rename 2024-02-17T00:39:08.153 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] multi_open_unlink 2024-02-17T00:39:08.292 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] unwritten_sync 2024-02-17T00:39:08.445 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] genhashnames 2024-02-17T00:39:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_holes 2024-02-17T00:39:08.733 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_writev 2024-02-17T00:39:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_truncate_cmtime 2024-02-17T00:39:08.989 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirhash_collide 2024-02-17T00:39:09.145 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_rename_overwrite 2024-02-17T00:39:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] holetest 2024-02-17T00:39:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_truncate_self 2024-02-17T00:39:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] af_unix 2024-02-17T00:39:09.703 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_stale_pmd 2024-02-17T00:39:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_cow_race 2024-02-17T00:39:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_fallocate 2024-02-17T00:39:10.099 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsync-err 2024-02-17T00:39:10.258 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_write_ro 2024-02-17T00:39:10.385 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ext4_dax_journal_corruption 2024-02-17T00:39:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ext4_dax_inline_corruption 2024-02-17T00:39:10.650 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ofd_locks 2024-02-17T00:39:10.818 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_collision 2024-02-17T00:39:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmap-write-concurrent 2024-02-17T00:39:11.133 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_get_file_time 2024-02-17T00:39:11.255 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_create_short_dirs 2024-02-17T00:39:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_create_long_dirs 2024-02-17T00:39:11.539 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_enospc 2024-02-17T00:39:11.699 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_writev_overlap 2024-02-17T00:39:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] checkpoint_journal 2024-02-17T00:39:11.973 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmap-rw-fault 2024-02-17T00:39:12.130 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] allocstale 2024-02-17T00:39:12.273 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_cow_memory_failure 2024-02-17T00:39:12.416 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fake-dump-rootino 2024-02-17T00:39:12.542 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-buf-fault 2024-02-17T00:39:12.671 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] rewinddir-test 2024-02-17T00:39:12.815 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] readdir-while-renames 2024-02-17T00:39:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] xfsctl 2024-02-17T00:39:13.113 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bstat 2024-02-17T00:39:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mtab 2024-02-17T00:39:13.452 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] getdevicesize 2024-02-17T00:39:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] preallo_rw_pattern_reader 2024-02-17T00:39:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] preallo_rw_pattern_writer 2024-02-17T00:39:13.835 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] ftrunc 2024-02-17T00:39:13.959 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] trunc 2024-02-17T00:39:14.096 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fs_perms 2024-02-17T00:39:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] testx 2024-02-17T00:39:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] looptest 2024-02-17T00:39:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] locktest 2024-02-17T00:39:14.790 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] unwritten_mmap 2024-02-17T00:39:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_unlink_test 2024-02-17T00:39:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] deduperace 2024-02-17T00:39:15.269 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_unlink_test_modified 2024-02-17T00:39:15.440 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_offset 2024-02-17T00:39:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_futimens 2024-02-17T00:39:15.679 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_immutable 2024-02-17T00:39:16.255 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] stale_handle 2024-02-17T00:39:16.399 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] pwrite_mmap_blocked 2024-02-17T00:39:16.527 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_offset2 2024-02-17T00:39:16.692 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] seek_sanity_test 2024-02-17T00:39:17.098 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] seek_copy_test 2024-02-17T00:39:17.249 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_1 2024-02-17T00:39:17.373 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_2 2024-02-17T00:39:17.500 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsync-tester 2024-02-17T00:39:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] nsexec 2024-02-17T00:39:17.872 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] cloner 2024-02-17T00:39:18.024 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] renameat2 2024-02-17T00:39:18.164 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_getcwd 2024-02-17T00:39:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] e4compact 2024-02-17T00:39:18.473 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] test-nextquota 2024-02-17T00:39:18.619 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] punch-alternating 2024-02-17T00:39:18.766 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] attr-list-by-handle-cursor-test 2024-02-17T00:39:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] listxattr 2024-02-17T00:39:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-interleaved 2024-02-17T00:39:19.168 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_type 2024-02-17T00:39:19.299 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-invalidate-cache 2024-02-17T00:39:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] stat_test 2024-02-17T00:39:19.739 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_encrypted_d_revalidate 2024-02-17T00:39:19.879 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] attr_replace_test 2024-02-17T00:39:20.016 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] swapon 2024-02-17T00:39:20.155 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mkswap 2024-02-17T00:39:20.283 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_attr_corruption 2024-02-17T00:39:20.409 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_open_tmpfiles 2024-02-17T00:39:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fscrypt-crypt-util 2024-02-17T00:39:21.183 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_null_ocount 2024-02-17T00:39:21.316 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] splice-test 2024-02-17T00:39:21.471 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] chprojid_fail 2024-02-17T00:39:21.607 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] detached_mounts_propagation 2024-02-17T00:39:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] ext4_resize 2024-02-17T00:39:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_3 2024-02-17T00:39:22.058 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] splice2pipe 2024-02-17T00:39:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] uuid_ioctl 2024-02-17T00:39:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_snapshot_deleted_subvolume 2024-02-17T00:39:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fiemap-tester 2024-02-17T00:39:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_stripealign 2024-02-17T00:39:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] open_by_handle 2024-02-17T00:39:23.053 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dbtest 2024-02-17T00:39:23.272 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_dio 2024-02-17T00:39:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] xfsfind 2024-02-17T00:39:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_reflink_read_race 2024-02-17T00:39:23.744 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fssum 2024-02-17T00:39:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2024-02-17T00:39:24.155 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] replay-log 2024-02-17T00:39:24.442 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2024-02-17T00:39:24.445 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2024-02-17T00:39:24.450 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aiocp 2024-02-17T00:39:24.653 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-append-write-fallocate-race 2024-02-17T00:39:24.796 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-append-write-read-race 2024-02-17T00:39:24.945 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-cow-race 2024-02-17T00:39:25.074 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-cycle-write 2024-02-17T00:39:25.233 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-eof-race 2024-02-17T00:39:25.390 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-extend-stat 2024-02-17T00:39:25.528 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-fcntl-race 2024-02-17T00:39:25.666 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-hole-filling-race 2024-02-17T00:39:25.790 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-invalidate-failure 2024-02-17T00:39:25.927 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-invalidate-readahead 2024-02-17T00:39:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aiodio_sparse2 2024-02-17T00:39:26.258 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-subblock-eof-read 2024-02-17T00:39:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-write-verify 2024-02-17T00:39:26.548 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-02-17T00:39:26.659 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-02-17T00:39:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-last-ref-held-by-io 2024-02-17T00:39:26.919 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2024-02-17T00:39:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] vfstest 2024-02-17T00:39:30.358 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mount-idmapped 2024-02-17T00:39:30.715 INFO:teuthology.orchestra.run.smithi032.stdout:Building m4 2024-02-17T00:39:30.719 INFO:teuthology.orchestra.run.smithi032.stdout:Building common 2024-02-17T00:39:30.722 INFO:teuthology.orchestra.run.smithi032.stdout:Building tests 2024-02-17T00:39:30.727 INFO:teuthology.orchestra.run.smithi032.stdout:Building btrfs 2024-02-17T00:39:30.732 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/btrfs/group.list 2024-02-17T00:39:30.789 INFO:teuthology.orchestra.run.smithi032.stdout:Building ceph 2024-02-17T00:39:30.794 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/ceph/group.list 2024-02-17T00:39:30.807 INFO:teuthology.orchestra.run.smithi032.stdout:Building cifs 2024-02-17T00:39:30.812 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/cifs/group.list 2024-02-17T00:39:30.824 INFO:teuthology.orchestra.run.smithi032.stdout:Building ext4 2024-02-17T00:39:30.829 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/ext4/group.list 2024-02-17T00:39:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:Building f2fs 2024-02-17T00:39:30.870 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/f2fs/group.list 2024-02-17T00:39:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:Building generic 2024-02-17T00:39:30.892 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/generic/group.list 2024-02-17T00:39:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:Building nfs 2024-02-17T00:39:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/nfs/group.list 2024-02-17T00:39:31.001 INFO:teuthology.orchestra.run.smithi032.stdout:Building ocfs2 2024-02-17T00:39:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/ocfs2/group.list 2024-02-17T00:39:31.018 INFO:teuthology.orchestra.run.smithi032.stdout:Building overlay 2024-02-17T00:39:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/overlay/group.list 2024-02-17T00:39:31.061 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2024-02-17T00:39:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/perf/group.list 2024-02-17T00:39:31.076 INFO:teuthology.orchestra.run.smithi032.stdout:Building selftest 2024-02-17T00:39:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/selftest/group.list 2024-02-17T00:39:31.093 INFO:teuthology.orchestra.run.smithi032.stdout:Building shared 2024-02-17T00:39:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/shared/group.list 2024-02-17T00:39:31.114 INFO:teuthology.orchestra.run.smithi032.stdout:Building tmpfs 2024-02-17T00:39:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/tmpfs/group.list 2024-02-17T00:39:31.131 INFO:teuthology.orchestra.run.smithi032.stdout:Building udf 2024-02-17T00:39:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/udf/group.list 2024-02-17T00:39:31.146 INFO:teuthology.orchestra.run.smithi032.stdout:Building xfs 2024-02-17T00:39:31.152 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/xfs/group.list 2024-02-17T00:39:31.247 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo make install) 2024-02-17T00:39:31.284 INFO:teuthology.orchestra.run.smithi032.stdout:Building include 2024-02-17T00:39:31.287 INFO:teuthology.orchestra.run.smithi032.stdout:Building lib 2024-02-17T00:39:31.291 INFO:teuthology.orchestra.run.smithi032.stdout:Building ltp 2024-02-17T00:39:31.295 INFO:teuthology.orchestra.run.smithi032.stdout:Building src 2024-02-17T00:39:31.327 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2024-02-17T00:39:31.330 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2024-02-17T00:39:31.334 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2024-02-17T00:39:31.337 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2024-02-17T00:39:31.341 INFO:teuthology.orchestra.run.smithi032.stdout:Building m4 2024-02-17T00:39:31.344 INFO:teuthology.orchestra.run.smithi032.stdout:Building common 2024-02-17T00:39:31.347 INFO:teuthology.orchestra.run.smithi032.stdout:Building tests 2024-02-17T00:39:31.352 INFO:teuthology.orchestra.run.smithi032.stdout:Building btrfs 2024-02-17T00:39:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/btrfs/group.list 2024-02-17T00:39:31.414 INFO:teuthology.orchestra.run.smithi032.stdout:Building ceph 2024-02-17T00:39:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/ceph/group.list 2024-02-17T00:39:31.434 INFO:teuthology.orchestra.run.smithi032.stdout:Building cifs 2024-02-17T00:39:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/cifs/group.list 2024-02-17T00:39:31.451 INFO:teuthology.orchestra.run.smithi032.stdout:Building ext4 2024-02-17T00:39:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/ext4/group.list 2024-02-17T00:39:31.491 INFO:teuthology.orchestra.run.smithi032.stdout:Building f2fs 2024-02-17T00:39:31.496 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/f2fs/group.list 2024-02-17T00:39:31.511 INFO:teuthology.orchestra.run.smithi032.stdout:Building generic 2024-02-17T00:39:31.518 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/generic/group.list 2024-02-17T00:39:31.607 INFO:teuthology.orchestra.run.smithi032.stdout:Building nfs 2024-02-17T00:39:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/nfs/group.list 2024-02-17T00:39:31.625 INFO:teuthology.orchestra.run.smithi032.stdout:Building ocfs2 2024-02-17T00:39:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/ocfs2/group.list 2024-02-17T00:39:31.642 INFO:teuthology.orchestra.run.smithi032.stdout:Building overlay 2024-02-17T00:39:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/overlay/group.list 2024-02-17T00:39:31.685 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2024-02-17T00:39:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/perf/group.list 2024-02-17T00:39:31.701 INFO:teuthology.orchestra.run.smithi032.stdout:Building selftest 2024-02-17T00:39:31.706 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/selftest/group.list 2024-02-17T00:39:31.717 INFO:teuthology.orchestra.run.smithi032.stdout:Building shared 2024-02-17T00:39:31.722 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/shared/group.list 2024-02-17T00:39:31.738 INFO:teuthology.orchestra.run.smithi032.stdout:Building tmpfs 2024-02-17T00:39:31.743 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/tmpfs/group.list 2024-02-17T00:39:31.755 INFO:teuthology.orchestra.run.smithi032.stdout:Building udf 2024-02-17T00:39:31.760 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/udf/group.list 2024-02-17T00:39:31.770 INFO:teuthology.orchestra.run.smithi032.stdout:Building xfs 2024-02-17T00:39:31.777 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.oprNTeITBlxfstests-dev/tests/xfs/group.list 2024-02-17T00:39:31.867 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-02-17T00:39:31.869 INFO:teuthology.orchestra.run.smithi032.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-17T00:39:31.869 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-02-17T00:39:31.871 INFO:teuthology.orchestra.run.smithi032.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-17T00:39:31.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-02-17T00:39:31.873 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-02-17T00:39:31.881 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-02-17T00:39:31.946 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-02-17T00:39:31.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-02-17T00:39:31.970 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2024-02-17T00:39:31.974 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2024-02-17T00:39:31.977 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2024-02-17T00:39:31.981 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2024-02-17T00:39:31.984 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C log-writes install 2024-02-17T00:39:31.985 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-02-17T00:39:31.993 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-02-17T00:39:32.001 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C perf install 2024-02-17T00:39:32.003 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-02-17T00:39:32.010 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-02-17T00:39:32.030 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-02-17T00:39:32.032 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-02-17T00:39:32.040 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-02-17T00:39:32.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C vfs install 2024-02-17T00:39:32.087 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-02-17T00:39:32.095 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-02-17T00:39:32.106 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-02-17T00:39:32.114 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-02-17T00:39:33.207 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-02-17T00:39:33.296 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-02-17T00:39:33.320 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-02-17T00:39:33.321 INFO:teuthology.orchestra.run.smithi032.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-17T00:39:33.321 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-02-17T00:39:33.323 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-02-17T00:39:33.330 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-02-17T00:39:33.446 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-02-17T00:39:33.448 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/btrfs/ install 2024-02-17T00:39:33.451 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-02-17T00:39:33.459 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 /var/lib/xfstests/tests/btrfs 2024-02-17T00:39:34.187 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-02-17T00:39:34.195 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out /var/lib/xfstests/tests/btrfs 2024-02-17T00:39:34.924 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/ceph/ install 2024-02-17T00:39:34.925 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-02-17T00:39:34.933 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-02-17T00:39:34.951 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-02-17T00:39:34.959 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-02-17T00:39:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/cifs/ install 2024-02-17T00:39:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-02-17T00:39:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-02-17T00:39:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-02-17T00:39:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-02-17T00:39:35.009 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/ext4/ install 2024-02-17T00:39:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-02-17T00:39:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-02-17T00:39:35.181 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-02-17T00:39:35.189 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-02-17T00:39:35.362 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/f2fs/ install 2024-02-17T00:39:35.363 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-02-17T00:39:35.371 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-02-17T00:39:35.381 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-02-17T00:39:35.389 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-02-17T00:39:35.400 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/generic/ install 2024-02-17T00:39:35.405 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-02-17T00:39:35.413 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-02-17T00:39:36.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:39:36.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:39:37.149 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-02-17T00:39:37.157 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-02-17T00:39:38.916 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/nfs/ install 2024-02-17T00:39:38.918 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-02-17T00:39:38.926 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-02-17T00:39:38.934 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-02-17T00:39:38.942 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-02-17T00:39:38.949 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/ocfs2/ install 2024-02-17T00:39:38.951 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-02-17T00:39:38.959 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-02-17T00:39:38.967 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-02-17T00:39:38.975 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-02-17T00:39:38.983 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/overlay/ install 2024-02-17T00:39:38.985 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-02-17T00:39:38.993 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-02-17T00:39:39.241 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-02-17T00:39:39.249 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-02-17T00:39:39.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/perf/ install 2024-02-17T00:39:39.500 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-02-17T00:39:39.508 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-02-17T00:39:39.515 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-02-17T00:39:39.524 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-02-17T00:39:39.532 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/selftest/ install 2024-02-17T00:39:39.533 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-02-17T00:39:39.541 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-02-17T00:39:39.560 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-02-17T00:39:39.568 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-02-17T00:39:39.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/shared/ install 2024-02-17T00:39:39.590 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-02-17T00:39:39.598 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-02-17T00:39:39.610 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-02-17T00:39:39.619 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-02-17T00:39:39.631 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/tmpfs/ install 2024-02-17T00:39:39.633 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-02-17T00:39:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-02-17T00:39:39.648 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-02-17T00:39:39.656 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-02-17T00:39:39.664 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/udf/ install 2024-02-17T00:39:39.666 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-02-17T00:39:39.674 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-02-17T00:39:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-02-17T00:39:39.690 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-02-17T00:39:39.698 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.oprNTeITBlxfstests-dev/tests/xfs/ install 2024-02-17T00:39:39.703 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-02-17T00:39:39.711 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 602 603 604 605 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-02-17T00:39:41.355 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-02-17T00:39:41.363 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 602.out 603.out 604.out 605.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-02-17T00:39:43.026 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-02-17T00:39:43.034 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-02-17T00:39:43.041 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-02-17T00:39:43.049 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-02-17T00:39:43.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T00:39:43.059 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec ls tests/generic) 2024-02-17T00:39:43.075 INFO:teuthology.orchestra.run.smithi032.stdout:001 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:001.out 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:002 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:002.out 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:003 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:003.out 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:004 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:004.out 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:005 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:005.out 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:006 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:006.out 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:007 2024-02-17T00:39:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:007.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:008 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:008.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:009 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:009.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:010 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:010.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:011 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:011.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:012 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:012.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:013 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:013.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:014 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:014.out 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:015 2024-02-17T00:39:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:015.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:016 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:016.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:017 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:017.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:018 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:018.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:019 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:019.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:020 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:020.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:021 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:021.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:022 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:022.out 2024-02-17T00:39:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:023 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:023.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:024 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:024.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:025 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:025.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:026 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:026.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:027 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:027.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:028 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:028.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:029 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:029.out 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:030 2024-02-17T00:39:43.079 INFO:teuthology.orchestra.run.smithi032.stdout:030.out 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:031 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:031.out 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:032 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:032.out 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:033 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:033.out 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:034 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:034.out 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:035 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:035.cfg 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:035.out.default 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:035.out.nfs 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:036 2024-02-17T00:39:43.080 INFO:teuthology.orchestra.run.smithi032.stdout:036.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:037 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:037.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:038 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:038.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:039 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:039.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:040 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:040.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:041 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:041.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:042 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:042.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:043 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:043.out 2024-02-17T00:39:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:044 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:044.out 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:045 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:045.out 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:046 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:046.out 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:047 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:047.out 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:048 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:048.out 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:049 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:049.out 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:050 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:050.cfg 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.default 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.nojournal 2024-02-17T00:39:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.xfsquota 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:051 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:051.out 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:052 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:052.out 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:053 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:053.out 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:054 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:054.out 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:055 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:055.out 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:056 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:056.out 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:057 2024-02-17T00:39:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:057.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:058 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:058.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:059 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:059.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:060 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:060.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:061 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:061.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:062 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:062.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:063 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:063.out 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:064 2024-02-17T00:39:43.084 INFO:teuthology.orchestra.run.smithi032.stdout:064.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:065 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:065.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:066 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:066.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:067 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:067.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:068 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:068.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:069 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:069.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:070 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:070.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:071 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:071.out 2024-02-17T00:39:43.085 INFO:teuthology.orchestra.run.smithi032.stdout:072 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:072.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:073 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:073.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:074 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:074.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:075 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:075.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:076 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:076.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:077 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:077.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:078 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:078.out 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:079 2024-02-17T00:39:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:079.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:080 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:080.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:081 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:081.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:082 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:082.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:083 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:083.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:084 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:084.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:085 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:085.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:086 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:086.out 2024-02-17T00:39:43.087 INFO:teuthology.orchestra.run.smithi032.stdout:087 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:087.out 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:088 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:088.out 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:089 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:089.out 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:090 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:090.out 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:091 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:091.out 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:092 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:092.out 2024-02-17T00:39:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:093 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:093.out 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:094 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:094.out 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:095 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:095.out 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:096 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:096.out 2024-02-17T00:39:43.091 INFO:teuthology.orchestra.run.smithi032.stdout:097 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:097.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:098 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:098.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:099 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:099.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:100 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:100.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:101 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:101.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:102 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:102.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:103 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:103.out 2024-02-17T00:39:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:104 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:104.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:105 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:105.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:106 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:106.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:107 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:107.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:108 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:108.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:109 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:109.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:110 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:110.out 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:111 2024-02-17T00:39:43.093 INFO:teuthology.orchestra.run.smithi032.stdout:111.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:112 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:112.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:113 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:113.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:114 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:114.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:115 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:115.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:116 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:116.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:117 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:117.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:118 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:118.out 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:119 2024-02-17T00:39:43.094 INFO:teuthology.orchestra.run.smithi032.stdout:119.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:120 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:120.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:121 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:121.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:122 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:122.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:123 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:123.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:124 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:124.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:125 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:125.out 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:126 2024-02-17T00:39:43.095 INFO:teuthology.orchestra.run.smithi032.stdout:126.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:127 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:127.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:128 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:128.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:129 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:129.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:130 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:130.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:131 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:131.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:132 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:132.out 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:133 2024-02-17T00:39:43.096 INFO:teuthology.orchestra.run.smithi032.stdout:133.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:134 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:134.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:135 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:135.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:136 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:136.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:137 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:137.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:138 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:138.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:139 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:139.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:140 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:140.out 2024-02-17T00:39:43.097 INFO:teuthology.orchestra.run.smithi032.stdout:141 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:141.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:142 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:142.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:143 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:143.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:144 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:144.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:145 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:145.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:146 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:146.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:147 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:147.out 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:148 2024-02-17T00:39:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:148.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:149 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:149.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:150 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:150.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:151 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:151.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:152 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:152.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:153 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:153.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:154 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:154.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:155 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:155.out 2024-02-17T00:39:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:156 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:156.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:157 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:157.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:158 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:158.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:159 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:159.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:160 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:160.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:161 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:161.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:162 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:162.out 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:163 2024-02-17T00:39:43.100 INFO:teuthology.orchestra.run.smithi032.stdout:163.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:164 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:164.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:165 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:165.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:166 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:166.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:167 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:167.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:168 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:168.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:169 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:169.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:170 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:170.out 2024-02-17T00:39:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:171 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:171.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:172 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:172.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:173 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:173.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:174 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:174.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:175 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:175.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:176 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:176.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:177 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:177.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:178 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:178.out 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:179 2024-02-17T00:39:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:179.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:180 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:180.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:181 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:181.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:182 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:182.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:183 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:183.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:184 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:184.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:185 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:185.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:186 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:186.out 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:187 2024-02-17T00:39:43.103 INFO:teuthology.orchestra.run.smithi032.stdout:187.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:188 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:188.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:189 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:189.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:190 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:190.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:191 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:191.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:192 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:192.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:193 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:193.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:194 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:194.out 2024-02-17T00:39:43.104 INFO:teuthology.orchestra.run.smithi032.stdout:195 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:195.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:196 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:196.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:197 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:197.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:198 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:198.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:199 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:199.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:200 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:200.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:201 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:201.out 2024-02-17T00:39:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:202 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:202.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:203 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:203.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:204 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:204.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:205 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:205.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:206 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:206.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:207 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:207.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:208 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:208.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:209 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:209.out 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:210 2024-02-17T00:39:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:210.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:211 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:211.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:212 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:212.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:213 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:213.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:214 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:214.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:215 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:215.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:216 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:216.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:217 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:217.out 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:218 2024-02-17T00:39:43.107 INFO:teuthology.orchestra.run.smithi032.stdout:218.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:219 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:219.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:220 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:220.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:221 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:221.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:222 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:222.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:223 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:223.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:224 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:224.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:225 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:225.out 2024-02-17T00:39:43.108 INFO:teuthology.orchestra.run.smithi032.stdout:226 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:226.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:227 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:227.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:228 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:228.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:229 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:229.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:230 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:230.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:231 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:231.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:232 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:232.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:233 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:233.out 2024-02-17T00:39:43.109 INFO:teuthology.orchestra.run.smithi032.stdout:234 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:234.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:235 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:235.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:236 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:236.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:237 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:237.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:238 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:238.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:239 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:239.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:240 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:240.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:241 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:241.out 2024-02-17T00:39:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:242 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:242.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:243 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:243.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:244 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:244.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:245 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:245.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:246 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:246.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:247 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:247.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:248 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:248.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:249 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:249.out 2024-02-17T00:39:43.111 INFO:teuthology.orchestra.run.smithi032.stdout:250 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:250.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:251 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:251.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:252 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:252.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:253 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:253.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:254 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:254.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:255 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:255.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:256 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:256.out 2024-02-17T00:39:43.112 INFO:teuthology.orchestra.run.smithi032.stdout:257 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:257.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:258 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:258.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:259 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:259.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:260 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:260.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:261 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:261.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:262 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:262.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:263 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:263.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:264 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:264.out 2024-02-17T00:39:43.113 INFO:teuthology.orchestra.run.smithi032.stdout:265 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:265.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:266 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:266.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:267 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:267.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:268 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:268.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:269 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:269.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:270 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:270.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:271 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:271.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:272 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:272.out 2024-02-17T00:39:43.114 INFO:teuthology.orchestra.run.smithi032.stdout:273 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:273.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:274 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:274.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:275 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:275.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:276 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:276.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:277 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:277.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:278 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:278.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:279 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:279.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:280 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:280.out 2024-02-17T00:39:43.115 INFO:teuthology.orchestra.run.smithi032.stdout:281 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:281.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:282 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:282.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:283 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:283.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:284 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:284.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:285 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:285.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:286 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:286.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:287 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:287.out 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:288 2024-02-17T00:39:43.116 INFO:teuthology.orchestra.run.smithi032.stdout:288.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:289 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:289.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:290 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:290.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:291 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:291.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:292 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:292.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:293 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:293.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:294 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:294.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:295 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:295.out 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:296 2024-02-17T00:39:43.117 INFO:teuthology.orchestra.run.smithi032.stdout:296.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:297 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:297.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:298 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:298.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:299 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:299.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:300 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:300.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:301 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:301.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:302 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:302.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:303 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:303.out 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:304 2024-02-17T00:39:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:304.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:305 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:305.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:306 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:306.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:307 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:307.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:308 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:308.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:309 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:309.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:310 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:310.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:311 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:311.out 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:312 2024-02-17T00:39:43.119 INFO:teuthology.orchestra.run.smithi032.stdout:312.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:313 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:313.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:314 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:314.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:315 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:315.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:316 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:316.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:317 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:317.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:318 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:318.out 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:319 2024-02-17T00:39:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:319.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:320 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:320.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:321 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:321.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:322 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:322.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:323 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:323.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:324 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:324.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:325 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:325.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:326 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:326.out 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:327 2024-02-17T00:39:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:327.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:328 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:328.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:329 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:329.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:330 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:330.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:331 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:331.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:332 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:332.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:333 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:333.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:334 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:334.out 2024-02-17T00:39:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:335 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:335.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:336 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:336.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:337 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:337.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:338 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:338.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:339 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:339.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:340 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:340.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:341 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:341.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:342 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:342.out 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:343 2024-02-17T00:39:43.123 INFO:teuthology.orchestra.run.smithi032.stdout:343.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:344 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:344.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:345 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:345.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:346 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:346.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:347 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:347.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:348 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:348.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:349 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:349.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:350 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:350.out 2024-02-17T00:39:43.124 INFO:teuthology.orchestra.run.smithi032.stdout:351 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:351.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:352 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:352.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:353 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:353.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:354 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:354.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:355 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:355.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:356 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:356.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:357 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:357.out 2024-02-17T00:39:43.125 INFO:teuthology.orchestra.run.smithi032.stdout:358 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:358.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:359 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:359.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:360 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:360.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:361 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:361.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:362 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:362.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:363 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:363.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:364 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:364.out 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:365 2024-02-17T00:39:43.126 INFO:teuthology.orchestra.run.smithi032.stdout:365.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:366 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:366.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:367 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:367.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:368 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:368.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:369 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:369.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:370 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:370.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:371 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:371.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:372 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:372.out 2024-02-17T00:39:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:373 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:373.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:374 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:374.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:375 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:375.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:376 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:376.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:377 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:377.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:378 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:378.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:379 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:379.out 2024-02-17T00:39:43.128 INFO:teuthology.orchestra.run.smithi032.stdout:380 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:380.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:381 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:381.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:382 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:382.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:383 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:383.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:384 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:384.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:385 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:385.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:386 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:386.out 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:387 2024-02-17T00:39:43.129 INFO:teuthology.orchestra.run.smithi032.stdout:387.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:388 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:388.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:389 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:389.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:390 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:390.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:391 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:391.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:392 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:392.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:393 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:393.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:394 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:394.out 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:395 2024-02-17T00:39:43.130 INFO:teuthology.orchestra.run.smithi032.stdout:395.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:396 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:396.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:397 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:397.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:398 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:398.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:399 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:399.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:400 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:400.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:401 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:401.out 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:402 2024-02-17T00:39:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:402.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:403 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:403.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:404 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:404.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:405 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:405.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:406 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:406.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:407 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:407.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:408 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:408.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:409 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:409.out 2024-02-17T00:39:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:410 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:410.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:411 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:411.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:412 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:412.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:413 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:413.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:414 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:414.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:415 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:415.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:416 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:416.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:417 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:417.out 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:418 2024-02-17T00:39:43.133 INFO:teuthology.orchestra.run.smithi032.stdout:418.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:419 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:419.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:420 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:420.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:421 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:421.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:422 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:422.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:423 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:423.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:424 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:424.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:425 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:425.out 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:426 2024-02-17T00:39:43.134 INFO:teuthology.orchestra.run.smithi032.stdout:426.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:427 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:427.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:428 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:428.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:429 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:429.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:430 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:430.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:431 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:431.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:432 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:432.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:433 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:433.out 2024-02-17T00:39:43.135 INFO:teuthology.orchestra.run.smithi032.stdout:434 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:434.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:435 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:435.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:436 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:436.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:437 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:437.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:438 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:438.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:439 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:439.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:440 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:440.out 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:441 2024-02-17T00:39:43.136 INFO:teuthology.orchestra.run.smithi032.stdout:441.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:442 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:442.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:443 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:443.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:444 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:444.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:445 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:445.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:446 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:446.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:447 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:447.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:448 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:448.out 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:449 2024-02-17T00:39:43.137 INFO:teuthology.orchestra.run.smithi032.stdout:449.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:450 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:450.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:451 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:451.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:452 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:452.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:453 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:453.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:454 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:454.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:455 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:455.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:456 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:456.out 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:457 2024-02-17T00:39:43.138 INFO:teuthology.orchestra.run.smithi032.stdout:457.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:458 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:458.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:459 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:459.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:460 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:460.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:461 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:461.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:462 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:462.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:463 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:463.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:464 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:464.out 2024-02-17T00:39:43.139 INFO:teuthology.orchestra.run.smithi032.stdout:465 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:465.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:466 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:466.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:467 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:467.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:468 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:468.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:469 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:469.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:470 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:470.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:471 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:471.out 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:472 2024-02-17T00:39:43.140 INFO:teuthology.orchestra.run.smithi032.stdout:472.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:473 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:473.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:474 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:474.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:475 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:475.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:476 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:476.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:477 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:477.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:478 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:478.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:479 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:479.out 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:480 2024-02-17T00:39:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:480.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:481 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:481.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:482 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:482.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:483 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:483.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:484 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:484.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:485 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:485.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:486 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:486.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:487 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:487.out 2024-02-17T00:39:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:488 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:488.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:489 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:489.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:490 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:490.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:491 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:491.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:492 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:492.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:493 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:493.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:494 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:494.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:495 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:495.out 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:496 2024-02-17T00:39:43.143 INFO:teuthology.orchestra.run.smithi032.stdout:496.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:497 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:497.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:498 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:498.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:499 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:499.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:500 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:500.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:501 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:501.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:502 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:502.out 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:503 2024-02-17T00:39:43.144 INFO:teuthology.orchestra.run.smithi032.stdout:503.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:504 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:504.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:505 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:505.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:506 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:506.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:507 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:507.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:508 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:508.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:509 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:509.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:510 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:510.out 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:511 2024-02-17T00:39:43.145 INFO:teuthology.orchestra.run.smithi032.stdout:511.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:512 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:512.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:513 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:513.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:514 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:514.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:515 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:515.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:516 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:516.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:517 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:517.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:518 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:518.out 2024-02-17T00:39:43.146 INFO:teuthology.orchestra.run.smithi032.stdout:519 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:519.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:520 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:520.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:521 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:521.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:522 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:522.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:523 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:523.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:524 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:524.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:525 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:525.out 2024-02-17T00:39:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:526 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:526.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:527 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:527.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:528 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:528.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:529 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:529.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:530 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:530.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:531 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:531.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:532 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:532.out 2024-02-17T00:39:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:533 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:533.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:534 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:534.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:535 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:535.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:536 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:536.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:537 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:537.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:538 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:538.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:539 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:539.out 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:540 2024-02-17T00:39:43.149 INFO:teuthology.orchestra.run.smithi032.stdout:540.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:541 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:541.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:542 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:542.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:543 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:543.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:544 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:544.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:545 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:545.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:546 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:546.out 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:547 2024-02-17T00:39:43.150 INFO:teuthology.orchestra.run.smithi032.stdout:547.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:548 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:548.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:549 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:549.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:550 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:550.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:551 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:551.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:552 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:552.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:553 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:553.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:554 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:554.out 2024-02-17T00:39:43.151 INFO:teuthology.orchestra.run.smithi032.stdout:555 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:555.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:556 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:556.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:557 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:557.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:558 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:558.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:559 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:559.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:560 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:560.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:561 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:561.out 2024-02-17T00:39:43.152 INFO:teuthology.orchestra.run.smithi032.stdout:562 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:562.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:563 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:563.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:564 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:564.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:565 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:565.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:566 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:566.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:567 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:567.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:568 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:568.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:569 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:569.out 2024-02-17T00:39:43.153 INFO:teuthology.orchestra.run.smithi032.stdout:570 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:570.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:571 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:571.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:572 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:572.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:573 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:573.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:574 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:574.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:575 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:575.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:576 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:576.out 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:577 2024-02-17T00:39:43.154 INFO:teuthology.orchestra.run.smithi032.stdout:577.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:578 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:578.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:579 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:579.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:580 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:580.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:581 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:581.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:582 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:582.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:583 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:583.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:584 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:584.out 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:585 2024-02-17T00:39:43.155 INFO:teuthology.orchestra.run.smithi032.stdout:585.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:586 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:586.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:587 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:587.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:588 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:588.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:589 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:589.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:590 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:590.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:591 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:591.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:592 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:592.out 2024-02-17T00:39:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:593 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:593.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:594 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:594.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:595 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:595.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:596 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:596.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:597 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:597.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:598 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:598.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:599 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:599.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:600 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:600.out 2024-02-17T00:39:43.157 INFO:teuthology.orchestra.run.smithi032.stdout:601 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:601.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:602 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:602.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:603 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:603.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:604 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:604.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:605 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:605.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:606 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:606.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:607 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:607.out 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:608 2024-02-17T00:39:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:608.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:609 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:609.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:610 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:610.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:611 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:611.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:612 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:612.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:613 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:613.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:614 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:614.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:615 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:615.out 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:616 2024-02-17T00:39:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:616.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:617 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:617.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:618 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:618.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:619 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:619.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:620 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:620.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:621 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:621.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:622 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:622.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:623 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:623.out 2024-02-17T00:39:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:624 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:624.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:625 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:625.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:626 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:626.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:627 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:627.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:628 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:628.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:629 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:629.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:630 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:630.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:631 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:631.out 2024-02-17T00:39:43.161 INFO:teuthology.orchestra.run.smithi032.stdout:632 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:632.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:633 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:633.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:634 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:634.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:635 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:635.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:636 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:636.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:637 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:637.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:638 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:638.out 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:639 2024-02-17T00:39:43.162 INFO:teuthology.orchestra.run.smithi032.stdout:639.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:640 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:640.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:641 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:641.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:642 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:642.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:643 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:643.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:644 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:644.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:645 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:645.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:646 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:646.out 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:647 2024-02-17T00:39:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:647.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:648 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:648.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:649 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:649.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:650 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:650.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:651 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:651.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:652 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:652.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:653 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:653.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:654 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:654.out 2024-02-17T00:39:43.164 INFO:teuthology.orchestra.run.smithi032.stdout:655 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:655.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:656 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:656.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:657 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:657.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:658 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:658.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:659 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:659.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:660 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:660.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:661 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:661.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:662 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:662.out 2024-02-17T00:39:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:663 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:663.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:664 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:664.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:665 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:665.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:666 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:666.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:667 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:667.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:668 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:668.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:669 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:669.out 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:670 2024-02-17T00:39:43.166 INFO:teuthology.orchestra.run.smithi032.stdout:670.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:671 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:671.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:672 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:672.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:673 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:673.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:674 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:674.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:675 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:675.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:676 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:676.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:677 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:677.out 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:678 2024-02-17T00:39:43.167 INFO:teuthology.orchestra.run.smithi032.stdout:678.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:679 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:679.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:680 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:680.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:681 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:681.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:682 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:682.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:683 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:683.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:684 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:684.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:685 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:685.out 2024-02-17T00:39:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:686 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:686.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:687 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:687.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:688 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:688.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:689 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:689.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:690 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:690.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:691 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:691.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:692 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:692.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:693 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:693.out 2024-02-17T00:39:43.169 INFO:teuthology.orchestra.run.smithi032.stdout:694 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:694.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:695 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:695.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:696 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:696.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:697 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:697.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:698 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:698.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:699 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:699.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:700 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:700.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:701 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:701.out 2024-02-17T00:39:43.170 INFO:teuthology.orchestra.run.smithi032.stdout:702 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:702.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:703 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:703.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:704 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:704.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:705 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:705.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:706 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:706.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:707 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:707.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:708 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:708.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:709 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:709.out 2024-02-17T00:39:43.171 INFO:teuthology.orchestra.run.smithi032.stdout:710 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:710.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:711 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:711.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:712 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:712.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:713 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:713.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:714 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:714.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:715 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:715.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:716 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:716.out 2024-02-17T00:39:43.172 INFO:teuthology.orchestra.run.smithi032.stdout:717 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:717.out 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:718 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:718.out 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:719 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:719.out 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:720 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:720.out 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:721 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:721.out 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:722 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:722.out 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:723 2024-02-17T00:39:43.173 INFO:teuthology.orchestra.run.smithi032.stdout:723.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:724 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:724.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:725 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:725.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:726 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:726.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:727 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:727.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:728 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:728.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:729 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:729.out 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:730 2024-02-17T00:39:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:730.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:731 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:731.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:732 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:732.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:733 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:733.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:734 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:734.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:735 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:735.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:736 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:736.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:737 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:737.out 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:738 2024-02-17T00:39:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:738.out 2024-02-17T00:39:43.176 INFO:teuthology.orchestra.run.smithi032.stdout:739 2024-02-17T00:39:43.176 INFO:teuthology.orchestra.run.smithi032.stdout:739.out 2024-02-17T00:39:43.176 INFO:teuthology.orchestra.run.smithi032.stdout:group.list 2024-02-17T00:39:43.176 INFO:teuthology.orchestra.run.smithi032.stdout:Makefile 2024-02-17T00:39:43.176 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-02-17T00:39:43.364 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:39:43.368 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:39:43.368 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:39:43.369 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:39:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:46.806 INFO:teuthology.orchestra.run.smithi032.stdout:generic/001 3s 2024-02-17T00:39:46.811 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/001 2024-02-17T00:39:46.811 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:39:46.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:47.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:39:47.406 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-02-17T00:39:47.594 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:39:47.597 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:39:47.598 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:39:47.599 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:39:47.599 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:48.015 INFO:teuthology.orchestra.run.smithi032.stdout:generic/002 1s 2024-02-17T00:39:48.023 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/002 2024-02-17T00:39:48.023 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:39:48.026 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:48.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:39:48.110 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-02-17T00:39:48.289 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:39:48.293 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:39:48.293 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:39:48.294 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:39:48.294 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:48.497 INFO:teuthology.orchestra.run.smithi032.stdout:generic/003 [not run] atime not maintained by ceph 2024-02-17T00:39:48.501 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/003 2024-02-17T00:39:48.501 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/003 2024-02-17T00:39:48.501 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:39:48.503 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:48.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:39:48.513 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-02-17T00:39:48.691 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:39:48.695 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:39:48.695 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:39:48.696 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:39:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:48.908 INFO:teuthology.orchestra.run.smithi032.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-02-17T00:39:48.911 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/004 2024-02-17T00:39:48.911 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/004 2024-02-17T00:39:48.912 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:39:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:48.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:39:48.925 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-02-17T00:39:49.097 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:39:49.100 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:39:49.101 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:39:49.101 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:39:49.101 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:49.457 INFO:teuthology.orchestra.run.smithi032.stdout:generic/005 0s 2024-02-17T00:39:49.461 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/005 2024-02-17T00:39:49.462 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:39:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:39:49.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:39:49.526 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-02-17T00:39:49.712 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:39:49.716 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:39:49.716 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:39:49.717 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:39:49.717 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:06.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:40:06.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:40:10.584 INFO:teuthology.orchestra.run.smithi032.stdout:generic/006 21s 2024-02-17T00:40:10.589 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/006 2024-02-17T00:40:10.589 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:40:10.592 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:10.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:40:10.620 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-02-17T00:40:10.796 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:40:10.799 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:40:10.799 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:40:10.800 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:40:10.800 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:36.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:40:36.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:40:52.425 INFO:teuthology.orchestra.run.smithi032.stdout:generic/007 42s 2024-02-17T00:40:52.430 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/007 2024-02-17T00:40:52.431 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:40:52.433 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:52.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:40:52.524 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-02-17T00:40:52.719 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:40:52.724 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:40:52.725 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:40:52.726 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:40:52.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:53.075 INFO:teuthology.orchestra.run.smithi032.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-17T00:40:53.079 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/008 2024-02-17T00:40:53.079 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/008 2024-02-17T00:40:53.079 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:40:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:53.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:40:53.094 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-02-17T00:40:53.265 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:40:53.268 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:40:53.268 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:40:53.269 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:40:53.269 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:53.522 INFO:teuthology.orchestra.run.smithi032.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-17T00:40:53.526 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/009 2024-02-17T00:40:53.526 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/009 2024-02-17T00:40:53.526 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:40:53.528 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:53.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:40:53.542 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-02-17T00:40:53.724 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:40:53.728 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:40:53.728 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:40:53.729 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:40:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:54.247 INFO:teuthology.orchestra.run.smithi032.stdout:generic/010 1s 2024-02-17T00:40:54.252 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/010 2024-02-17T00:40:54.252 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:40:54.254 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:40:54.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:40:54.289 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-02-17T00:40:54.472 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:40:54.475 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:40:54.476 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:40:54.476 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:40:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:41:06.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:41:06.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:41:20.687 INFO:teuthology.orchestra.run.smithi032.stdout:generic/011 26s 2024-02-17T00:41:20.691 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/011 2024-02-17T00:41:20.691 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:41:20.693 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:41:21.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:41:21.156 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-02-17T00:41:21.372 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:41:21.375 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:41:21.376 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:41:21.377 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:41:21.377 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:41:21.653 INFO:teuthology.orchestra.run.smithi032.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:41:21.657 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/012 2024-02-17T00:41:21.657 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/012 2024-02-17T00:41:21.657 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:41:21.659 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:41:21.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:41:21.697 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-02-17T00:41:21.886 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:41:21.889 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:41:21.889 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:41:21.890 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:41:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:41:37.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:41:37.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:42:07.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:42:07.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:42:16.435 INFO:teuthology.orchestra.run.smithi032.stdout:generic/013 55s 2024-02-17T00:42:16.442 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/013 2024-02-17T00:42:16.443 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:16.446 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:16.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:16.474 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-02-17T00:42:16.716 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:16.721 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:16.722 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:16.723 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:16.723 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:17.020 INFO:teuthology.orchestra.run.smithi032.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-02-17T00:42:17.026 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/014 2024-02-17T00:42:17.026 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/014 2024-02-17T00:42:17.026 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:17.028 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:17.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:17.046 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-02-17T00:42:17.311 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:17.316 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:17.317 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:17.318 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:17.318 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:17.583 INFO:teuthology.orchestra.run.smithi032.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T00:42:17.588 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/015 2024-02-17T00:42:17.588 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/015 2024-02-17T00:42:17.588 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:17.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:17.608 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-02-17T00:42:17.866 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:17.871 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:17.871 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:17.873 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:17.873 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:18.260 INFO:teuthology.orchestra.run.smithi032.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:42:18.265 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/016 2024-02-17T00:42:18.265 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/016 2024-02-17T00:42:18.265 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:18.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:18.305 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-02-17T00:42:18.593 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:18.599 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:18.599 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:18.600 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:18.879 INFO:teuthology.orchestra.run.smithi032.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T00:42:18.885 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/017 2024-02-17T00:42:18.885 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/017 2024-02-17T00:42:18.885 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:18.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:18.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:18.905 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-02-17T00:42:19.157 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:19.163 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:19.164 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:19.165 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:19.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-02-17T00:42:19.526 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/018 2024-02-17T00:42:19.526 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/018 2024-02-17T00:42:19.526 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:19.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:19.545 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-02-17T00:42:19.794 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:19.800 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:19.801 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:19.803 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:20.067 INFO:teuthology.orchestra.run.smithi032.stdout:generic/019 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:42:20.072 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/019 2024-02-17T00:42:20.072 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/019 2024-02-17T00:42:20.072 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:20.075 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:20.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:20.089 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-02-17T00:42:20.335 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:20.340 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:20.341 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:20.342 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:20.342 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:generic/020 4s 2024-02-17T00:42:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/020 2024-02-17T00:42:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:24.145 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:24.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:24.173 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-02-17T00:42:24.465 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:24.469 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:24.469 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:24.471 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:24.838 INFO:teuthology.orchestra.run.smithi032.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:42:24.843 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/021 2024-02-17T00:42:24.843 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/021 2024-02-17T00:42:24.843 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:24.846 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:24.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:24.879 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-02-17T00:42:25.179 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:25.184 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:25.185 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:25.186 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:25.186 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:25.573 INFO:teuthology.orchestra.run.smithi032.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:42:25.579 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/022 2024-02-17T00:42:25.579 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/022 2024-02-17T00:42:25.580 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:25.583 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:25.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:25.621 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-02-17T00:42:25.909 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:25.914 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:25.915 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:25.916 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:25.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:27.194 INFO:teuthology.orchestra.run.smithi032.stdout:generic/023 1s 2024-02-17T00:42:27.258 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/023 2024-02-17T00:42:27.258 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:27.261 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:27.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:27.353 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-02-17T00:42:27.646 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:27.651 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:27.651 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:27.653 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:27.961 INFO:teuthology.orchestra.run.smithi032.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-02-17T00:42:27.966 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/024 2024-02-17T00:42:27.967 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/024 2024-02-17T00:42:27.967 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:27.970 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:28.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:28.025 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-02-17T00:42:28.317 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:28.321 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:28.322 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:28.323 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:28.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:28.621 INFO:teuthology.orchestra.run.smithi032.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-02-17T00:42:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/025 2024-02-17T00:42:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/025 2024-02-17T00:42:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:28.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:28.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:28.658 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-02-17T00:42:28.948 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:28.952 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:28.953 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:28.954 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:28.954 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:29.270 INFO:teuthology.orchestra.run.smithi032.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-02-17T00:42:29.276 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/026 2024-02-17T00:42:29.276 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/026 2024-02-17T00:42:29.276 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:29.281 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:29.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:29.301 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-02-17T00:42:29.544 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:29.549 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:29.550 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:29.551 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:29.551 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:29.813 INFO:teuthology.orchestra.run.smithi032.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T00:42:29.818 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/027 2024-02-17T00:42:29.818 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/027 2024-02-17T00:42:29.819 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:29.821 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:29.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:29.836 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-02-17T00:42:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:30.078 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:35.369 INFO:teuthology.orchestra.run.smithi032.stdout:generic/028 5s 2024-02-17T00:42:35.378 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/028 2024-02-17T00:42:35.378 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:35.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:35.399 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-02-17T00:42:35.642 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:35.647 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:35.647 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:35.649 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:35.649 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:37.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:42:37.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:42:39.060 INFO:teuthology.orchestra.run.smithi032.stdout:generic/029 4s 2024-02-17T00:42:39.129 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/029 2024-02-17T00:42:39.129 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:39.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:39.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:39.144 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-02-17T00:42:39.399 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:39.403 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:39.404 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:39.405 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:39.405 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:40.826 INFO:teuthology.orchestra.run.smithi032.stdout:generic/030 1s 2024-02-17T00:42:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/030 2024-02-17T00:42:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:40.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:40.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:40.849 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-02-17T00:42:41.091 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:41.096 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:41.097 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:41.098 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:41.098 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:41.467 INFO:teuthology.orchestra.run.smithi032.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-17T00:42:41.472 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/031 2024-02-17T00:42:41.472 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/031 2024-02-17T00:42:41.472 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:41.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:41.496 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-02-17T00:42:41.740 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:41.745 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:41.746 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:41.747 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:41.747 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:42.024 INFO:teuthology.orchestra.run.smithi032.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:42:42.028 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/032 2024-02-17T00:42:42.028 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/032 2024-02-17T00:42:42.028 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:42.032 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:42.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:42.051 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-02-17T00:42:42.309 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:42.313 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:42.313 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:42.314 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:42.315 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:42.646 INFO:teuthology.orchestra.run.smithi032.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-17T00:42:42.651 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/033 2024-02-17T00:42:42.651 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/033 2024-02-17T00:42:42.651 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:42.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:42.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:42.672 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-02-17T00:42:42.925 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:42.930 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:42.930 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:42.931 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:42.931 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:43.212 INFO:teuthology.orchestra.run.smithi032.stdout:generic/034 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:42:43.216 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/034 2024-02-17T00:42:43.216 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/034 2024-02-17T00:42:43.216 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:43.219 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:43.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:43.233 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-02-17T00:42:43.476 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:43.481 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:43.481 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:43.483 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:43.483 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:43.827 INFO:teuthology.orchestra.run.smithi032.stdout:generic/035 0s 2024-02-17T00:42:43.834 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/035 2024-02-17T00:42:43.834 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:43.838 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:43.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:43.869 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-02-17T00:42:44.173 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:44.177 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:44.178 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:44.179 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:54.549 INFO:teuthology.orchestra.run.smithi032.stdout:generic/036 10s 2024-02-17T00:42:54.556 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/036 2024-02-17T00:42:54.556 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:54.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:54.595 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-02-17T00:42:54.916 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:54.922 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:54.922 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:54.923 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:54.923 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:59.691 INFO:teuthology.orchestra.run.smithi032.stdout:generic/037 4s 2024-02-17T00:42:59.699 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/037 2024-02-17T00:42:59.699 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:42:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:42:59.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:42:59.717 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-02-17T00:42:59.970 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:42:59.975 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:42:59.976 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:42:59.977 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:42:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:00.263 INFO:teuthology.orchestra.run.smithi032.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:43:00.268 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/038 2024-02-17T00:43:00.268 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/038 2024-02-17T00:43:00.268 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:00.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:00.292 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-02-17T00:43:00.540 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:00.544 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:00.545 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:00.545 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:00.546 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:00.832 INFO:teuthology.orchestra.run.smithi032.stdout:generic/039 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:00.837 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/039 2024-02-17T00:43:00.837 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/039 2024-02-17T00:43:00.838 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:00.840 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:00.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:00.864 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-02-17T00:43:01.123 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:01.128 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:01.128 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:01.129 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:01.414 INFO:teuthology.orchestra.run.smithi032.stdout:generic/040 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:01.419 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/040 2024-02-17T00:43:01.420 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/040 2024-02-17T00:43:01.420 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:01.422 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:01.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:01.445 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-02-17T00:43:01.704 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:01.708 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:01.709 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:01.710 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:01.991 INFO:teuthology.orchestra.run.smithi032.stdout:generic/041 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:01.997 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/041 2024-02-17T00:43:01.997 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/041 2024-02-17T00:43:01.997 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:02.000 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:02.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:02.018 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-02-17T00:43:02.255 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:02.260 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:02.261 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:02.262 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:02.262 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:02.613 INFO:teuthology.orchestra.run.smithi032.stdout:generic/042 [not run] ceph does not support shutdown 2024-02-17T00:43:02.622 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/042 2024-02-17T00:43:02.622 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/042 2024-02-17T00:43:02.622 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:02.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:02.639 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-02-17T00:43:02.877 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:02.882 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:02.882 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:02.884 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:02.884 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:03.243 INFO:teuthology.orchestra.run.smithi032.stdout:generic/043 [not run] ceph does not support shutdown 2024-02-17T00:43:03.251 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/043 2024-02-17T00:43:03.251 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/043 2024-02-17T00:43:03.251 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:03.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:03.269 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-02-17T00:43:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:03.515 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:03.864 INFO:teuthology.orchestra.run.smithi032.stdout:generic/044 [not run] ceph does not support shutdown 2024-02-17T00:43:03.871 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/044 2024-02-17T00:43:03.871 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/044 2024-02-17T00:43:03.872 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:03.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:03.888 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-02-17T00:43:04.135 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:04.140 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:04.141 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:04.142 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:04.501 INFO:teuthology.orchestra.run.smithi032.stdout:generic/045 [not run] ceph does not support shutdown 2024-02-17T00:43:04.509 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/045 2024-02-17T00:43:04.509 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/045 2024-02-17T00:43:04.509 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:04.512 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:04.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:04.530 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-02-17T00:43:04.776 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:04.782 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:04.783 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:04.784 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:05.135 INFO:teuthology.orchestra.run.smithi032.stdout:generic/046 [not run] ceph does not support shutdown 2024-02-17T00:43:05.143 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/046 2024-02-17T00:43:05.143 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/046 2024-02-17T00:43:05.143 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:05.146 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:05.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:05.161 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-02-17T00:43:05.429 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:05.434 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:05.434 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:05.436 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:05.830 INFO:teuthology.orchestra.run.smithi032.stdout:generic/047 [not run] ceph does not support shutdown 2024-02-17T00:43:05.846 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/047 2024-02-17T00:43:05.846 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/047 2024-02-17T00:43:05.846 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:05.849 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:05.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:05.867 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-02-17T00:43:06.136 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:06.141 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:06.142 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:06.143 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:06.143 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:06.538 INFO:teuthology.orchestra.run.smithi032.stdout:generic/048 [not run] ceph does not support shutdown 2024-02-17T00:43:06.555 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/048 2024-02-17T00:43:06.555 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/048 2024-02-17T00:43:06.555 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:06.558 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:06.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:06.574 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-02-17T00:43:06.858 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:06.865 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:06.866 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:06.867 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:06.867 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:07.248 INFO:teuthology.orchestra.run.smithi032.stdout:generic/049 [not run] ceph does not support shutdown 2024-02-17T00:43:07.268 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/049 2024-02-17T00:43:07.268 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/049 2024-02-17T00:43:07.268 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:07.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:07.289 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-02-17T00:43:07.534 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:07.539 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:07.539 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:07.540 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:07.541 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:07.888 INFO:teuthology.orchestra.run.smithi032.stdout:generic/050 [not run] ceph does not support shutdown 2024-02-17T00:43:07.898 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/050 2024-02-17T00:43:07.898 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/050 2024-02-17T00:43:07.898 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:07.902 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:07.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:07.915 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-02-17T00:43:08.158 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:08.163 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:08.163 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:08.164 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:08.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:08.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:43:08.182 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:43:08.505 INFO:teuthology.orchestra.run.smithi032.stdout:generic/051 [not run] ceph does not support shutdown 2024-02-17T00:43:08.511 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/051 2024-02-17T00:43:08.511 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/051 2024-02-17T00:43:08.511 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:08.514 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:08.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:08.532 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-02-17T00:43:08.772 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:08.777 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:08.777 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:08.778 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:08.779 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:09.139 INFO:teuthology.orchestra.run.smithi032.stdout:generic/052 [not run] ceph does not support shutdown 2024-02-17T00:43:09.157 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/052 2024-02-17T00:43:09.157 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/052 2024-02-17T00:43:09.157 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:09.160 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:09.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:09.173 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-02-17T00:43:09.436 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:09.442 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:09.443 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:09.444 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:10.059 INFO:teuthology.orchestra.run.smithi032.stdout:generic/053 1s 2024-02-17T00:43:10.085 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/053 2024-02-17T00:43:10.085 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:10.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:10.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:10.105 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-02-17T00:43:10.384 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:10.389 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:10.389 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:10.390 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:10.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:10.785 INFO:teuthology.orchestra.run.smithi032.stdout:generic/054 [not run] ceph does not support shutdown 2024-02-17T00:43:10.796 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/054 2024-02-17T00:43:10.796 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/054 2024-02-17T00:43:10.796 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:10.800 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:10.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:10.813 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-02-17T00:43:11.055 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:11.059 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:11.060 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:11.061 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:11.429 INFO:teuthology.orchestra.run.smithi032.stdout:generic/055 [not run] ceph does not support shutdown 2024-02-17T00:43:11.443 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/055 2024-02-17T00:43:11.443 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/055 2024-02-17T00:43:11.443 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:11.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:11.462 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-02-17T00:43:11.705 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:11.711 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:11.712 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:11.713 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:11.713 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:12.007 INFO:teuthology.orchestra.run.smithi032.stdout:generic/056 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:12.011 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/056 2024-02-17T00:43:12.011 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/056 2024-02-17T00:43:12.011 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:12.013 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:12.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:12.029 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-02-17T00:43:12.272 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:12.277 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:12.277 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:12.278 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:12.577 INFO:teuthology.orchestra.run.smithi032.stdout:generic/057 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:12.582 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/057 2024-02-17T00:43:12.582 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/057 2024-02-17T00:43:12.582 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:12.584 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:12.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:12.604 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-02-17T00:43:12.850 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:12.855 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:12.855 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:12.857 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:12.857 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:13.232 INFO:teuthology.orchestra.run.smithi032.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:43:13.238 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/058 2024-02-17T00:43:13.238 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/058 2024-02-17T00:43:13.238 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:13.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:13.278 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-02-17T00:43:13.570 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:13.574 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:13.575 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:13.576 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:13.856 INFO:teuthology.orchestra.run.smithi032.stdout:generic/059 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:13.863 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/059 2024-02-17T00:43:13.863 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/059 2024-02-17T00:43:13.863 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:13.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:13.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:13.877 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-02-17T00:43:14.129 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:14.134 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:14.135 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:14.136 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:14.516 INFO:teuthology.orchestra.run.smithi032.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:43:14.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/060 2024-02-17T00:43:14.522 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/060 2024-02-17T00:43:14.522 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:14.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:14.561 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-02-17T00:43:14.875 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:14.880 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:14.881 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:14.882 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:15.254 INFO:teuthology.orchestra.run.smithi032.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:43:15.261 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/061 2024-02-17T00:43:15.262 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/061 2024-02-17T00:43:15.262 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:15.264 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:15.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:15.297 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-02-17T00:43:15.601 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:15.605 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:15.606 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:15.607 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:17.258 INFO:teuthology.orchestra.run.smithi032.stdout:generic/062 2s 2024-02-17T00:43:17.268 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/062 2024-02-17T00:43:17.268 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:17.270 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:17.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:17.282 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-02-17T00:43:17.624 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:17.629 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:17.630 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:17.631 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:18.084 INFO:teuthology.orchestra.run.smithi032.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:43:18.089 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/063 2024-02-17T00:43:18.089 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/063 2024-02-17T00:43:18.089 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:18.093 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:18.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:18.136 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-02-17T00:43:18.442 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:18.446 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:18.446 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:18.447 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:18.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:18.743 INFO:teuthology.orchestra.run.smithi032.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T00:43:18.748 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/064 2024-02-17T00:43:18.748 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/064 2024-02-17T00:43:18.748 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:18.751 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:18.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:18.771 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-02-17T00:43:19.008 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:19.013 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:19.013 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:19.015 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:19.299 INFO:teuthology.orchestra.run.smithi032.stdout:generic/065 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:19.304 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/065 2024-02-17T00:43:19.304 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/065 2024-02-17T00:43:19.304 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:19.307 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:19.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:19.324 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-02-17T00:43:19.572 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:19.577 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:19.577 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:19.578 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:19.579 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:19.857 INFO:teuthology.orchestra.run.smithi032.stdout:generic/066 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:19.862 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/066 2024-02-17T00:43:19.862 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/066 2024-02-17T00:43:19.862 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:19.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:19.878 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-02-17T00:43:20.126 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:20.130 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:20.131 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:20.132 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:20.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:20.438 INFO:teuthology.orchestra.run.smithi032.stdout:generic/067 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:20.444 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/067 2024-02-17T00:43:20.444 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/067 2024-02-17T00:43:20.444 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:20.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:20.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:20.470 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-02-17T00:43:20.723 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:20.728 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:20.729 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:20.730 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:20.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:21.027 INFO:teuthology.orchestra.run.smithi032.stdout:generic/068 [not run] ceph does not support freezing 2024-02-17T00:43:21.032 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/068 2024-02-17T00:43:21.032 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/068 2024-02-17T00:43:21.032 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:21.035 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:21.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:21.048 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-02-17T00:43:21.295 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:21.300 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:21.301 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:21.303 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:21.303 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:28.229 INFO:teuthology.orchestra.run.smithi032.stdout:generic/069 7s 2024-02-17T00:43:28.237 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/069 2024-02-17T00:43:28.237 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:28.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:28.256 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-02-17T00:43:28.541 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:28.547 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:28.547 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:28.549 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:28.549 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:38.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:43:38.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:43:54.566 INFO:teuthology.orchestra.run.smithi032.stdout:generic/070 26s 2024-02-17T00:43:54.573 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/070 2024-02-17T00:43:54.574 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:54.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:54.703 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-02-17T00:43:55.018 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:55.022 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:55.023 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:55.024 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:55.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:55.319 INFO:teuthology.orchestra.run.smithi032.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T00:43:55.326 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/071 2024-02-17T00:43:55.327 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/071 2024-02-17T00:43:55.327 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:55.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:55.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:55.348 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-02-17T00:43:55.602 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:55.607 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:55.608 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:55.609 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:55.609 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:55.957 INFO:teuthology.orchestra.run.smithi032.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-17T00:43:55.962 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/072 2024-02-17T00:43:55.962 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/072 2024-02-17T00:43:55.962 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:55.965 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:55.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:55.985 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-02-17T00:43:56.232 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:56.236 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:56.237 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:56.238 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:56.238 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:56.517 INFO:teuthology.orchestra.run.smithi032.stdout:generic/073 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:43:56.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/073 2024-02-17T00:43:56.521 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/073 2024-02-17T00:43:56.521 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:43:56.525 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:43:56.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:43:56.539 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-02-17T00:43:56.782 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:43:56.787 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:43:56.787 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:43:56.788 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:43:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:08.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:44:08.867 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:44:11.692 INFO:teuthology.orchestra.run.smithi032.stdout:generic/074 15s 2024-02-17T00:44:11.697 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/074 2024-02-17T00:44:11.698 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:11.700 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:12.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:12.604 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-02-17T00:44:12.939 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:12.944 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:12.945 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:12.946 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:32.305 INFO:teuthology.orchestra.run.smithi032.stdout:generic/075 19s 2024-02-17T00:44:32.312 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/075 2024-02-17T00:44:32.312 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:32.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:32.376 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-02-17T00:44:32.733 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:32.737 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:32.738 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:32.739 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:32.739 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:32.997 INFO:teuthology.orchestra.run.smithi032.stdout:generic/076 [not run] require 172.21.15.32:6789:/scratch to be local device 2024-02-17T00:44:33.002 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/076 2024-02-17T00:44:33.002 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/076 2024-02-17T00:44:33.002 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:33.005 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:33.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:33.019 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-02-17T00:44:33.267 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:33.271 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:33.272 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:33.273 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:33.273 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:34.417 INFO:teuthology.orchestra.run.smithi032.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T00:44:34.423 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/077 2024-02-17T00:44:34.423 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/077 2024-02-17T00:44:34.424 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:34.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:34.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:34.465 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-02-17T00:44:34.824 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:34.829 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:34.829 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:34.831 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:34.831 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:35.122 INFO:teuthology.orchestra.run.smithi032.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-02-17T00:44:35.126 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/078 2024-02-17T00:44:35.127 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/078 2024-02-17T00:44:35.127 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:35.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:35.165 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-02-17T00:44:35.517 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:35.522 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:35.522 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:35.524 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:35.820 INFO:teuthology.orchestra.run.smithi032.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-02-17T00:44:35.825 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/079 2024-02-17T00:44:35.825 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/079 2024-02-17T00:44:35.825 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:35.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:35.850 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-02-17T00:44:36.106 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:36.110 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:36.111 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:36.112 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:38.451 INFO:teuthology.orchestra.run.smithi032.stdout:generic/080 2s 2024-02-17T00:44:38.457 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/080 2024-02-17T00:44:38.457 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:38.461 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:38.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:38.489 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-02-17T00:44:38.741 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:38.746 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:38.747 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:38.748 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:38.748 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:39.061 INFO:teuthology.orchestra.run.smithi032.stdout:generic/081 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:44:39.065 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/081 2024-02-17T00:44:39.065 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/081 2024-02-17T00:44:39.066 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:39.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:39.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:39.090 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-02-17T00:44:39.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:44:39.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:44:39.352 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:39.357 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:39.357 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:39.359 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:39.359 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:39.667 INFO:teuthology.orchestra.run.smithi032.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T00:44:39.673 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/082 2024-02-17T00:44:39.674 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/082 2024-02-17T00:44:39.674 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:39.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:39.698 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-02-17T00:44:39.978 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:39.983 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:39.985 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:39.986 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:40.287 INFO:teuthology.orchestra.run.smithi032.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T00:44:40.292 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/083 2024-02-17T00:44:40.292 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/083 2024-02-17T00:44:40.293 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:40.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:40.313 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-02-17T00:44:40.583 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:40.588 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:40.588 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:40.590 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:40.590 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:46.225 INFO:teuthology.orchestra.run.smithi032.stdout:generic/084 6s 2024-02-17T00:44:46.303 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/084 2024-02-17T00:44:46.303 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:46.305 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:46.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:46.318 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-02-17T00:44:46.555 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:46.559 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:46.559 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:46.560 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:46.560 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:46.837 INFO:teuthology.orchestra.run.smithi032.stdout:generic/085 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:44:46.841 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/085 2024-02-17T00:44:46.841 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/085 2024-02-17T00:44:46.841 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:46.844 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:46.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:46.861 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-02-17T00:44:47.111 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:47.114 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:47.115 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:47.116 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:47.116 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:47.405 INFO:teuthology.orchestra.run.smithi032.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:44:47.410 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/086 2024-02-17T00:44:47.410 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/086 2024-02-17T00:44:47.410 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:47.413 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:47.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:47.429 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-02-17T00:44:47.677 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:47.683 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:47.684 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:47.685 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:47.685 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:48.083 INFO:teuthology.orchestra.run.smithi032.stdout:generic/087 1s 2024-02-17T00:44:48.192 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/087 2024-02-17T00:44:48.192 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:48.196 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:48.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:48.249 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-02-17T00:44:48.624 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:48.629 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:48.629 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:48.630 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:48.630 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:48.968 INFO:teuthology.orchestra.run.smithi032.stdout:generic/088 0s 2024-02-17T00:44:49.016 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/088 2024-02-17T00:44:49.016 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:44:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:44:49.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:44:49.058 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-02-17T00:44:49.401 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:44:49.406 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:44:49.407 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:44:49.408 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:44:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:45:09.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:45:09.275 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:45:39.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:45:39.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:45:39.394 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T00:45:39.394+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45944) UID: 0 2024-02-17T00:45:39.394 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T00:45:39.394+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45944) UID: 0 2024-02-17T00:48:58.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:48:58.856 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:49:33.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:49:33.949 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:50:03.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:50:04.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:50:04.061 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T00:50:04.060+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46004) UID: 0 2024-02-17T00:50:04.061 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T00:50:04.060+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46004) UID: 0 2024-02-17T00:52:55.291 INFO:teuthology.orchestra.run.smithi032.stdout:generic/089 486s 2024-02-17T00:52:55.296 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/089 2024-02-17T00:52:55.296 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:52:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:52:56.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:52:56.161 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-02-17T00:52:56.416 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:52:56.420 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:52:56.420 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:52:56.421 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:52:56.421 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:52:56.643 INFO:teuthology.orchestra.run.smithi032.stdout:generic/090 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:52:56.646 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/090 2024-02-17T00:52:56.646 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/090 2024-02-17T00:52:56.646 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:52:56.648 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:52:56.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:52:56.662 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-02-17T00:52:56.843 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:52:56.847 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:52:56.847 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:52:56.848 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:52:56.849 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:53:13.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:53:13.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:53:43.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:53:43.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:54:13.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:54:13.199 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:54:13.449 INFO:teuthology.orchestra.run.smithi032.stdout:generic/091 77s 2024-02-17T00:54:13.454 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/091 2024-02-17T00:54:13.454 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:13.456 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:13.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:13.499 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-02-17T00:54:13.898 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:13.901 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:13.902 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:13.903 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:13.903 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/092 2024-02-17T00:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/092 2024-02-17T00:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:14.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:14.134 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-02-17T00:54:14.314 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:14.318 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:14.318 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:14.319 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:14.781 INFO:teuthology.orchestra.run.smithi032.stdout:generic/093 0s 2024-02-17T00:54:14.786 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/093 2024-02-17T00:54:14.786 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:14.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:14.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:14.837 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-02-17T00:54:15.244 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:15.248 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:15.248 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:15.249 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:15.249 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:15.499 INFO:teuthology.orchestra.run.smithi032.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T00:54:15.503 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/094 2024-02-17T00:54:15.503 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/094 2024-02-17T00:54:15.503 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:15.505 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:15.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:15.554 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-02-17T00:54:15.915 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:15.919 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:15.919 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:15.920 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:15.920 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:26.565 INFO:teuthology.orchestra.run.smithi032.stdout:generic/095 10s 2024-02-17T00:54:26.573 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/095 2024-02-17T00:54:26.573 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:26.575 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:26.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:26.587 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-02-17T00:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:27.163 INFO:teuthology.orchestra.run.smithi032.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-17T00:54:27.167 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/096 2024-02-17T00:54:27.167 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/096 2024-02-17T00:54:27.167 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:27.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:27.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:27.183 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-02-17T00:54:27.353 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:27.357 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:27.357 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:27.358 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:27.914 INFO:teuthology.orchestra.run.smithi032.stdout:generic/097 0s 2024-02-17T00:54:27.926 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/097 2024-02-17T00:54:27.926 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:27.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:27.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:27.954 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-02-17T00:54:28.169 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:28.173 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:28.173 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:28.174 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:28.174 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:31.032 INFO:teuthology.orchestra.run.smithi032.stdout:generic/098 3s 2024-02-17T00:54:31.037 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/098 2024-02-17T00:54:31.037 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:31.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:31.048 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-02-17T00:54:31.222 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:31.226 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:31.226 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:31.227 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:31.932 INFO:teuthology.orchestra.run.smithi032.stdout:generic/099 0s 2024-02-17T00:54:31.937 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/099 2024-02-17T00:54:31.937 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:31.939 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:31.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:31.998 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-02-17T00:54:32.384 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:32.387 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:32.388 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:32.389 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:32.389 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:42.626 INFO:teuthology.orchestra.run.smithi032.stdout:generic/100 10s 2024-02-17T00:54:42.631 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/100 2024-02-17T00:54:42.631 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:42.633 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:43.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:54:43.257 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:54:45.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:45.633 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-02-17T00:54:45.970 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:45.974 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:45.974 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:45.975 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:46.192 INFO:teuthology.orchestra.run.smithi032.stdout:generic/101 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:54:46.195 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/101 2024-02-17T00:54:46.196 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/101 2024-02-17T00:54:46.196 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:46.198 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:46.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:46.209 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-02-17T00:54:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:46.398 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:46.398 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:46.399 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:46.598 INFO:teuthology.orchestra.run.smithi032.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T00:54:46.602 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/102 2024-02-17T00:54:46.602 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/102 2024-02-17T00:54:46.602 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:46.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:46.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:46.615 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-02-17T00:54:46.801 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:46.804 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:46.805 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:46.806 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:46.806 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:47.031 INFO:teuthology.orchestra.run.smithi032.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T00:54:47.035 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/103 2024-02-17T00:54:47.035 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/103 2024-02-17T00:54:47.035 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:47.037 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:47.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:47.077 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-02-17T00:54:47.437 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:47.444 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:47.444 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:47.444 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:47.444 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:47.679 INFO:teuthology.orchestra.run.smithi032.stdout:generic/104 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:54:47.683 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/104 2024-02-17T00:54:47.683 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/104 2024-02-17T00:54:47.683 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:47.685 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:47.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:47.700 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-02-17T00:54:47.868 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:47.872 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:47.872 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:47.873 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:47.873 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:48.279 INFO:teuthology.orchestra.run.smithi032.stdout:generic/105 1s 2024-02-17T00:54:48.286 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/105 2024-02-17T00:54:48.286 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:48.290 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:48.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:48.301 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-02-17T00:54:48.645 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:48.649 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:48.649 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:48.650 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:48.882 INFO:teuthology.orchestra.run.smithi032.stdout:generic/106 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:54:48.885 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/106 2024-02-17T00:54:48.885 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/106 2024-02-17T00:54:48.886 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:48.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:48.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:48.903 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-02-17T00:54:49.082 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:49.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:49.321 INFO:teuthology.orchestra.run.smithi032.stdout:generic/107 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:54:49.324 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/107 2024-02-17T00:54:49.324 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/107 2024-02-17T00:54:49.324 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:49.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:49.341 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-02-17T00:54:49.516 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:49.520 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:49.520 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:49.521 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:49.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:49.822 INFO:teuthology.orchestra.run.smithi032.stdout:generic/108 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T00:54:49.826 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/108 2024-02-17T00:54:49.826 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/108 2024-02-17T00:54:49.826 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:49.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:49.841 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-02-17T00:54:50.018 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:57.759 INFO:teuthology.orchestra.run.smithi032.stdout:generic/109 7s 2024-02-17T00:54:57.766 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/109 2024-02-17T00:54:57.766 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:54:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:54:57.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:54:57.782 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-02-17T00:54:58.583 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:54:58.586 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:54:58.587 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:54:58.588 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:54:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:13.646 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:55:13.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:55:13.678 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T00:55:13.678+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46105) UID: 0 2024-02-17T00:55:13.679 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T00:55:13.678+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46105) UID: 0 2024-02-17T00:55:16.149 INFO:teuthology.orchestra.run.smithi032.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T00:55:16.154 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/110 2024-02-17T00:55:16.154 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/110 2024-02-17T00:55:16.154 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:16.160 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:16.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:16.293 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-02-17T00:55:16.718 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:16.725 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:16.726 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:16.729 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:16.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:17.171 INFO:teuthology.orchestra.run.smithi032.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T00:55:17.174 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/111 2024-02-17T00:55:17.174 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/111 2024-02-17T00:55:17.175 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:17.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:17.221 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-02-17T00:55:17.619 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:17.622 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:17.623 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:17.624 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:33.059 INFO:teuthology.orchestra.run.smithi032.stdout:generic/112 16s 2024-02-17T00:55:33.064 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/112 2024-02-17T00:55:33.064 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:33.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:33.137 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-02-17T00:55:33.527 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:33.531 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:33.531 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:33.532 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:33.532 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:49.901 INFO:teuthology.orchestra.run.smithi032.stdout:generic/113 16s 2024-02-17T00:55:49.905 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/113 2024-02-17T00:55:49.905 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:49.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:49.961 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-02-17T00:55:50.349 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:50.357 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:50.358 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:50.359 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:50.580 INFO:teuthology.orchestra.run.smithi032.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-02-17T00:55:50.584 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/114 2024-02-17T00:55:50.584 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/114 2024-02-17T00:55:50.584 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:50.586 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:50.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:50.607 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-02-17T00:55:50.776 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:50.779 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:50.779 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:50.780 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:50.781 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:51.005 INFO:teuthology.orchestra.run.smithi032.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T00:55:51.009 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/115 2024-02-17T00:55:51.009 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/115 2024-02-17T00:55:51.009 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:51.011 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:51.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:51.060 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-02-17T00:55:51.422 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:51.426 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:51.427 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:51.428 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:51.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:51.660 INFO:teuthology.orchestra.run.smithi032.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T00:55:51.664 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/116 2024-02-17T00:55:51.664 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/116 2024-02-17T00:55:51.664 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:55:51.666 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:55:51.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:55:51.720 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-02-17T00:55:52.130 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:55:52.134 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:55:52.134 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:55:52.135 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:55:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:05.437 INFO:teuthology.orchestra.run.smithi032.stdout:generic/117 13s 2024-02-17T00:56:05.448 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/117 2024-02-17T00:56:05.449 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:05.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:05.466 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-02-17T00:56:05.674 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:05.678 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:05.678 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:05.679 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:06.309 INFO:teuthology.orchestra.run.smithi032.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T00:56:06.312 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/118 2024-02-17T00:56:06.312 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/118 2024-02-17T00:56:06.313 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:06.315 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:06.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:06.360 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-02-17T00:56:06.748 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:06.752 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:06.752 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:06.753 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:06.981 INFO:teuthology.orchestra.run.smithi032.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T00:56:06.985 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/119 2024-02-17T00:56:06.985 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/119 2024-02-17T00:56:06.985 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:06.987 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:07.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:07.038 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-02-17T00:56:07.462 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:07.468 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:07.468 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:07.471 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:07.471 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:07.695 INFO:teuthology.orchestra.run.smithi032.stdout:generic/120 [not run] atime not maintained by ceph 2024-02-17T00:56:07.699 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/120 2024-02-17T00:56:07.699 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/120 2024-02-17T00:56:07.699 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:07.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:07.712 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-02-17T00:56:07.884 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:07.888 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:07.888 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:07.889 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:07.889 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:08.109 INFO:teuthology.orchestra.run.smithi032.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T00:56:08.113 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/121 2024-02-17T00:56:08.113 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/121 2024-02-17T00:56:08.113 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:08.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:08.181 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-02-17T00:56:08.575 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:08.579 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:08.579 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:08.580 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:08.808 INFO:teuthology.orchestra.run.smithi032.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T00:56:08.812 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/122 2024-02-17T00:56:08.812 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/122 2024-02-17T00:56:08.812 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:08.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:08.870 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-02-17T00:56:09.284 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:09.287 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:09.288 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:09.289 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:09.773 INFO:teuthology.orchestra.run.smithi032.stdout:generic/123 0s 2024-02-17T00:56:09.778 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/123 2024-02-17T00:56:09.778 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:09.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:09.837 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-02-17T00:56:10.233 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:10.237 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:10.238 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:10.239 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:10.239 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:12.094 INFO:teuthology.orchestra.run.smithi032.stdout:generic/124 2s 2024-02-17T00:56:12.102 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/124 2024-02-17T00:56:12.102 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:56:12.105 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:56:12.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:56:12.702 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-02-17T00:56:13.147 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:56:13.158 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:56:13.158 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:56:13.159 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:56:13.159 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:57:14.547 INFO:teuthology.orchestra.run.smithi032.stdout:generic/125 61s 2024-02-17T00:57:14.552 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/125 2024-02-17T00:57:14.553 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:57:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:57:14.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:57:14.594 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-02-17T00:57:15.002 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:57:15.006 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:57:15.006 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:57:15.007 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:57:15.007 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:57:15.366 INFO:teuthology.orchestra.run.smithi032.stdout:generic/126 0s 2024-02-17T00:57:15.371 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/126 2024-02-17T00:57:15.371 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T00:57:15.373 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:57:15.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T00:57:15.446 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-02-17T00:57:15.836 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T00:57:15.840 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T00:57:15.840 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T00:57:15.841 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T00:57:15.841 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T00:58:00.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:58:00.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:58:30.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:58:30.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:59:01.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:59:01.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:59:31.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T00:59:31.088 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:00:01.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:00:01.144 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:00:31.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:00:31.201 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:01:01.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:01:01.562 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:01:31.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:01:31.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:02:02.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:02:02.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:02:33.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:02:33.085 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:03:03.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:03:03.349 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:03:33.437 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:03:33.439 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:04:03.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:04:03.555 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:04:33.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:04:33.618 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:05:03.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:05:03.924 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:05:33.995 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:05:33.998 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:05:58.693 INFO:teuthology.orchestra.run.smithi032.stdout:generic/127 523s 2024-02-17T01:05:58.731 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/127 2024-02-17T01:05:58.731 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:05:58.733 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:05:58.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:05:58.784 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-02-17T01:05:59.446 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:05:59.450 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:05:59.450 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:05:59.451 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:05:59.451 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:00.710 INFO:teuthology.orchestra.run.smithi032.stdout:generic/128 1s 2024-02-17T01:06:00.715 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/128 2024-02-17T01:06:00.715 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:06:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:00.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:06:00.726 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-02-17T01:06:00.904 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:06:00.907 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:06:00.908 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:06:00.909 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:06:00.909 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:01.138 INFO:teuthology.orchestra.run.smithi032.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-02-17T01:06:01.141 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/129 2024-02-17T01:06:01.142 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/129 2024-02-17T01:06:01.142 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:06:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:01.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:06:01.168 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-02-17T01:06:01.345 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:06:01.348 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:06:01.348 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:06:01.349 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:06:01.349 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:01.566 INFO:teuthology.orchestra.run.smithi032.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-02-17T01:06:01.569 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/130 2024-02-17T01:06:01.570 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/130 2024-02-17T01:06:01.570 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:06:01.572 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:01.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:06:01.596 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-02-17T01:06:01.784 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:06:01.788 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:06:01.788 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:06:01.789 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:06:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:generic/131 2s 2024-02-17T01:06:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/131 2024-02-17T01:06:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:06:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:03.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:06:03.189 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-02-17T01:06:03.643 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:06:03.646 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:06:03.647 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:06:03.648 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:06:03.648 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:04.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:06:04.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:06:16.189 INFO:teuthology.orchestra.run.smithi032.stdout:generic/132 13s 2024-02-17T01:06:16.194 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/132 2024-02-17T01:06:16.195 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:06:16.197 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:16.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:06:16.205 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-02-17T01:06:16.387 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:06:16.390 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:06:16.391 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:06:16.392 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:06:16.392 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:06:34.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:06:34.129 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:07:04.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:07:04.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:07:34.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:07:34.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:08:04.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:08:04.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:08:34.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:08:34.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:09:04.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:09:04.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:09:27.115 INFO:teuthology.orchestra.run.smithi032.stdout:generic/133 191s 2024-02-17T01:09:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/133 2024-02-17T01:09:27.120 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:27.122 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:27.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:27.172 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-02-17T01:09:27.653 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:27.658 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:27.658 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:27.965 INFO:teuthology.orchestra.run.smithi032.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:27.969 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/134 2024-02-17T01:09:27.970 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/134 2024-02-17T01:09:27.970 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:27.971 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:28.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:28.035 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-02-17T01:09:28.443 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:28.447 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:28.447 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:28.448 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:28.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:29.334 INFO:teuthology.orchestra.run.smithi032.stdout:generic/135 1s 2024-02-17T01:09:29.356 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/135 2024-02-17T01:09:29.356 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:29.358 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:29.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:29.367 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-02-17T01:09:29.543 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:29.546 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:29.547 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:29.547 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:29.548 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:29.929 INFO:teuthology.orchestra.run.smithi032.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T01:09:29.933 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/136 2024-02-17T01:09:29.933 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/136 2024-02-17T01:09:29.933 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:29.935 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:30.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:30.003 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-02-17T01:09:30.428 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:30.431 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:30.432 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:30.433 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:30.433 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:30.710 INFO:teuthology.orchestra.run.smithi032.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:30.713 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/137 2024-02-17T01:09:30.714 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/137 2024-02-17T01:09:30.714 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:30.716 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:30.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:30.764 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-02-17T01:09:31.150 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:31.154 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:31.154 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:31.155 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:31.155 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:31.606 INFO:teuthology.orchestra.run.smithi032.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:31.609 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/138 2024-02-17T01:09:31.609 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/138 2024-02-17T01:09:31.609 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:31.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:31.670 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-02-17T01:09:32.101 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:32.104 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:32.104 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:32.105 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:32.105 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:32.343 INFO:teuthology.orchestra.run.smithi032.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:32.347 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/139 2024-02-17T01:09:32.347 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/139 2024-02-17T01:09:32.347 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:32.349 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:32.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:32.401 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-02-17T01:09:32.801 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:32.805 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:32.805 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:32.806 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:32.806 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:33.046 INFO:teuthology.orchestra.run.smithi032.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:33.049 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/140 2024-02-17T01:09:33.049 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/140 2024-02-17T01:09:33.050 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:33.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:33.110 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-02-17T01:09:33.476 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:33.484 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:33.484 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:33.485 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:33.486 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:33.825 INFO:teuthology.orchestra.run.smithi032.stdout:generic/141 0s 2024-02-17T01:09:33.830 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/141 2024-02-17T01:09:33.830 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:33.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:33.840 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-02-17T01:09:34.030 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:34.033 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:34.034 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:34.035 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:34.035 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:34.271 INFO:teuthology.orchestra.run.smithi032.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:34.275 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/142 2024-02-17T01:09:34.275 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/142 2024-02-17T01:09:34.275 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:34.277 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:34.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:34.330 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-02-17T01:09:34.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:09:34.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:09:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:34.786 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:34.787 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:34.788 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:34.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/143 2024-02-17T01:09:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/143 2024-02-17T01:09:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:35.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:35.080 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-02-17T01:09:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:35.484 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:35.732 INFO:teuthology.orchestra.run.smithi032.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:35.736 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/144 2024-02-17T01:09:35.736 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/144 2024-02-17T01:09:35.736 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:35.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:35.788 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-02-17T01:09:36.188 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:36.193 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:36.193 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:36.195 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:36.431 INFO:teuthology.orchestra.run.smithi032.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:36.435 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/145 2024-02-17T01:09:36.435 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/145 2024-02-17T01:09:36.435 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:36.437 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:36.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:36.489 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-02-17T01:09:36.910 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:36.914 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:36.914 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:36.915 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:36.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:37.157 INFO:teuthology.orchestra.run.smithi032.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:37.161 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/146 2024-02-17T01:09:37.161 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/146 2024-02-17T01:09:37.161 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:37.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:37.223 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-02-17T01:09:37.624 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:37.627 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:37.628 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:37.629 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:37.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:37.870 INFO:teuthology.orchestra.run.smithi032.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:37.874 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/147 2024-02-17T01:09:37.874 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/147 2024-02-17T01:09:37.874 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:37.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:37.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:37.935 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-02-17T01:09:38.327 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:38.331 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:38.332 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:38.333 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:38.333 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:38.571 INFO:teuthology.orchestra.run.smithi032.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:38.575 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/148 2024-02-17T01:09:38.575 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/148 2024-02-17T01:09:38.575 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:38.577 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:38.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:38.638 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-02-17T01:09:39.024 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:39.029 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:39.029 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:39.030 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:39.270 INFO:teuthology.orchestra.run.smithi032.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:39.274 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/149 2024-02-17T01:09:39.274 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/149 2024-02-17T01:09:39.275 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:39.277 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:39.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:39.328 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-02-17T01:09:39.756 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:39.760 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:39.760 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:39.761 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:39.995 INFO:teuthology.orchestra.run.smithi032.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:39.999 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/150 2024-02-17T01:09:39.999 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/150 2024-02-17T01:09:39.999 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:40.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:40.062 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-02-17T01:09:40.474 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:40.477 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:40.477 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:40.478 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:40.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:40.730 INFO:teuthology.orchestra.run.smithi032.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:40.733 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/151 2024-02-17T01:09:40.734 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/151 2024-02-17T01:09:40.734 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:40.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:40.788 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-02-17T01:09:41.180 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:41.185 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:41.185 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:41.186 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:41.187 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:41.423 INFO:teuthology.orchestra.run.smithi032.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:41.427 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/152 2024-02-17T01:09:41.427 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/152 2024-02-17T01:09:41.427 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:41.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:41.480 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-02-17T01:09:41.890 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:41.894 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:41.894 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:41.895 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:41.896 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:42.129 INFO:teuthology.orchestra.run.smithi032.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:42.132 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/153 2024-02-17T01:09:42.133 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/153 2024-02-17T01:09:42.133 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:42.135 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:42.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:42.183 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-02-17T01:09:42.567 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:42.571 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:42.572 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:42.573 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:42.573 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:42.807 INFO:teuthology.orchestra.run.smithi032.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:42.811 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/154 2024-02-17T01:09:42.811 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/154 2024-02-17T01:09:42.811 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:42.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:42.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:42.872 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-02-17T01:09:43.239 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:43.243 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:43.244 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:43.245 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:43.245 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:43.495 INFO:teuthology.orchestra.run.smithi032.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:43.498 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/155 2024-02-17T01:09:43.498 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/155 2024-02-17T01:09:43.499 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:43.501 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:43.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:43.553 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-02-17T01:09:43.952 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:43.956 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:43.956 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:43.957 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:43.957 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:44.202 INFO:teuthology.orchestra.run.smithi032.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:44.206 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/156 2024-02-17T01:09:44.206 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/156 2024-02-17T01:09:44.206 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:44.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:44.257 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-02-17T01:09:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:44.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:44.911 INFO:teuthology.orchestra.run.smithi032.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:09:44.915 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/157 2024-02-17T01:09:44.915 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/157 2024-02-17T01:09:44.915 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:44.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:44.985 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-02-17T01:09:45.393 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:45.397 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:45.397 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:45.398 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:45.398 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:45.632 INFO:teuthology.orchestra.run.smithi032.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T01:09:45.636 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/158 2024-02-17T01:09:45.636 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/158 2024-02-17T01:09:45.636 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:45.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:45.681 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-02-17T01:09:46.072 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:46.077 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:46.078 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:46.079 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:46.079 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:46.314 INFO:teuthology.orchestra.run.smithi032.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-02-17T01:09:46.318 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/159 2024-02-17T01:09:46.318 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/159 2024-02-17T01:09:46.318 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:46.320 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:46.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:46.339 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-02-17T01:09:46.518 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:46.521 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:46.522 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:46.523 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:46.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:46.758 INFO:teuthology.orchestra.run.smithi032.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-02-17T01:09:46.762 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/160 2024-02-17T01:09:46.762 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/160 2024-02-17T01:09:46.762 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:46.764 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:46.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:46.782 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-02-17T01:09:46.962 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:46.965 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:46.966 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:46.966 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:47.309 INFO:teuthology.orchestra.run.smithi032.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:47.315 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/161 2024-02-17T01:09:47.315 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/161 2024-02-17T01:09:47.315 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:47.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:47.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:47.651 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-02-17T01:09:47.821 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:47.825 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:47.826 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:47.827 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:47.827 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-17T01:09:48.164 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/162 2024-02-17T01:09:48.164 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/162 2024-02-17T01:09:48.165 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:48.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:48.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:48.499 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-02-17T01:09:48.695 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:48.698 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:48.698 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:48.700 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:49.000 INFO:teuthology.orchestra.run.smithi032.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-17T01:09:49.054 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/163 2024-02-17T01:09:49.055 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/163 2024-02-17T01:09:49.055 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:49.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:49.375 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-02-17T01:09:49.560 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:49.564 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:49.565 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:49.566 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:49.566 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:49.903 INFO:teuthology.orchestra.run.smithi032.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:49.910 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/164 2024-02-17T01:09:49.910 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/164 2024-02-17T01:09:49.910 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:50.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:50.264 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-02-17T01:09:50.446 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:50.450 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:50.450 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:50.451 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:50.796 INFO:teuthology.orchestra.run.smithi032.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:50.801 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/165 2024-02-17T01:09:50.802 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/165 2024-02-17T01:09:50.802 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:50.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:51.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:51.061 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-02-17T01:09:51.270 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:51.274 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:51.274 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:51.275 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:51.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:51.626 INFO:teuthology.orchestra.run.smithi032.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:51.632 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/166 2024-02-17T01:09:51.632 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/166 2024-02-17T01:09:51.633 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:51.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:51.928 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-02-17T01:09:52.134 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:52.137 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:52.138 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:52.139 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:52.475 INFO:teuthology.orchestra.run.smithi032.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:52.480 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/167 2024-02-17T01:09:52.480 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/167 2024-02-17T01:09:52.480 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:52.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:52.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:52.624 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-02-17T01:09:52.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:52.914 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:52.914 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:52.915 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:53.259 INFO:teuthology.orchestra.run.smithi032.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:53.264 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/168 2024-02-17T01:09:53.264 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/168 2024-02-17T01:09:53.264 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:53.267 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:53.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:53.464 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-02-17T01:09:53.730 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:53.734 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:53.734 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:53.735 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:generic/169 1s 2024-02-17T01:09:54.174 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/169 2024-02-17T01:09:54.175 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:54.176 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:54.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:54.185 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-02-17T01:09:54.371 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:54.374 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:54.374 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:54.376 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:54.717 INFO:teuthology.orchestra.run.smithi032.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:54.723 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/170 2024-02-17T01:09:54.723 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/170 2024-02-17T01:09:54.723 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:54.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:54.843 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-02-17T01:09:55.157 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:55.161 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:55.161 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:55.162 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:55.162 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:55.498 INFO:teuthology.orchestra.run.smithi032.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:55.504 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/171 2024-02-17T01:09:55.504 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/171 2024-02-17T01:09:55.504 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:55.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:55.641 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-02-17T01:09:55.945 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:55.949 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:55.949 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:55.950 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:55.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:56.282 INFO:teuthology.orchestra.run.smithi032.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:56.289 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/172 2024-02-17T01:09:56.289 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/172 2024-02-17T01:09:56.289 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:56.291 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:56.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:56.509 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-02-17T01:09:56.765 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:56.769 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:56.769 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:56.770 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:57.106 INFO:teuthology.orchestra.run.smithi032.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:57.113 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/173 2024-02-17T01:09:57.113 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/173 2024-02-17T01:09:57.113 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:57.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:57.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:57.372 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-02-17T01:09:57.596 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:57.599 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:57.599 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:57.600 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:57.600 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:57.944 INFO:teuthology.orchestra.run.smithi032.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:57.949 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/174 2024-02-17T01:09:57.949 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/174 2024-02-17T01:09:57.949 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:57.953 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:58.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:58.102 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-02-17T01:09:58.379 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:58.382 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:58.383 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:58.384 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:58.384 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:58.731 INFO:teuthology.orchestra.run.smithi032.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:58.738 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/175 2024-02-17T01:09:58.738 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/175 2024-02-17T01:09:58.738 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:58.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:58.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:58.918 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-02-17T01:09:59.176 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:59.179 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:59.180 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:59.180 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:59.520 INFO:teuthology.orchestra.run.smithi032.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:09:59.526 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/176 2024-02-17T01:09:59.526 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/176 2024-02-17T01:09:59.526 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:09:59.530 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:09:59.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:09:59.721 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-02-17T01:09:59.969 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:09:59.972 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:09:59.973 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:09:59.974 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:09:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:00.335 INFO:teuthology.orchestra.run.smithi032.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T01:10:00.338 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/177 2024-02-17T01:10:00.339 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/177 2024-02-17T01:10:00.339 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:00.341 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:00.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:00.388 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-02-17T01:10:00.792 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:00.796 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:00.796 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:00.797 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:01.037 INFO:teuthology.orchestra.run.smithi032.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:10:01.040 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/178 2024-02-17T01:10:01.041 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/178 2024-02-17T01:10:01.041 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:01.043 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:01.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:01.099 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-02-17T01:10:01.461 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:01.467 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:01.467 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:01.468 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:01.468 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:01.711 INFO:teuthology.orchestra.run.smithi032.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:10:01.715 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/179 2024-02-17T01:10:01.715 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/179 2024-02-17T01:10:01.715 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:01.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:01.767 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-02-17T01:10:02.193 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:02.197 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:02.197 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:02.198 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:02.198 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:02.438 INFO:teuthology.orchestra.run.smithi032.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:10:02.442 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/180 2024-02-17T01:10:02.442 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/180 2024-02-17T01:10:02.442 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:02.444 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:02.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:02.504 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-02-17T01:10:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:02.909 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:10:03.148 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/181 2024-02-17T01:10:03.148 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/181 2024-02-17T01:10:03.148 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:03.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:03.194 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-02-17T01:10:03.585 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:03.590 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:03.590 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:03.591 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:03.591 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:03.882 INFO:teuthology.orchestra.run.smithi032.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T01:10:03.885 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/182 2024-02-17T01:10:03.886 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/182 2024-02-17T01:10:03.886 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:03.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:03.942 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-02-17T01:10:04.355 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:04.360 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:04.360 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:04.361 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:04.361 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:04.714 INFO:teuthology.orchestra.run.smithi032.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:04.721 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/183 2024-02-17T01:10:04.721 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/183 2024-02-17T01:10:04.721 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:04.723 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:04.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:10:04.778 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:10:04.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:04.968 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-02-17T01:10:05.188 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:05.191 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:05.192 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:05.193 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:05.193 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:05.675 INFO:teuthology.orchestra.run.smithi032.stdout:generic/184 0s 2024-02-17T01:10:05.680 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/184 2024-02-17T01:10:05.680 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:05.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:05.698 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-02-17T01:10:05.922 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:05.925 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:05.926 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:05.927 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:05.927 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:06.252 INFO:teuthology.orchestra.run.smithi032.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:06.262 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/185 2024-02-17T01:10:06.263 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/185 2024-02-17T01:10:06.263 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:06.265 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:06.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:06.415 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-02-17T01:10:06.708 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:06.712 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:06.712 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:06.713 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:07.056 INFO:teuthology.orchestra.run.smithi032.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:07.062 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/186 2024-02-17T01:10:07.063 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/186 2024-02-17T01:10:07.063 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:07.066 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:07.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:07.381 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-02-17T01:10:07.565 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:07.568 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:07.569 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:07.570 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:07.570 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:07.959 INFO:teuthology.orchestra.run.smithi032.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:07.965 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/187 2024-02-17T01:10:07.965 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/187 2024-02-17T01:10:07.965 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:08.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:08.125 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-02-17T01:10:08.393 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:08.396 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:08.397 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:08.397 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:08.748 INFO:teuthology.orchestra.run.smithi032.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:08.754 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/188 2024-02-17T01:10:08.754 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/188 2024-02-17T01:10:08.754 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:08.757 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:08.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:08.898 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-02-17T01:10:09.168 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:09.171 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:09.172 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:09.173 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:09.511 INFO:teuthology.orchestra.run.smithi032.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:09.518 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/189 2024-02-17T01:10:09.518 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/189 2024-02-17T01:10:09.518 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:09.520 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:09.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:09.726 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-02-17T01:10:09.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:09.983 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:09.984 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:09.985 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:09.985 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:10.338 INFO:teuthology.orchestra.run.smithi032.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:10.345 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/190 2024-02-17T01:10:10.345 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/190 2024-02-17T01:10:10.345 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:10.348 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:10.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:10.456 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-02-17T01:10:10.744 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:10.748 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:10.749 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:10.750 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:10.750 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:11.109 INFO:teuthology.orchestra.run.smithi032.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:11.116 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/191 2024-02-17T01:10:11.116 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/191 2024-02-17T01:10:11.116 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:11.118 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:11.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:11.239 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-02-17T01:10:11.534 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:11.538 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:11.538 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:11.539 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:11.539 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:11.758 INFO:teuthology.orchestra.run.smithi032.stdout:generic/192 [not run] atime not maintained by ceph 2024-02-17T01:10:11.761 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/192 2024-02-17T01:10:11.762 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/192 2024-02-17T01:10:11.762 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:11.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:11.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:11.776 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-02-17T01:10:11.957 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:11.960 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:11.961 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:11.961 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:11.962 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:13.098 INFO:teuthology.orchestra.run.smithi032.stdout:generic/193 1s 2024-02-17T01:10:13.103 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/193 2024-02-17T01:10:13.103 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:13.105 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:13.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:13.151 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-02-17T01:10:13.566 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:13.570 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:13.571 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:13.572 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:13.912 INFO:teuthology.orchestra.run.smithi032.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:13.917 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/194 2024-02-17T01:10:13.917 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/194 2024-02-17T01:10:13.917 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:13.926 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:14.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:14.086 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-02-17T01:10:14.359 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:14.363 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:14.363 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:14.364 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:14.709 INFO:teuthology.orchestra.run.smithi032.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:14.716 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/195 2024-02-17T01:10:14.716 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/195 2024-02-17T01:10:14.716 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:14.718 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:14.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:14.898 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-02-17T01:10:15.165 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:15.169 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:15.169 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:15.170 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:15.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:15.530 INFO:teuthology.orchestra.run.smithi032.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:15.535 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/196 2024-02-17T01:10:15.536 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/196 2024-02-17T01:10:15.536 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:15.539 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:15.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:15.787 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-02-17T01:10:16.003 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:16.007 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:16.008 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:16.008 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:16.009 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:16.367 INFO:teuthology.orchestra.run.smithi032.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:16.372 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/197 2024-02-17T01:10:16.372 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/197 2024-02-17T01:10:16.373 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:16.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:16.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:16.512 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-02-17T01:10:16.825 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:16.829 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:16.829 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:16.830 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:16.830 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:17.446 INFO:teuthology.orchestra.run.smithi032.stdout:generic/198 1s 2024-02-17T01:10:17.451 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/198 2024-02-17T01:10:17.451 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:17.453 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:17.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:17.495 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-02-17T01:10:17.907 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:17.911 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:17.911 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:17.912 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:17.912 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:18.254 INFO:teuthology.orchestra.run.smithi032.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:18.260 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/199 2024-02-17T01:10:18.260 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/199 2024-02-17T01:10:18.261 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:18.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:18.488 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-02-17T01:10:18.771 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:18.775 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:18.775 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:18.776 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:18.776 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:19.115 INFO:teuthology.orchestra.run.smithi032.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:19.121 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/200 2024-02-17T01:10:19.121 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/200 2024-02-17T01:10:19.122 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:19.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:19.277 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-02-17T01:10:19.569 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:19.573 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:19.573 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:19.574 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:19.575 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:19.917 INFO:teuthology.orchestra.run.smithi032.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:19.924 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/201 2024-02-17T01:10:19.924 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/201 2024-02-17T01:10:19.924 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:19.926 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:20.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:20.053 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-02-17T01:10:20.342 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:20.345 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:20.345 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:20.347 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:20.347 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:20.683 INFO:teuthology.orchestra.run.smithi032.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:20.690 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/202 2024-02-17T01:10:20.690 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/202 2024-02-17T01:10:20.690 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:20.692 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:20.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:20.856 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-02-17T01:10:21.129 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:21.133 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:21.133 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:21.134 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:21.134 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:21.476 INFO:teuthology.orchestra.run.smithi032.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:21.484 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/203 2024-02-17T01:10:21.484 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/203 2024-02-17T01:10:21.484 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:21.486 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:21.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:21.697 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-02-17T01:10:21.935 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:21.939 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:21.939 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:21.940 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:10:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/204 2024-02-17T01:10:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/204 2024-02-17T01:10:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:24.050 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:24.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:24.064 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-02-17T01:10:24.268 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:24.271 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:24.272 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:24.272 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:24.273 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:24.623 INFO:teuthology.orchestra.run.smithi032.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:24.633 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/205 2024-02-17T01:10:24.633 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/205 2024-02-17T01:10:24.633 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:24.636 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:24.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:24.806 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-02-17T01:10:25.080 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:25.083 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:25.084 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:25.085 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:25.085 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:25.420 INFO:teuthology.orchestra.run.smithi032.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:10:25.427 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/206 2024-02-17T01:10:25.427 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/206 2024-02-17T01:10:25.427 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:25.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:25.668 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-02-17T01:10:25.897 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:25.900 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:25.900 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:25.901 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:25.901 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:32.400 INFO:teuthology.orchestra.run.smithi032.stdout:generic/207 7s 2024-02-17T01:10:32.405 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/207 2024-02-17T01:10:32.405 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:10:32.407 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:32.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:10:32.444 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-02-17T01:10:32.829 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:10:32.834 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:10:32.834 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:10:32.835 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:10:32.835 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:10:35.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:10:35.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:11:05.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:11:05.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:11:35.641 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:11:35.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:12:05.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:12:05.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:12:05.807 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T01:12:05.810+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47561) UID: 0 2024-02-17T01:12:05.807 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T01:12:05.810+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47561) UID: 0 2024-02-17T01:12:05.808 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T01:12:05.810+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47561) UID: 0 2024-02-17T01:12:05.808 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T01:12:05.810+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47561) UID: 0 2024-02-17T01:13:53.227 INFO:teuthology.orchestra.run.smithi032.stdout:generic/208 201s 2024-02-17T01:13:53.231 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/208 2024-02-17T01:13:53.231 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:13:53.233 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:13:53.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:13:53.274 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-02-17T01:13:53.679 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:13:53.683 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:13:53.683 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:13:53.684 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:13:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:29.278 INFO:teuthology.orchestra.run.smithi032.stdout:generic/209 36s 2024-02-17T01:14:29.283 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/209 2024-02-17T01:14:29.283 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:29.285 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:29.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:29.319 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-02-17T01:14:29.738 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:29.743 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:29.744 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:29.745 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:29.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:generic/210 1s 2024-02-17T01:14:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/210 2024-02-17T01:14:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:30.064 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:30.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:30.119 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-02-17T01:14:30.505 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:30.509 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:30.510 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:30.510 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:30.511 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:generic/211 0s 2024-02-17T01:14:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/211 2024-02-17T01:14:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:30.899 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:30.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:30.915 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-02-17T01:14:31.097 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:31.100 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:31.101 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:31.102 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:31.378 INFO:teuthology.orchestra.run.smithi032.stdout:generic/212 0s 2024-02-17T01:14:31.383 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/212 2024-02-17T01:14:31.383 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:31.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:31.401 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-02-17T01:14:31.571 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:31.575 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:31.575 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:31.576 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:31.785 INFO:teuthology.orchestra.run.smithi032.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:14:31.788 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/213 2024-02-17T01:14:31.789 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/213 2024-02-17T01:14:31.789 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:31.791 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:31.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:31.803 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-02-17T01:14:31.989 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:31.992 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:31.993 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:31.994 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:31.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:32.208 INFO:teuthology.orchestra.run.smithi032.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:14:32.211 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/214 2024-02-17T01:14:32.211 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/214 2024-02-17T01:14:32.211 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:32.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:32.226 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-02-17T01:14:32.404 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:32.407 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:32.408 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:32.409 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:32.409 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:34.684 INFO:teuthology.orchestra.run.smithi032.stdout:generic/215 2s 2024-02-17T01:14:34.690 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/215 2024-02-17T01:14:34.690 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:34.692 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:34.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:34.733 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-02-17T01:14:34.913 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:34.916 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:34.917 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:34.918 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:34.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:35.260 INFO:teuthology.orchestra.run.smithi032.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:35.266 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/216 2024-02-17T01:14:35.266 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/216 2024-02-17T01:14:35.266 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:35.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:35.439 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-02-17T01:14:35.727 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:35.731 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:35.731 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:35.732 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:36.078 INFO:teuthology.orchestra.run.smithi032.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:36.085 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/217 2024-02-17T01:14:36.085 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/217 2024-02-17T01:14:36.085 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:36.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:36.263 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-02-17T01:14:36.528 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:36.532 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:36.532 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:36.533 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:36.533 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:36.888 INFO:teuthology.orchestra.run.smithi032.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:36.895 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/218 2024-02-17T01:14:36.895 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/218 2024-02-17T01:14:36.895 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:36.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:37.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:37.088 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-02-17T01:14:37.357 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:37.361 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:37.361 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:37.362 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:37.575 INFO:teuthology.orchestra.run.smithi032.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:37.579 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/219 2024-02-17T01:14:37.579 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/219 2024-02-17T01:14:37.579 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:37.581 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:37.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:37.595 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-02-17T01:14:37.770 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:37.773 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:37.773 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:37.775 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:38.116 INFO:teuthology.orchestra.run.smithi032.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:38.123 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/220 2024-02-17T01:14:38.123 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/220 2024-02-17T01:14:38.123 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:38.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:38.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:38.298 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-02-17T01:14:38.593 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:38.596 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:38.597 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:38.597 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:38.598 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:39.861 INFO:teuthology.orchestra.run.smithi032.stdout:generic/221 1s 2024-02-17T01:14:39.867 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/221 2024-02-17T01:14:39.867 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:39.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:39.888 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-02-17T01:14:40.088 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:40.091 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:40.092 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:40.092 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:40.093 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:40.430 INFO:teuthology.orchestra.run.smithi032.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:40.435 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/222 2024-02-17T01:14:40.435 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/222 2024-02-17T01:14:40.435 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:40.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:40.706 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-02-17T01:14:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:40.939 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:14:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/223 2024-02-17T01:14:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/223 2024-02-17T01:14:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:41.151 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:41.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:41.166 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-02-17T01:14:41.335 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:41.339 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:41.339 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:41.340 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:41.551 INFO:teuthology.orchestra.run.smithi032.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:14:41.555 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/224 2024-02-17T01:14:41.555 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/224 2024-02-17T01:14:41.555 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:41.557 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:41.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:41.571 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-02-17T01:14:41.743 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:41.747 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:41.747 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:41.748 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:41.748 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:42.008 INFO:teuthology.orchestra.run.smithi032.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T01:14:42.012 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/225 2024-02-17T01:14:42.012 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/225 2024-02-17T01:14:42.012 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:42.014 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:42.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:42.050 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-02-17T01:14:42.449 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:42.453 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:42.454 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:42.455 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:42.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:42.683 INFO:teuthology.orchestra.run.smithi032.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:14:42.686 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/226 2024-02-17T01:14:42.686 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/226 2024-02-17T01:14:42.687 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:42.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:42.704 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-02-17T01:14:42.871 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:42.875 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:42.875 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:42.876 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:42.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:43.214 INFO:teuthology.orchestra.run.smithi032.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:43.219 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/227 2024-02-17T01:14:43.219 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/227 2024-02-17T01:14:43.220 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:43.222 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:43.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:43.312 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-02-17T01:14:43.636 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:43.639 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:43.640 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:43.640 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:43.640 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:43.887 INFO:teuthology.orchestra.run.smithi032.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:14:43.890 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/228 2024-02-17T01:14:43.890 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/228 2024-02-17T01:14:43.890 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:43.893 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:43.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:43.905 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-02-17T01:14:44.074 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:44.077 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:44.078 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:44.079 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:44.079 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:44.419 INFO:teuthology.orchestra.run.smithi032.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:44.424 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/229 2024-02-17T01:14:44.424 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/229 2024-02-17T01:14:44.425 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:44.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:44.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:44.617 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-02-17T01:14:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:45.100 INFO:teuthology.orchestra.run.smithi032.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:45.103 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/230 2024-02-17T01:14:45.103 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/230 2024-02-17T01:14:45.104 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:45.106 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:45.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:45.118 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-02-17T01:14:45.291 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:45.295 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:45.295 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:45.296 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:45.296 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:45.489 INFO:teuthology.orchestra.run.smithi032.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:45.493 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/231 2024-02-17T01:14:45.493 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/231 2024-02-17T01:14:45.493 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:45.495 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:45.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:45.525 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-02-17T01:14:45.712 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:45.715 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:45.715 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:45.716 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:45.908 INFO:teuthology.orchestra.run.smithi032.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:45.912 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/232 2024-02-17T01:14:45.912 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/232 2024-02-17T01:14:45.912 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:45.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:45.926 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-02-17T01:14:46.101 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:46.104 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:46.105 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:46.105 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:46.307 INFO:teuthology.orchestra.run.smithi032.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:46.311 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/233 2024-02-17T01:14:46.311 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/233 2024-02-17T01:14:46.311 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:46.314 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:46.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:46.326 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-02-17T01:14:46.509 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:46.512 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:46.513 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:46.513 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:46.714 INFO:teuthology.orchestra.run.smithi032.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:46.718 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/234 2024-02-17T01:14:46.718 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/234 2024-02-17T01:14:46.718 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:46.720 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:46.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:46.732 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-02-17T01:14:46.913 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:46.917 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:46.917 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:46.918 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:47.122 INFO:teuthology.orchestra.run.smithi032.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:14:47.126 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/235 2024-02-17T01:14:47.126 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/235 2024-02-17T01:14:47.126 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:47.128 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:47.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:47.152 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-02-17T01:14:47.332 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:47.335 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:47.335 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:47.336 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:47.337 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:48.634 INFO:teuthology.orchestra.run.smithi032.stdout:generic/236 1s 2024-02-17T01:14:48.640 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/236 2024-02-17T01:14:48.640 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:48.642 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:48.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:48.684 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-02-17T01:14:49.069 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:49.074 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:49.074 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:49.076 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:49.988 INFO:teuthology.orchestra.run.smithi032.stdout:generic/237 0s 2024-02-17T01:14:50.095 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/237 2024-02-17T01:14:50.095 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:50.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:50.148 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-02-17T01:14:50.554 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:50.558 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:50.559 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:50.560 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:50.560 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:50.900 INFO:teuthology.orchestra.run.smithi032.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:14:50.907 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/238 2024-02-17T01:14:50.907 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/238 2024-02-17T01:14:50.907 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:51.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:51.096 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-02-17T01:14:51.362 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:51.366 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:51.366 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:51.367 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:51.367 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:51.603 INFO:teuthology.orchestra.run.smithi032.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-02-17T01:14:51.607 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/239 2024-02-17T01:14:51.607 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/239 2024-02-17T01:14:51.608 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:51.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:51.631 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-02-17T01:14:51.800 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:51.804 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:51.804 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:51.805 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:51.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:52.023 INFO:teuthology.orchestra.run.smithi032.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-02-17T01:14:52.027 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/240 2024-02-17T01:14:52.027 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/240 2024-02-17T01:14:52.027 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:14:52.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:14:52.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:14:52.050 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-02-17T01:14:52.229 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:14:52.233 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:14:52.233 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:14:52.234 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:14:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:15:44.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:15:44.359 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:15:44.404 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T01:15:44.411+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260994) UID: 0 2024-02-17T01:15:44.404 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T01:15:44.411+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260994) UID: 0 2024-02-17T01:15:44.405 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T01:15:44.411+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260994) UID: 0 2024-02-17T01:15:44.405 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T01:15:44.411+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260994) UID: 0 2024-02-17T01:16:05.127 INFO:teuthology.orchestra.run.smithi032.stdout:generic/241 73s 2024-02-17T01:16:05.132 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/241 2024-02-17T01:16:05.132 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:05.134 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:05.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:05.506 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-02-17T01:16:05.857 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:05.862 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:05.862 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:05.864 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:06.543 INFO:teuthology.orchestra.run.smithi032.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:06.549 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/242 2024-02-17T01:16:06.549 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/242 2024-02-17T01:16:06.549 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:06.551 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:06.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:06.729 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-02-17T01:16:07.041 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:07.045 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:07.045 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:07.047 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:07.047 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:07.383 INFO:teuthology.orchestra.run.smithi032.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:07.389 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/243 2024-02-17T01:16:07.389 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/243 2024-02-17T01:16:07.389 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:07.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:07.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:07.575 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-02-17T01:16:07.879 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:07.882 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:07.883 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:07.884 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:07.884 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:08.095 INFO:teuthology.orchestra.run.smithi032.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:16:08.098 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/244 2024-02-17T01:16:08.098 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/244 2024-02-17T01:16:08.098 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:08.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:08.116 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-02-17T01:16:08.296 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:08.300 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:08.300 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:08.301 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:08.301 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout:generic/245 0s 2024-02-17T01:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/245 2024-02-17T01:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:08.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:08.621 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-02-17T01:16:08.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:08.989 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:08.989 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:08.994 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:08.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:09.374 INFO:teuthology.orchestra.run.smithi032.stdout:generic/246 0s 2024-02-17T01:16:09.379 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/246 2024-02-17T01:16:09.379 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:09.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:09.439 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-02-17T01:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:17.499 INFO:teuthology.orchestra.run.smithi032.stdout:generic/247 8s 2024-02-17T01:16:17.504 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/247 2024-02-17T01:16:17.504 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:17.507 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:17.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:17.515 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-02-17T01:16:17.698 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:17.701 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:17.702 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:17.702 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:18.034 INFO:teuthology.orchestra.run.smithi032.stdout:generic/248 1s 2024-02-17T01:16:18.039 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/248 2024-02-17T01:16:18.039 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:18.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:18.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:18.065 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-02-17T01:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:18.642 INFO:teuthology.orchestra.run.smithi032.stdout:generic/249 0s 2024-02-17T01:16:18.647 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/249 2024-02-17T01:16:18.648 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:18.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:18.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:18.705 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-02-17T01:16:19.130 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:19.136 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:19.137 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:19.138 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:19.138 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:19.438 INFO:teuthology.orchestra.run.smithi032.stdout:generic/250 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:16:19.442 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/250 2024-02-17T01:16:19.442 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/250 2024-02-17T01:16:19.442 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:19.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:19.457 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-02-17T01:16:19.637 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:19.641 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:19.641 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:19.642 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:19.642 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:19.939 INFO:teuthology.orchestra.run.smithi032.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:19.946 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/251 2024-02-17T01:16:19.946 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/251 2024-02-17T01:16:19.946 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:19.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:19.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:19.960 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-02-17T01:16:20.147 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:20.151 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:20.151 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:20.152 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:20.152 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:20.362 INFO:teuthology.orchestra.run.smithi032.stdout:generic/252 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:16:20.365 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/252 2024-02-17T01:16:20.365 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/252 2024-02-17T01:16:20.365 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:20.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:20.381 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-02-17T01:16:20.556 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:20.560 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:20.560 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:20.562 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:20.899 INFO:teuthology.orchestra.run.smithi032.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:20.905 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/253 2024-02-17T01:16:20.906 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/253 2024-02-17T01:16:20.906 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:21.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:21.047 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-02-17T01:16:21.377 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:21.381 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:21.381 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:21.382 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:21.382 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:21.719 INFO:teuthology.orchestra.run.smithi032.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:21.726 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/254 2024-02-17T01:16:21.726 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/254 2024-02-17T01:16:21.726 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:21.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:21.829 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-02-17T01:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:16:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/255 2024-02-17T01:16:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/255 2024-02-17T01:16:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:22.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:22.520 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-02-17T01:16:22.938 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:22.946 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:22.947 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:22.948 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:22.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:23.950 INFO:teuthology.orchestra.run.smithi032.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:16:23.954 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/256 2024-02-17T01:16:23.954 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/256 2024-02-17T01:16:23.954 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:23.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:23.977 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-02-17T01:16:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:24.161 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:24.768 INFO:teuthology.orchestra.run.smithi032.stdout:generic/257 0s 2024-02-17T01:16:24.773 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/257 2024-02-17T01:16:24.773 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:24.775 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:24.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:24.985 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-02-17T01:16:25.392 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:25.406 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:25.407 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:25.409 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:25.409 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:25.621 INFO:teuthology.orchestra.run.smithi032.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-02-17T01:16:25.625 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/258 2024-02-17T01:16:25.625 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/258 2024-02-17T01:16:25.625 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:25.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:25.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:25.639 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-02-17T01:16:25.807 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:25.810 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:25.811 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:25.812 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:25.812 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:26.179 INFO:teuthology.orchestra.run.smithi032.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:26.186 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/259 2024-02-17T01:16:26.186 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/259 2024-02-17T01:16:26.186 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:26.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:26.278 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-02-17T01:16:26.635 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:26.640 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:26.640 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:26.641 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:26.641 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:26.909 INFO:teuthology.orchestra.run.smithi032.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:26.917 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/260 2024-02-17T01:16:26.917 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/260 2024-02-17T01:16:26.917 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:26.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:26.942 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-02-17T01:16:27.114 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:27.117 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:27.118 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:27.119 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:27.479 INFO:teuthology.orchestra.run.smithi032.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:27.484 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/261 2024-02-17T01:16:27.484 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/261 2024-02-17T01:16:27.485 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:27.487 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:27.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:27.644 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-02-17T01:16:27.968 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:27.972 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:27.973 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:27.973 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:27.973 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:28.332 INFO:teuthology.orchestra.run.smithi032.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:16:28.338 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/262 2024-02-17T01:16:28.338 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/262 2024-02-17T01:16:28.339 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:16:28.340 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:16:28.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:16:28.453 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-02-17T01:16:28.773 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:16:28.778 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:16:28.779 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:16:28.780 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:16:28.780 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:03.764 INFO:teuthology.orchestra.run.smithi032.stdout:generic/263 35s 2024-02-17T01:17:03.769 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/263 2024-02-17T01:17:03.769 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:03.771 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:03.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:03.824 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-02-17T01:17:04.228 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:04.234 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:04.234 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:04.236 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:04.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:04.653 INFO:teuthology.orchestra.run.smithi032.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:04.660 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/264 2024-02-17T01:17:04.660 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/264 2024-02-17T01:17:04.660 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:04.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:04.766 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-02-17T01:17:05.093 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:05.097 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:05.097 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:05.098 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:05.098 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:05.548 INFO:teuthology.orchestra.run.smithi032.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:05.562 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/265 2024-02-17T01:17:05.563 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/265 2024-02-17T01:17:05.563 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:05.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:05.657 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-02-17T01:17:05.978 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:05.982 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:05.982 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:05.983 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:05.983 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:06.356 INFO:teuthology.orchestra.run.smithi032.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:06.364 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/266 2024-02-17T01:17:06.364 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/266 2024-02-17T01:17:06.365 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:06.368 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:06.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:06.503 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-02-17T01:17:06.811 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:06.814 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:06.815 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:06.816 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:06.816 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:07.184 INFO:teuthology.orchestra.run.smithi032.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:07.189 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/267 2024-02-17T01:17:07.190 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/267 2024-02-17T01:17:07.190 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:07.193 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:07.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:07.307 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-02-17T01:17:07.627 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:07.631 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:07.631 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:07.632 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:07.632 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:08.089 INFO:teuthology.orchestra.run.smithi032.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:08.095 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/268 2024-02-17T01:17:08.095 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/268 2024-02-17T01:17:08.096 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:08.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:08.215 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-02-17T01:17:08.534 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:08.538 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:08.538 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:08.539 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:08.539 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:08.768 INFO:teuthology.orchestra.run.smithi032.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:17:08.772 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/269 2024-02-17T01:17:08.772 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/269 2024-02-17T01:17:08.772 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:08.774 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:08.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:08.787 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-02-17T01:17:08.968 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:08.971 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:08.972 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:08.973 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:08.973 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:09.217 INFO:teuthology.orchestra.run.smithi032.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:17:09.220 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/270 2024-02-17T01:17:09.220 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/270 2024-02-17T01:17:09.220 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:09.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:09.235 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-02-17T01:17:09.412 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:09.415 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:09.415 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:09.416 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:09.808 INFO:teuthology.orchestra.run.smithi032.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:09.814 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/271 2024-02-17T01:17:09.814 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/271 2024-02-17T01:17:09.814 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:09.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:09.965 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-02-17T01:17:10.326 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:10.330 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:10.330 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:10.331 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:10.331 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:10.728 INFO:teuthology.orchestra.run.smithi032.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:10.733 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/272 2024-02-17T01:17:10.733 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/272 2024-02-17T01:17:10.733 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:10.737 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:10.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:10.850 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-02-17T01:17:11.182 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:11.186 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:11.186 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:11.187 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:11.187 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:11.393 INFO:teuthology.orchestra.run.smithi032.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:17:11.397 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/273 2024-02-17T01:17:11.397 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/273 2024-02-17T01:17:11.397 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:11.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:11.423 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-02-17T01:17:11.598 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:11.602 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:11.602 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:11.603 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:11.603 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:11.833 INFO:teuthology.orchestra.run.smithi032.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T01:17:11.836 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/274 2024-02-17T01:17:11.837 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/274 2024-02-17T01:17:11.837 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:11.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:11.856 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-02-17T01:17:12.035 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:12.039 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:12.040 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:12.041 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:12.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:12.277 INFO:teuthology.orchestra.run.smithi032.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:17:12.281 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/275 2024-02-17T01:17:12.281 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/275 2024-02-17T01:17:12.281 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:12.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:12.296 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-02-17T01:17:12.466 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:12.470 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:12.470 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:12.471 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:12.471 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:12.847 INFO:teuthology.orchestra.run.smithi032.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:12.852 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/276 2024-02-17T01:17:12.852 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/276 2024-02-17T01:17:12.852 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:12.855 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:13.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:13.056 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-02-17T01:17:13.371 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:13.375 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:13.375 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:13.376 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:13.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:13.668 INFO:teuthology.orchestra.run.smithi032.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-02-17T01:17:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/277 2024-02-17T01:17:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/277 2024-02-17T01:17:13.672 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:13.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:13.692 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-02-17T01:17:13.873 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:13.876 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:13.877 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:13.878 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:14.245 INFO:teuthology.orchestra.run.smithi032.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:14.250 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/278 2024-02-17T01:17:14.250 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/278 2024-02-17T01:17:14.250 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:14.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:14.404 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-02-17T01:17:14.717 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:14.720 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:14.721 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:14.721 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:14.722 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:15.107 INFO:teuthology.orchestra.run.smithi032.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:15.114 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/279 2024-02-17T01:17:15.114 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/279 2024-02-17T01:17:15.114 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:15.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:15.227 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-02-17T01:17:15.556 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:15.560 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:15.560 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:15.561 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:15.781 INFO:teuthology.orchestra.run.smithi032.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:17:15.785 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/280 2024-02-17T01:17:15.785 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/280 2024-02-17T01:17:15.786 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:15.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:15.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:15.800 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-02-17T01:17:15.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:15.984 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:15.984 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:15.985 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:15.985 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:16.416 INFO:teuthology.orchestra.run.smithi032.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:16.422 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/281 2024-02-17T01:17:16.422 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/281 2024-02-17T01:17:16.422 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:16.429 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:16.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:16.537 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-02-17T01:17:16.858 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:16.861 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:16.862 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:16.863 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:16.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:17.229 INFO:teuthology.orchestra.run.smithi032.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:17.236 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/282 2024-02-17T01:17:17.236 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/282 2024-02-17T01:17:17.236 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:17.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:17.398 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-02-17T01:17:17.722 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:17.725 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:17.726 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:17.727 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:18.244 INFO:teuthology.orchestra.run.smithi032.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:18.250 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/283 2024-02-17T01:17:18.250 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/283 2024-02-17T01:17:18.250 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:18.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:18.306 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-02-17T01:17:18.599 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:18.603 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:18.603 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:18.604 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:18.965 INFO:teuthology.orchestra.run.smithi032.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:18.970 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/284 2024-02-17T01:17:18.970 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/284 2024-02-17T01:17:18.970 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:19.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:19.145 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-02-17T01:17:19.441 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:19.445 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:19.445 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:19.446 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:20.798 INFO:teuthology.orchestra.run.smithi032.stdout:generic/285 1s 2024-02-17T01:17:20.851 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/285 2024-02-17T01:17:20.851 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:21.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:21.155 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-02-17T01:17:21.580 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:21.592 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:21.592 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:21.594 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:21.594 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:21.850 INFO:teuthology.orchestra.run.smithi032.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:17:21.854 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/286 2024-02-17T01:17:21.854 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/286 2024-02-17T01:17:21.854 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:21.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:21.883 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-02-17T01:17:22.076 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:22.082 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:22.082 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:22.084 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:22.589 INFO:teuthology.orchestra.run.smithi032.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:22.596 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/287 2024-02-17T01:17:22.596 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/287 2024-02-17T01:17:22.596 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:22.598 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:22.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:22.741 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-02-17T01:17:23.137 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:23.143 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:23.143 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:23.145 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:23.145 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:23.582 INFO:teuthology.orchestra.run.smithi032.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:23.593 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/288 2024-02-17T01:17:23.593 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/288 2024-02-17T01:17:23.593 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:23.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:23.616 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-02-17T01:17:23.887 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:23.893 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:23.894 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:23.895 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:23.895 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:24.399 INFO:teuthology.orchestra.run.smithi032.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:24.406 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/289 2024-02-17T01:17:24.406 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/289 2024-02-17T01:17:24.406 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:24.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:24.556 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-02-17T01:17:24.958 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:24.963 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:24.963 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:24.965 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:24.965 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:25.449 INFO:teuthology.orchestra.run.smithi032.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:25.459 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/290 2024-02-17T01:17:25.459 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/290 2024-02-17T01:17:25.459 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:25.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:25.627 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-02-17T01:17:25.999 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:26.005 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:26.005 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:26.007 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:26.519 INFO:teuthology.orchestra.run.smithi032.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:26.524 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/291 2024-02-17T01:17:26.524 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/291 2024-02-17T01:17:26.524 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:26.528 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:26.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:26.676 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-02-17T01:17:27.034 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:27.045 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:27.045 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:27.047 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:27.572 INFO:teuthology.orchestra.run.smithi032.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:27.579 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/292 2024-02-17T01:17:27.579 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/292 2024-02-17T01:17:27.579 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:27.581 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:27.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:27.742 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-02-17T01:17:28.087 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:28.093 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:28.093 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:28.094 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:28.094 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:28.656 INFO:teuthology.orchestra.run.smithi032.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:28.662 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/293 2024-02-17T01:17:28.663 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/293 2024-02-17T01:17:28.663 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:28.666 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:28.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:28.831 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-02-17T01:17:29.172 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:29.175 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:29.176 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:29.177 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:29.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:29.702 INFO:teuthology.orchestra.run.smithi032.stdout:generic/294 0s 2024-02-17T01:17:29.709 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/294 2024-02-17T01:17:29.710 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:29.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:29.726 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-02-17T01:17:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:30.099 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:30.466 INFO:teuthology.orchestra.run.smithi032.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:30.475 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/295 2024-02-17T01:17:30.475 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/295 2024-02-17T01:17:30.475 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:30.481 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:30.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:30.619 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-02-17T01:17:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:31.336 INFO:teuthology.orchestra.run.smithi032.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:31.343 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/296 2024-02-17T01:17:31.343 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/296 2024-02-17T01:17:31.343 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:31.345 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:31.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:31.496 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-02-17T01:17:31.829 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:31.833 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:31.834 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:31.835 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:31.835 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:32.196 INFO:teuthology.orchestra.run.smithi032.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:32.201 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/297 2024-02-17T01:17:32.201 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/297 2024-02-17T01:17:32.201 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:32.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:32.350 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-02-17T01:17:32.671 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:32.674 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:32.675 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:32.676 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:32.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:33.034 INFO:teuthology.orchestra.run.smithi032.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:33.039 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/298 2024-02-17T01:17:33.040 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/298 2024-02-17T01:17:33.040 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:33.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:33.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-02-17T01:17:33.553 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:33.556 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:33.556 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:33.557 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:33.851 INFO:teuthology.orchestra.run.smithi032.stdout:generic/299 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:17:33.855 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/299 2024-02-17T01:17:33.855 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/299 2024-02-17T01:17:33.855 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:33.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:33.877 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-02-17T01:17:34.055 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:34.059 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:34.059 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:34.060 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:34.060 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:34.317 INFO:teuthology.orchestra.run.smithi032.stdout:generic/300 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:17:34.320 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/300 2024-02-17T01:17:34.321 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/300 2024-02-17T01:17:34.321 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:34.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:34.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:34.343 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-02-17T01:17:34.515 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:34.519 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:34.519 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:34.520 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:34.520 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:34.876 INFO:teuthology.orchestra.run.smithi032.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:34.882 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/301 2024-02-17T01:17:34.882 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/301 2024-02-17T01:17:34.882 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:34.886 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:35.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:35.015 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-02-17T01:17:35.349 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:35.352 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:35.353 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:35.354 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:35.711 INFO:teuthology.orchestra.run.smithi032.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:35.718 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/302 2024-02-17T01:17:35.718 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/302 2024-02-17T01:17:35.718 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:35.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:35.869 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-02-17T01:17:36.212 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:36.216 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:36.216 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:36.217 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:36.479 INFO:teuthology.orchestra.run.smithi032.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:17:36.484 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/303 2024-02-17T01:17:36.484 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/303 2024-02-17T01:17:36.484 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:36.486 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:36.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:36.544 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-02-17T01:17:36.931 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:36.938 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:36.939 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:36.940 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:36.940 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:37.206 INFO:teuthology.orchestra.run.smithi032.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T01:17:37.210 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/304 2024-02-17T01:17:37.210 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/304 2024-02-17T01:17:37.210 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:37.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:37.271 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-02-17T01:17:37.677 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:37.680 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:37.681 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:37.682 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:38.043 INFO:teuthology.orchestra.run.smithi032.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:17:38.050 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/305 2024-02-17T01:17:38.050 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/305 2024-02-17T01:17:38.050 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:38.053 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:38.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:38.192 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-02-17T01:17:38.544 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:38.548 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:38.548 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:38.549 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:38.550 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:39.042 INFO:teuthology.orchestra.run.smithi032.stdout:generic/306 1s 2024-02-17T01:17:39.050 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/306 2024-02-17T01:17:39.050 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:39.052 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:39.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:39.314 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-02-17T01:17:39.675 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:39.683 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:41.264 INFO:teuthology.orchestra.run.smithi032.stdout:generic/307 2s 2024-02-17T01:17:41.269 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/307 2024-02-17T01:17:41.269 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:41.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:41.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:41.279 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-02-17T01:17:41.451 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:41.454 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:41.455 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:41.456 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:41.690 INFO:teuthology.orchestra.run.smithi032.stdout:generic/308 0s 2024-02-17T01:17:41.695 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/308 2024-02-17T01:17:41.695 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:41.697 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:41.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:41.716 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-02-17T01:17:41.906 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:41.910 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:41.910 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:41.911 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:41.911 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:43.181 INFO:teuthology.orchestra.run.smithi032.stdout:generic/309 1s 2024-02-17T01:17:43.185 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/309 2024-02-17T01:17:43.186 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:17:43.188 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:17:43.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:17:43.242 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-02-17T01:17:43.669 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:17:43.684 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:17:43.688 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:17:43.691 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:17:43.691 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:18:55.034 INFO:teuthology.orchestra.run.smithi032.stdout:generic/310 72s 2024-02-17T01:18:55.038 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/310 2024-02-17T01:18:55.039 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:18:55.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:18:55.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:18:55.127 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-02-17T01:18:55.529 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:18:55.533 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:18:55.533 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:18:55.534 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:18:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:18:55.853 INFO:teuthology.orchestra.run.smithi032.stdout:generic/311 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:18:55.856 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/311 2024-02-17T01:18:55.857 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/311 2024-02-17T01:18:55.857 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:18:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:18:55.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:18:55.873 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-02-17T01:18:56.057 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:18:56.060 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:18:56.061 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:18:56.062 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:18:56.062 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:18:56.258 INFO:teuthology.orchestra.run.smithi032.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:18:56.262 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/312 2024-02-17T01:18:56.262 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/312 2024-02-17T01:18:56.262 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:18:56.264 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:18:56.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:18:56.277 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-02-17T01:18:56.446 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:18:56.449 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:18:56.450 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:18:56.451 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:18:56.451 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:00.716 INFO:teuthology.orchestra.run.smithi032.stdout:generic/313 4s 2024-02-17T01:19:00.721 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/313 2024-02-17T01:19:00.721 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:00.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:00.739 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-02-17T01:19:00.925 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:00.929 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:00.929 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:00.930 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:00.930 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:01.801 INFO:teuthology.orchestra.run.smithi032.stdout:generic/314 0s 2024-02-17T01:19:01.806 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/314 2024-02-17T01:19:01.806 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:01.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:01.823 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-02-17T01:19:02.002 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:02.006 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:02.006 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:02.007 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:02.007 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:02.222 INFO:teuthology.orchestra.run.smithi032.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T01:19:02.226 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/315 2024-02-17T01:19:02.226 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/315 2024-02-17T01:19:02.226 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:02.228 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:02.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:02.242 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-02-17T01:19:02.426 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:02.429 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:02.430 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:02.431 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:02.431 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:02.739 INFO:teuthology.orchestra.run.smithi032.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T01:19:02.743 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/316 2024-02-17T01:19:02.743 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/316 2024-02-17T01:19:02.743 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:02.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:02.801 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-02-17T01:19:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:04.254 INFO:teuthology.orchestra.run.smithi032.stdout:generic/317 1s 2024-02-17T01:19:04.259 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/317 2024-02-17T01:19:04.259 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:04.262 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:04.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:04.270 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-02-17T01:19:04.444 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:04.448 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:04.448 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:04.449 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:04.449 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:05.044 INFO:teuthology.orchestra.run.smithi032.stdout:generic/318 1s 2024-02-17T01:19:05.049 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/318 2024-02-17T01:19:05.050 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:05.052 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:05.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:05.061 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-02-17T01:19:05.248 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:05.252 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:05.252 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:05.253 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:05.253 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:05.588 INFO:teuthology.orchestra.run.smithi032.stdout:generic/319 0s 2024-02-17T01:19:05.593 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/319 2024-02-17T01:19:05.593 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:05.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:05.603 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-02-17T01:19:05.779 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:05.783 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:05.783 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:05.784 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:05.993 INFO:teuthology.orchestra.run.smithi032.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:19:05.996 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/320 2024-02-17T01:19:05.997 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/320 2024-02-17T01:19:05.997 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:05.999 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:06.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:06.010 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-02-17T01:19:06.184 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:06.189 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:06.189 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:06.190 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:06.190 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:06.404 INFO:teuthology.orchestra.run.smithi032.stdout:generic/321 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:19:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/321 2024-02-17T01:19:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/321 2024-02-17T01:19:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:06.410 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:06.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:06.421 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-02-17T01:19:06.605 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:06.609 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:06.609 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:06.610 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:06.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:06.812 INFO:teuthology.orchestra.run.smithi032.stdout:generic/322 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:19:06.815 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/322 2024-02-17T01:19:06.816 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/322 2024-02-17T01:19:06.816 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:19:06.818 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:19:06.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:19:06.829 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-02-17T01:19:07.000 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:19:07.004 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:19:07.004 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:19:07.005 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:19:07.005 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:07.783 INFO:teuthology.orchestra.run.smithi032.stdout:generic/323 120s 2024-02-17T01:21:07.787 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/323 2024-02-17T01:21:07.788 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:07.790 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:07.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:07.853 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-02-17T01:21:08.230 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:08.234 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:08.235 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:08.236 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:08.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:08.453 INFO:teuthology.orchestra.run.smithi032.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-02-17T01:21:08.457 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/324 2024-02-17T01:21:08.458 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/324 2024-02-17T01:21:08.458 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:08.460 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:08.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:08.472 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-02-17T01:21:08.666 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:08.669 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:08.670 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:08.670 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:08.885 INFO:teuthology.orchestra.run.smithi032.stdout:generic/325 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:21:08.888 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/325 2024-02-17T01:21:08.888 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/325 2024-02-17T01:21:08.889 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:08.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:08.902 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-02-17T01:21:09.080 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:09.083 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:09.084 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:09.085 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:09.085 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/326 2024-02-17T01:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/326 2024-02-17T01:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:09.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:09.516 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-02-17T01:21:09.876 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:09.879 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:09.879 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:09.880 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:10.207 INFO:teuthology.orchestra.run.smithi032.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:10.213 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/327 2024-02-17T01:21:10.213 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/327 2024-02-17T01:21:10.213 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:10.216 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:10.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:10.360 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-02-17T01:21:10.663 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:10.666 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:10.666 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:10.667 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:10.667 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:11.006 INFO:teuthology.orchestra.run.smithi032.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:11.014 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/328 2024-02-17T01:21:11.014 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/328 2024-02-17T01:21:11.014 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:11.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:11.075 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-02-17T01:21:11.445 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:11.448 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:11.448 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:11.449 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:11.798 INFO:teuthology.orchestra.run.smithi032.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:11.804 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/329 2024-02-17T01:21:11.804 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/329 2024-02-17T01:21:11.804 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:11.809 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:11.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:11.862 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-02-17T01:21:12.210 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:12.214 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:12.214 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:12.215 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:12.215 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:12.556 INFO:teuthology.orchestra.run.smithi032.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:12.563 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/330 2024-02-17T01:21:12.563 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/330 2024-02-17T01:21:12.564 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:12.566 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:12.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:12.675 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-02-17T01:21:12.988 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:12.991 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:12.992 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:12.993 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:13.345 INFO:teuthology.orchestra.run.smithi032.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:13.350 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/331 2024-02-17T01:21:13.350 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/331 2024-02-17T01:21:13.350 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:13.357 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:13.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:13.436 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-02-17T01:21:13.756 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:13.760 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:13.760 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:13.761 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:14.176 INFO:teuthology.orchestra.run.smithi032.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:14.183 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/332 2024-02-17T01:21:14.183 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/332 2024-02-17T01:21:14.183 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:14.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:14.311 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-02-17T01:21:14.611 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:14.615 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:14.616 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:14.616 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:14.616 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/333 2024-02-17T01:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/333 2024-02-17T01:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:15.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:15.057 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-02-17T01:21:15.372 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:15.376 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:15.376 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:15.377 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:15.377 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:15.710 INFO:teuthology.orchestra.run.smithi032.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:21:15.716 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/334 2024-02-17T01:21:15.716 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/334 2024-02-17T01:21:15.717 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:15.718 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:15.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:15.847 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-02-17T01:21:16.161 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:16.164 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:16.165 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:16.165 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:16.166 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:16.395 INFO:teuthology.orchestra.run.smithi032.stdout:generic/335 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:21:16.398 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/335 2024-02-17T01:21:16.398 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/335 2024-02-17T01:21:16.398 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:16.401 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:16.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:16.413 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-02-17T01:21:16.580 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:16.583 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:16.584 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:16.585 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:16.834 INFO:teuthology.orchestra.run.smithi032.stdout:generic/336 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:21:16.837 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/336 2024-02-17T01:21:16.838 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/336 2024-02-17T01:21:16.838 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:16.840 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:16.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:16.865 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-02-17T01:21:17.040 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:17.043 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:17.043 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:17.044 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:17.044 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:17.376 INFO:teuthology.orchestra.run.smithi032.stdout:generic/337 0s 2024-02-17T01:21:17.381 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/337 2024-02-17T01:21:17.381 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:17.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:17.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:17.392 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-02-17T01:21:17.562 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:17.566 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:17.566 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:17.567 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:17.568 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:17.775 INFO:teuthology.orchestra.run.smithi032.stdout:generic/338 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:21:17.779 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/338 2024-02-17T01:21:17.779 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/338 2024-02-17T01:21:17.779 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:21:17.781 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:17.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:21:17.809 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-02-17T01:21:17.984 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:21:17.988 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:21:17.988 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:21:17.989 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:21:17.990 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:21:36.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:21:36.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:21:36.328 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T01:21:36.340+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47660) UID: 0 2024-02-17T01:21:36.328 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T01:21:36.340+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47660) UID: 0 2024-02-17T01:22:09.027 INFO:teuthology.orchestra.run.smithi032.stdout:generic/339 50s 2024-02-17T01:22:09.033 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/339 2024-02-17T01:22:09.033 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:09.035 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:09.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:09.043 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-02-17T01:22:09.225 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:09.229 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:09.229 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:09.230 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:11.336 INFO:teuthology.orchestra.run.smithi032.stdout:generic/340 2s 2024-02-17T01:22:11.343 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/340 2024-02-17T01:22:11.343 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:11.347 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:11.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:11.363 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-02-17T01:22:11.764 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:11.770 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:11.770 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:11.771 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:11.771 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:12.094 INFO:teuthology.orchestra.run.smithi032.stdout:generic/341 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:12.100 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/341 2024-02-17T01:22:12.100 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/341 2024-02-17T01:22:12.100 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:12.103 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:12.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:12.121 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-02-17T01:22:12.333 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:12.337 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:12.337 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:12.338 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:12.549 INFO:teuthology.orchestra.run.smithi032.stdout:generic/342 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:12.553 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/342 2024-02-17T01:22:12.553 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/342 2024-02-17T01:22:12.553 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:12.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:12.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:12.567 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-02-17T01:22:12.744 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:12.747 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:12.748 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:12.748 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:12.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:12.969 INFO:teuthology.orchestra.run.smithi032.stdout:generic/343 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:12.973 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/343 2024-02-17T01:22:12.973 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/343 2024-02-17T01:22:12.973 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:12.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:12.993 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-02-17T01:22:13.169 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:13.173 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:13.173 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:13.174 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:13.174 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:17.127 INFO:teuthology.orchestra.run.smithi032.stdout:generic/344 4s 2024-02-17T01:22:17.139 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/344 2024-02-17T01:22:17.139 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:17.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:17.154 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-02-17T01:22:17.517 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:17.520 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:17.520 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:17.521 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:17.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:23.551 INFO:teuthology.orchestra.run.smithi032.stdout:generic/345 6s 2024-02-17T01:22:23.559 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/345 2024-02-17T01:22:23.560 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:23.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:23.574 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-02-17T01:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:26.363 INFO:teuthology.orchestra.run.smithi032.stdout:generic/346 2s 2024-02-17T01:22:26.387 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/346 2024-02-17T01:22:26.388 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:26.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:26.403 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-02-17T01:22:26.742 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:26.749 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:26.749 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:26.751 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:27.263 INFO:teuthology.orchestra.run.smithi032.stdout:generic/347 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:27.267 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/347 2024-02-17T01:22:27.267 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/347 2024-02-17T01:22:27.267 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:27.269 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:27.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:27.281 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-02-17T01:22:27.465 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:27.468 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:27.469 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:27.470 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:27.470 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:27.693 INFO:teuthology.orchestra.run.smithi032.stdout:generic/348 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:27.697 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/348 2024-02-17T01:22:27.697 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/348 2024-02-17T01:22:27.697 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:27.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:27.714 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-02-17T01:22:27.892 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:27.895 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:27.896 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:27.896 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:27.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-17T01:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/349 2024-02-17T01:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/349 2024-02-17T01:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:28.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:28.217 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-02-17T01:22:28.389 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:28.393 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:28.393 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:28.394 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:28.394 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:29.049 INFO:teuthology.orchestra.run.smithi032.stdout:generic/350 1s 2024-02-17T01:22:29.054 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/350 2024-02-17T01:22:29.054 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:29.056 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:29.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:29.064 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-02-17T01:22:29.234 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:29.237 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:29.237 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:29.238 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:29.239 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:29.462 INFO:teuthology.orchestra.run.smithi032.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:22:29.466 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/351 2024-02-17T01:22:29.466 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/351 2024-02-17T01:22:29.466 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:29.468 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:29.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:29.483 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-02-17T01:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/352 2024-02-17T01:22:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/352 2024-02-17T01:22:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:30.021 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:30.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:30.137 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-02-17T01:22:30.439 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:30.442 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:30.443 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:30.444 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:30.444 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:30.794 INFO:teuthology.orchestra.run.smithi032.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:30.801 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/353 2024-02-17T01:22:30.801 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/353 2024-02-17T01:22:30.801 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:30.807 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:30.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:30.890 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-02-17T01:22:31.244 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:31.248 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:31.248 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:31.249 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:31.249 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:35.124 INFO:teuthology.orchestra.run.smithi032.stdout:generic/354 4s 2024-02-17T01:22:35.131 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/354 2024-02-17T01:22:35.131 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:35.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:35.149 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-02-17T01:22:35.489 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:35.492 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:35.493 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:35.494 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:36.247 INFO:teuthology.orchestra.run.smithi032.stdout:generic/355 1s 2024-02-17T01:22:36.254 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/355 2024-02-17T01:22:36.254 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:36.257 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:36.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:36.310 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-02-17T01:22:36.707 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:36.711 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:36.712 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:36.713 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:37.197 INFO:teuthology.orchestra.run.smithi032.stdout:generic/356 [not run] swapfiles are not supported 2024-02-17T01:22:37.201 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/356 2024-02-17T01:22:37.201 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/356 2024-02-17T01:22:37.201 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:37.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:37.217 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-02-17T01:22:37.401 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:37.404 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:37.405 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:37.406 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout:generic/357 [not run] swapfiles are not supported 2024-02-17T01:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/357 2024-02-17T01:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/357 2024-02-17T01:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:37.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:37.735 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-02-17T01:22:37.905 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:37.909 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:37.909 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:37.910 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:37.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:38.250 INFO:teuthology.orchestra.run.smithi032.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:38.255 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/358 2024-02-17T01:22:38.255 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/358 2024-02-17T01:22:38.255 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:38.264 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:38.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:38.429 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-02-17T01:22:38.756 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:38.759 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:38.760 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:38.760 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:38.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:39.105 INFO:teuthology.orchestra.run.smithi032.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:39.110 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/359 2024-02-17T01:22:39.110 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/359 2024-02-17T01:22:39.110 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:39.119 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:39.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:39.302 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-02-17T01:22:39.622 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:39.626 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:39.626 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:39.627 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:39.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:39.870 INFO:teuthology.orchestra.run.smithi032.stdout:generic/360 0s 2024-02-17T01:22:39.875 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/360 2024-02-17T01:22:39.875 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:39.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:39.893 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-02-17T01:22:40.072 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:40.076 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:40.076 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:40.077 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:40.077 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:40.278 INFO:teuthology.orchestra.run.smithi032.stdout:generic/361 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:40.282 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/361 2024-02-17T01:22:40.282 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/361 2024-02-17T01:22:40.282 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:40.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:40.296 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-02-17T01:22:40.473 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:40.476 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:40.477 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:40.478 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:40.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:40.674 INFO:teuthology.orchestra.run.smithi032.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:40.678 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/362 2024-02-17T01:22:40.678 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/362 2024-02-17T01:22:40.678 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:40.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:40.693 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-02-17T01:22:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:40.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:41.074 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/363 2024-02-17T01:22:41.074 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/363 2024-02-17T01:22:41.074 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:41.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:41.088 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-02-17T01:22:41.272 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:41.276 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:41.276 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:41.277 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:41.277 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:41.479 INFO:teuthology.orchestra.run.smithi032.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:41.483 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/364 2024-02-17T01:22:41.483 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/364 2024-02-17T01:22:41.484 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:41.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:41.497 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-02-17T01:22:41.671 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:41.675 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:41.675 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:41.676 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:41.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:41.881 INFO:teuthology.orchestra.run.smithi032.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:41.884 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/365 2024-02-17T01:22:41.884 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/365 2024-02-17T01:22:41.885 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:41.887 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:41.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:41.898 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-02-17T01:22:42.074 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:42.077 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:42.078 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:42.078 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:42.078 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:42.269 INFO:teuthology.orchestra.run.smithi032.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/366 2024-02-17T01:22:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/366 2024-02-17T01:22:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:42.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:42.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:42.302 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-02-17T01:22:42.486 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:42.490 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:42.490 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:42.491 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:42.491 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:42.703 INFO:teuthology.orchestra.run.smithi032.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:42.707 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/367 2024-02-17T01:22:42.707 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/367 2024-02-17T01:22:42.707 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:42.709 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:42.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:42.730 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-02-17T01:22:42.916 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:42.919 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:42.920 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:42.920 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:42.921 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:43.121 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/368 2024-02-17T01:22:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/368 2024-02-17T01:22:43.122 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:43.124 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:43.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:43.136 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-02-17T01:22:43.316 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:43.319 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:43.320 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:43.321 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:43.517 INFO:teuthology.orchestra.run.smithi032.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:43.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/369 2024-02-17T01:22:43.521 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/369 2024-02-17T01:22:43.521 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:43.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:43.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:43.536 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-02-17T01:22:43.714 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:43.717 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:43.717 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:43.718 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:43.718 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:43.919 INFO:teuthology.orchestra.run.smithi032.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-17T01:22:43.923 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/370 2024-02-17T01:22:43.923 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/370 2024-02-17T01:22:43.923 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:43.925 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:43.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:43.937 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-02-17T01:22:44.108 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:44.111 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:44.111 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:44.112 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:44.112 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:44.320 INFO:teuthology.orchestra.run.smithi032.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:22:44.323 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/371 2024-02-17T01:22:44.324 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/371 2024-02-17T01:22:44.324 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:44.326 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:44.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:44.357 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-02-17T01:22:44.538 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:44.541 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:44.542 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:44.543 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:44.543 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/372 2024-02-17T01:22:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/372 2024-02-17T01:22:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:45.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:45.080 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-02-17T01:22:45.348 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:45.352 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:45.352 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:45.353 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:45.353 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:45.689 INFO:teuthology.orchestra.run.smithi032.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:45.694 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/373 2024-02-17T01:22:45.695 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/373 2024-02-17T01:22:45.695 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:45.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:45.878 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-02-17T01:22:46.148 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:46.151 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:46.152 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:46.152 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:46.152 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:46.457 INFO:teuthology.orchestra.run.smithi032.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-17T01:22:46.494 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/374 2024-02-17T01:22:46.494 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/374 2024-02-17T01:22:46.494 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:46.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:46.692 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-02-17T01:22:46.957 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:46.961 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:46.961 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:46.962 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:47.237 INFO:teuthology.orchestra.run.smithi032.stdout:generic/375 0s 2024-02-17T01:22:47.242 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/375 2024-02-17T01:22:47.242 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:47.244 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:47.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:47.299 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-02-17T01:22:47.678 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:47.683 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:47.683 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:47.684 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:47.684 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:47.904 INFO:teuthology.orchestra.run.smithi032.stdout:generic/376 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:22:47.908 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/376 2024-02-17T01:22:47.908 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/376 2024-02-17T01:22:47.908 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:47.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:47.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:47.931 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-02-17T01:22:48.110 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:48.114 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:48.114 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:48.115 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:48.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:48.450 INFO:teuthology.orchestra.run.smithi032.stdout:generic/377 0s 2024-02-17T01:22:48.455 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/377 2024-02-17T01:22:48.455 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:48.457 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:48.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:48.466 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-02-17T01:22:48.634 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:48.638 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:48.638 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:48.639 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:48.640 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:49.095 INFO:teuthology.orchestra.run.smithi032.stdout:generic/378 1s 2024-02-17T01:22:49.100 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/378 2024-02-17T01:22:49.100 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:49.103 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:49.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:49.156 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-02-17T01:22:49.547 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:49.551 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:49.551 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:49.553 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:49.553 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:49.769 INFO:teuthology.orchestra.run.smithi032.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:49.773 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/379 2024-02-17T01:22:49.773 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/379 2024-02-17T01:22:49.773 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:49.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:49.792 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-02-17T01:22:49.963 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:49.967 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:49.967 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:49.968 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:50.170 INFO:teuthology.orchestra.run.smithi032.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:50.173 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/380 2024-02-17T01:22:50.174 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/380 2024-02-17T01:22:50.174 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:50.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:50.188 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-02-17T01:22:50.360 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:50.363 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:50.364 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:50.364 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:50.568 INFO:teuthology.orchestra.run.smithi032.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:50.571 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/381 2024-02-17T01:22:50.571 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/381 2024-02-17T01:22:50.572 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:50.574 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:50.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:50.586 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-02-17T01:22:50.780 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:50.783 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:50.784 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:50.785 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:50.785 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:50.984 INFO:teuthology.orchestra.run.smithi032.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:50.987 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/382 2024-02-17T01:22:50.987 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/382 2024-02-17T01:22:50.987 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:51.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:51.002 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-02-17T01:22:51.175 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:51.178 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:51.178 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:51.179 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:51.179 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:51.381 INFO:teuthology.orchestra.run.smithi032.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:51.384 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/383 2024-02-17T01:22:51.385 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/383 2024-02-17T01:22:51.385 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:51.387 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:51.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:51.399 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-02-17T01:22:51.576 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:51.580 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:51.580 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:51.581 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:51.581 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:51.782 INFO:teuthology.orchestra.run.smithi032.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:51.785 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/384 2024-02-17T01:22:51.785 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/384 2024-02-17T01:22:51.785 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:51.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:51.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:51.800 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-02-17T01:22:51.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:51.983 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:51.984 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:51.984 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:51.984 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:52.194 INFO:teuthology.orchestra.run.smithi032.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:52.198 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/385 2024-02-17T01:22:52.198 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/385 2024-02-17T01:22:52.198 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:52.200 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:52.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:52.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-02-17T01:22:52.402 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:52.405 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:52.406 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:52.407 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:52.407 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:52.619 INFO:teuthology.orchestra.run.smithi032.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:22:52.622 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/386 2024-02-17T01:22:52.622 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/386 2024-02-17T01:22:52.622 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:52.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:52.637 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-02-17T01:22:52.810 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:52.813 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:52.814 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:52.814 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:53.145 INFO:teuthology.orchestra.run.smithi032.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:22:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/387 2024-02-17T01:22:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/387 2024-02-17T01:22:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:53.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:53.380 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-02-17T01:22:53.626 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:53.629 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:53.630 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:53.631 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:53.846 INFO:teuthology.orchestra.run.smithi032.stdout:generic/388 [not run] require 172.21.15.32:6789:/scratch to be local device 2024-02-17T01:22:53.849 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/388 2024-02-17T01:22:53.849 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/388 2024-02-17T01:22:53.849 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:53.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:53.864 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-02-17T01:22:54.057 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:54.060 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:54.061 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:54.062 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:54.062 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:54.276 INFO:teuthology.orchestra.run.smithi032.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-02-17T01:22:54.279 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/389 2024-02-17T01:22:54.280 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/389 2024-02-17T01:22:54.280 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:54.282 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:54.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:54.294 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-02-17T01:22:54.473 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:54.476 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:54.477 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:54.478 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:54.721 INFO:teuthology.orchestra.run.smithi032.stdout:generic/390 [not run] ceph does not support freezing 2024-02-17T01:22:54.725 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/390 2024-02-17T01:22:54.725 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/390 2024-02-17T01:22:54.725 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:54.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:54.740 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-02-17T01:22:54.919 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:54.923 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:54.923 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:54.924 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:54.924 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:55.143 INFO:teuthology.orchestra.run.smithi032.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:22:55.146 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/391 2024-02-17T01:22:55.146 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/391 2024-02-17T01:22:55.147 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:55.149 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:55.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:55.165 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-02-17T01:22:55.331 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:55.335 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:55.335 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:55.336 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:55.607 INFO:teuthology.orchestra.run.smithi032.stdout:generic/392 [not run] ceph does not support shutdown 2024-02-17T01:22:55.615 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/392 2024-02-17T01:22:55.615 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/392 2024-02-17T01:22:55.615 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:55.617 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:55.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:55.647 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-02-17T01:22:55.820 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:55.823 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:55.824 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:55.824 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:56.427 INFO:teuthology.orchestra.run.smithi032.stdout:generic/393 1s 2024-02-17T01:22:56.432 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/393 2024-02-17T01:22:56.432 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:56.434 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:56.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:56.443 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-02-17T01:22:56.624 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:56.627 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:56.628 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:56.628 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:56.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:56.873 INFO:teuthology.orchestra.run.smithi032.stdout:generic/394 0s 2024-02-17T01:22:56.878 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/394 2024-02-17T01:22:56.878 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:56.880 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:56.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:56.927 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-02-17T01:22:57.281 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:57.287 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:57.288 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:57.289 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:57.290 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:57.626 INFO:teuthology.orchestra.run.smithi032.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-02-17T01:22:57.634 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/395 2024-02-17T01:22:57.634 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/395 2024-02-17T01:22:57.634 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:57.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:57.665 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-02-17T01:22:57.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:57.916 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:57.917 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:57.918 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:57.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:58.353 INFO:teuthology.orchestra.run.smithi032.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-02-17T01:22:58.373 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/396 2024-02-17T01:22:58.373 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/396 2024-02-17T01:22:58.373 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:58.375 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:58.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:58.393 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-02-17T01:22:58.634 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:58.638 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:58.639 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:58.640 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:58.640 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:59.053 INFO:teuthology.orchestra.run.smithi032.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-02-17T01:22:59.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/397 2024-02-17T01:22:59.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/397 2024-02-17T01:22:59.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:59.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:59.088 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-02-17T01:22:59.268 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:59.272 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:59.272 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:59.274 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:59.274 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:59.604 INFO:teuthology.orchestra.run.smithi032.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-02-17T01:22:59.612 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/398 2024-02-17T01:22:59.612 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/398 2024-02-17T01:22:59.612 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:22:59.614 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:22:59.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:22:59.626 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-02-17T01:22:59.803 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:22:59.806 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:22:59.806 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:22:59.807 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:22:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:00.123 INFO:teuthology.orchestra.run.smithi032.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-02-17T01:23:00.130 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/399 2024-02-17T01:23:00.130 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/399 2024-02-17T01:23:00.130 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:00.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:00.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:00.164 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-02-17T01:23:00.351 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:00.355 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:00.355 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:00.356 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:00.356 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:00.587 INFO:teuthology.orchestra.run.smithi032.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T01:23:00.591 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/400 2024-02-17T01:23:00.591 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/400 2024-02-17T01:23:00.591 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:00.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:00.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:00.615 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-02-17T01:23:00.797 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:00.800 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:00.801 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:00.802 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:01.457 INFO:teuthology.orchestra.run.smithi032.stdout:generic/401 1s 2024-02-17T01:23:01.465 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/401 2024-02-17T01:23:01.466 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:01.468 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:01.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:01.483 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-02-17T01:23:01.865 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:01.869 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:01.869 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:01.870 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:01.870 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:02.187 INFO:teuthology.orchestra.run.smithi032.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-02-17T01:23:02.195 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/402 2024-02-17T01:23:02.195 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/402 2024-02-17T01:23:02.195 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:02.197 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:02.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:02.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-02-17T01:23:02.391 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:02.395 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:02.395 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:02.396 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:02.396 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:generic/403 0s 2024-02-17T01:23:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/403 2024-02-17T01:23:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:02.905 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:02.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:02.913 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-02-17T01:23:03.084 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:03.088 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:03.088 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:03.089 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:03.311 INFO:teuthology.orchestra.run.smithi032.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:23:03.315 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/404 2024-02-17T01:23:03.315 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/404 2024-02-17T01:23:03.315 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:03.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:03.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:03.332 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-02-17T01:23:03.506 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:03.511 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:03.743 INFO:teuthology.orchestra.run.smithi032.stdout:generic/405 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:23:03.747 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/405 2024-02-17T01:23:03.747 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/405 2024-02-17T01:23:03.747 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:03.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:03.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:03.772 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-02-17T01:23:03.951 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:03.954 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:03.955 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:03.956 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:03.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:05.338 INFO:teuthology.orchestra.run.smithi032.stdout:generic/406 1s 2024-02-17T01:23:05.344 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/406 2024-02-17T01:23:05.344 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:05.346 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:05.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:05.354 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-02-17T01:23:05.533 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:05.537 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:05.537 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:05.538 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:05.824 INFO:teuthology.orchestra.run.smithi032.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:23:05.828 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/407 2024-02-17T01:23:05.828 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/407 2024-02-17T01:23:05.828 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:05.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:05.909 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-02-17T01:23:06.286 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:06.289 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:06.289 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:06.291 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:06.291 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:06.525 INFO:teuthology.orchestra.run.smithi032.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T01:23:06.528 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/408 2024-02-17T01:23:06.528 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/408 2024-02-17T01:23:06.529 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:06.531 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:06.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:06.572 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-02-17T01:23:06.951 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:06.957 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:06.957 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:06.959 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:06.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:07.184 INFO:teuthology.orchestra.run.smithi032.stdout:generic/409 [not run] require 172.21.15.32:6789:/scratch to be local device 2024-02-17T01:23:07.188 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/409 2024-02-17T01:23:07.188 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/409 2024-02-17T01:23:07.188 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:07.190 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:07.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:07.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-02-17T01:23:07.395 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:07.399 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:07.399 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:07.400 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:07.400 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:07.607 INFO:teuthology.orchestra.run.smithi032.stdout:generic/410 [not run] require 172.21.15.32:6789:/scratch to be local device 2024-02-17T01:23:07.611 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/410 2024-02-17T01:23:07.611 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/410 2024-02-17T01:23:07.611 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:07.613 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:07.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:07.626 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-02-17T01:23:07.800 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:07.804 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:07.804 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:07.805 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:07.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:08.009 INFO:teuthology.orchestra.run.smithi032.stdout:generic/411 [not run] require 172.21.15.32:6789:/scratch to be local device 2024-02-17T01:23:08.013 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/411 2024-02-17T01:23:08.013 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/411 2024-02-17T01:23:08.013 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:08.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:08.027 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-02-17T01:23:08.203 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:08.206 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:08.207 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:08.208 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:08.208 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:08.648 INFO:teuthology.orchestra.run.smithi032.stdout:generic/412 0s 2024-02-17T01:23:08.653 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/412 2024-02-17T01:23:08.653 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:08.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:08.664 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-02-17T01:23:08.850 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:08.854 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:08.854 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:08.855 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:09.125 INFO:teuthology.orchestra.run.smithi032.stdout:generic/413 [not run] mount 172.21.15.32:6789:/scratch with dax failed 2024-02-17T01:23:09.129 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/413 2024-02-17T01:23:09.129 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/413 2024-02-17T01:23:09.129 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:09.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:09.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:09.144 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-02-17T01:23:09.322 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:09.326 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:09.326 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:09.327 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:09.664 INFO:teuthology.orchestra.run.smithi032.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:23:09.671 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/414 2024-02-17T01:23:09.671 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/414 2024-02-17T01:23:09.671 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:09.674 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:09.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:09.853 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-02-17T01:23:10.125 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:10.129 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:10.129 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:10.130 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:10.475 INFO:teuthology.orchestra.run.smithi032.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:23:10.480 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/415 2024-02-17T01:23:10.481 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/415 2024-02-17T01:23:10.481 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:10.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:10.695 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-02-17T01:23:10.961 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:10.964 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:10.965 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:10.966 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:11.167 INFO:teuthology.orchestra.run.smithi032.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:23:11.171 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/416 2024-02-17T01:23:11.171 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/416 2024-02-17T01:23:11.171 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:11.173 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:11.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:11.186 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-02-17T01:23:11.361 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:11.365 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:11.365 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:11.366 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:11.366 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:11.638 INFO:teuthology.orchestra.run.smithi032.stdout:generic/417 [not run] ceph does not support shutdown 2024-02-17T01:23:11.646 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/417 2024-02-17T01:23:11.646 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/417 2024-02-17T01:23:11.646 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:11.648 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:11.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:11.660 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-02-17T01:23:11.842 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:11.845 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:11.846 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:11.846 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:12.085 INFO:teuthology.orchestra.run.smithi032.stdout:generic/418 [not run] require 172.21.15.32:6789:/test to be valid block disk 2024-02-17T01:23:12.089 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/418 2024-02-17T01:23:12.089 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/418 2024-02-17T01:23:12.089 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:12.091 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:12.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:12.108 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-02-17T01:23:12.292 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:12.296 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:12.296 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:12.297 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:12.608 INFO:teuthology.orchestra.run.smithi032.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-02-17T01:23:12.616 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/419 2024-02-17T01:23:12.616 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/419 2024-02-17T01:23:12.616 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:12.618 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:12.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:12.630 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-02-17T01:23:12.815 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:12.819 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:12.819 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:12.820 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:12.820 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:13.132 INFO:teuthology.orchestra.run.smithi032.stdout:generic/420 1s 2024-02-17T01:23:13.137 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/420 2024-02-17T01:23:13.137 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:13.139 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:13.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:13.198 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-02-17T01:23:13.595 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:13.598 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:13.598 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:13.599 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:13.915 INFO:teuthology.orchestra.run.smithi032.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-02-17T01:23:13.924 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/421 2024-02-17T01:23:13.924 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/421 2024-02-17T01:23:13.924 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:13.926 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:13.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:13.938 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-02-17T01:23:14.125 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:14.129 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:14.129 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:14.130 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:14.359 INFO:teuthology.orchestra.run.smithi032.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T01:23:14.363 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/422 2024-02-17T01:23:14.363 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/422 2024-02-17T01:23:14.363 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:14.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:14.400 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-02-17T01:23:14.582 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:14.585 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:14.586 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:14.586 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:14.587 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:14.902 INFO:teuthology.orchestra.run.smithi032.stdout:generic/423 0s 2024-02-17T01:23:14.907 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/423 2024-02-17T01:23:14.907 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:14.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:14.969 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-02-17T01:23:15.342 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:15.346 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:15.347 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:15.348 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:15.348 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:15.560 INFO:teuthology.orchestra.run.smithi032.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-02-17T01:23:15.564 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/424 2024-02-17T01:23:15.564 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/424 2024-02-17T01:23:15.564 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:15.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:15.584 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-02-17T01:23:15.766 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:15.770 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:15.770 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:15.771 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:15.771 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:16.013 INFO:teuthology.orchestra.run.smithi032.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-02-17T01:23:16.016 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/425 2024-02-17T01:23:16.017 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/425 2024-02-17T01:23:16.017 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:16.019 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:16.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:16.062 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-02-17T01:23:16.455 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:16.459 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:16.460 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:16.460 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:16.460 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:39.764 INFO:teuthology.orchestra.run.smithi032.stdout:generic/426 23s 2024-02-17T01:23:39.835 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/426 2024-02-17T01:23:39.835 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:40.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:40.033 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-02-17T01:23:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:41.377 INFO:teuthology.orchestra.run.smithi032.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:23:41.380 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/427 2024-02-17T01:23:41.381 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/427 2024-02-17T01:23:41.381 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:41.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:41.398 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-02-17T01:23:41.575 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:41.578 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:41.578 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:41.579 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:41.579 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:41.820 INFO:teuthology.orchestra.run.smithi032.stdout:generic/428 0s 2024-02-17T01:23:41.825 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/428 2024-02-17T01:23:41.825 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:41.827 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:41.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:41.846 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-02-17T01:23:42.029 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:42.033 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:42.033 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:42.034 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:42.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:42.380 INFO:teuthology.orchestra.run.smithi032.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-02-17T01:23:42.387 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/429 2024-02-17T01:23:42.387 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/429 2024-02-17T01:23:42.388 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:42.390 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:42.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:42.401 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-02-17T01:23:42.598 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:42.604 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:42.604 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:42.604 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:42.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:42.896 INFO:teuthology.orchestra.run.smithi032.stdout:generic/430 0s 2024-02-17T01:23:42.901 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/430 2024-02-17T01:23:42.901 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:42.903 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:42.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:42.963 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-02-17T01:23:43.380 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:43.384 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:43.384 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:43.385 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:43.385 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:43.647 INFO:teuthology.orchestra.run.smithi032.stdout:generic/431 0s 2024-02-17T01:23:43.653 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/431 2024-02-17T01:23:43.653 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:43.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:43.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:43.721 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-02-17T01:23:44.151 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:44.155 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:44.155 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:44.156 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:44.452 INFO:teuthology.orchestra.run.smithi032.stdout:generic/432 0s 2024-02-17T01:23:44.458 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/432 2024-02-17T01:23:44.458 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:44.460 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:44.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:44.512 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-02-17T01:23:44.955 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:44.958 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:44.959 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:44.959 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:45.219 INFO:teuthology.orchestra.run.smithi032.stdout:generic/433 0s 2024-02-17T01:23:45.224 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/433 2024-02-17T01:23:45.224 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:45.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:45.283 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-02-17T01:23:45.708 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:45.711 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:45.712 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:45.713 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:45.988 INFO:teuthology.orchestra.run.smithi032.stdout:generic/434 0s 2024-02-17T01:23:45.993 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/434 2024-02-17T01:23:45.993 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:46.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:46.051 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-02-17T01:23:46.457 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:46.460 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:46.461 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:46.462 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:46.462 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:46.785 INFO:teuthology.orchestra.run.smithi032.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-02-17T01:23:46.794 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/435 2024-02-17T01:23:46.795 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/435 2024-02-17T01:23:46.795 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:46.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:46.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:46.808 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-02-17T01:23:46.994 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:46.998 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:46.998 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:46.999 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:46.999 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:47.496 INFO:teuthology.orchestra.run.smithi032.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:23:47.500 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/436 2024-02-17T01:23:47.500 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/436 2024-02-17T01:23:47.500 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:47.503 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:47.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:47.533 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-02-17T01:23:47.977 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:47.981 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:47.981 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:47.982 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:47.982 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:48.852 INFO:teuthology.orchestra.run.smithi032.stdout:generic/437 0s 2024-02-17T01:23:48.857 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/437 2024-02-17T01:23:48.857 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:23:48.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:23:48.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:23:48.876 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-02-17T01:23:49.058 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:23:49.061 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:23:49.062 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:23:49.063 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:23:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:24:32.988 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T01:24:32.999+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47802) UID: 0 2024-02-17T01:24:32.989 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T01:24:32.999+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47802) UID: 0 2024-02-17T01:24:32.989 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T01:24:32.999+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47802) UID: 0 2024-02-17T01:24:32.989 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T01:24:32.999+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47802) UID: 0 2024-02-17T01:25:02.058 INFO:teuthology.orchestra.run.smithi032.stdout:generic/438 73s 2024-02-17T01:25:02.062 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/438 2024-02-17T01:25:02.062 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:02.065 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:02.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:02.081 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-02-17T01:25:02.252 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:02.256 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:02.256 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:02.257 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:02.258 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:03.491 INFO:teuthology.orchestra.run.smithi032.stdout:generic/439 1s 2024-02-17T01:25:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/439 2024-02-17T01:25:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:03.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:03.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:03.535 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-02-17T01:25:03.716 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:03.720 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:03.720 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:03.721 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:03.721 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:04.112 INFO:teuthology.orchestra.run.smithi032.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-02-17T01:25:04.120 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/440 2024-02-17T01:25:04.120 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/440 2024-02-17T01:25:04.120 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:04.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:04.134 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-02-17T01:25:04.314 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:04.318 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:04.318 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:04.319 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:04.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:04.738 INFO:teuthology.orchestra.run.smithi032.stdout:generic/441 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:25:04.741 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/441 2024-02-17T01:25:04.742 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/441 2024-02-17T01:25:04.742 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:04.744 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:04.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:04.756 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-02-17T01:25:04.938 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:04.941 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:04.941 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:04.943 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:05.318 INFO:teuthology.orchestra.run.smithi032.stdout:generic/442 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:25:05.322 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/442 2024-02-17T01:25:05.322 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/442 2024-02-17T01:25:05.322 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:05.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:05.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:05.337 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-02-17T01:25:05.513 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:05.517 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:05.517 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:05.518 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:05.773 INFO:teuthology.orchestra.run.smithi032.stdout:generic/443 0s 2024-02-17T01:25:05.778 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/443 2024-02-17T01:25:05.779 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:05.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:05.798 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-02-17T01:25:05.970 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:05.974 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:05.974 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:05.975 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:05.975 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:06.273 INFO:teuthology.orchestra.run.smithi032.stdout:generic/444 0s 2024-02-17T01:25:06.279 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/444 2024-02-17T01:25:06.279 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:06.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:06.299 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-02-17T01:25:06.479 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:06.483 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:06.483 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:06.484 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:06.971 INFO:teuthology.orchestra.run.smithi032.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:25:06.975 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/445 2024-02-17T01:25:06.975 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/445 2024-02-17T01:25:06.975 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:06.977 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:07.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:07.018 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-02-17T01:25:07.414 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:07.417 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:07.418 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:07.419 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:07.419 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:24.493 INFO:teuthology.orchestra.run.smithi032.stdout:generic/446 17s 2024-02-17T01:25:24.508 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/446 2024-02-17T01:25:24.508 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:24.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:24.525 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-02-17T01:25:24.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:24.915 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:24.915 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:24.916 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:24.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:25.283 INFO:teuthology.orchestra.run.smithi032.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:25:25.290 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/447 2024-02-17T01:25:25.290 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/447 2024-02-17T01:25:25.290 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:25.293 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:25.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:25.447 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-02-17T01:25:25.729 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:25.733 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:25.733 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:25.734 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:25.734 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:26.552 INFO:teuthology.orchestra.run.smithi032.stdout:generic/448 1s 2024-02-17T01:25:26.557 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/448 2024-02-17T01:25:26.557 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:26.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:26.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:26.606 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-02-17T01:25:27.004 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:27.010 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:27.010 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:27.012 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:27.258 INFO:teuthology.orchestra.run.smithi032.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T01:25:27.261 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/449 2024-02-17T01:25:27.262 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/449 2024-02-17T01:25:27.262 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:27.264 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:27.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:27.299 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-02-17T01:25:27.694 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:27.698 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:27.698 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:27.700 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:28.264 INFO:teuthology.orchestra.run.smithi032.stdout:generic/450 1s 2024-02-17T01:25:28.270 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/450 2024-02-17T01:25:28.270 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:28.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:28.312 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-02-17T01:25:28.720 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:28.724 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:28.724 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:28.725 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:28.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:59.067 INFO:teuthology.orchestra.run.smithi032.stdout:generic/451 31s 2024-02-17T01:25:59.072 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/451 2024-02-17T01:25:59.072 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:59.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:59.123 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-02-17T01:25:59.519 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:25:59.523 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:25:59.523 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:25:59.524 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:25:59.524 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:59.883 INFO:teuthology.orchestra.run.smithi032.stdout:generic/452 0s 2024-02-17T01:25:59.889 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/452 2024-02-17T01:25:59.889 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:25:59.891 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:25:59.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:25:59.900 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-02-17T01:26:00.078 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:00.082 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:00.082 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:00.083 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:00.083 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:00.292 INFO:teuthology.orchestra.run.smithi032.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-02-17T01:26:00.296 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/453 2024-02-17T01:26:00.296 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/453 2024-02-17T01:26:00.296 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:00.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:00.311 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-02-17T01:26:00.491 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:00.494 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:00.495 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:00.496 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:00.496 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:00.709 INFO:teuthology.orchestra.run.smithi032.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-02-17T01:26:00.713 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/454 2024-02-17T01:26:00.713 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/454 2024-02-17T01:26:00.714 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:00.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:00.736 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-02-17T01:26:00.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:00.914 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:00.915 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:00.916 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:00.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:01.196 INFO:teuthology.orchestra.run.smithi032.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-02-17T01:26:01.200 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/455 2024-02-17T01:26:01.200 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/455 2024-02-17T01:26:01.200 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:01.202 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:01.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:01.215 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-02-17T01:26:01.392 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:01.396 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:01.396 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:01.397 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:01.397 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:01.627 INFO:teuthology.orchestra.run.smithi032.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T01:26:01.631 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/456 2024-02-17T01:26:01.631 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/456 2024-02-17T01:26:01.631 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:01.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:01.649 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-02-17T01:26:01.835 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:01.838 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:01.839 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:01.839 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:02.254 INFO:teuthology.orchestra.run.smithi032.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:26:02.261 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/457 2024-02-17T01:26:02.261 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/457 2024-02-17T01:26:02.261 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:02.265 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:02.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:02.488 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-02-17T01:26:02.687 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:02.691 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:02.691 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:02.692 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T01:26:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/458 2024-02-17T01:26:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/458 2024-02-17T01:26:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:03.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:03.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-02-17T01:26:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:03.502 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:03.503 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:03.504 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:03.504 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:03.956 INFO:teuthology.orchestra.run.smithi032.stdout:generic/459 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:26:03.959 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/459 2024-02-17T01:26:03.959 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/459 2024-02-17T01:26:03.960 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:03.962 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:03.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:03.976 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-02-17T01:26:04.170 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:04.174 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:04.174 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:04.175 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:05.675 INFO:teuthology.orchestra.run.smithi032.stdout:generic/460 1s 2024-02-17T01:26:05.680 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/460 2024-02-17T01:26:05.680 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:05.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:05.690 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-02-17T01:26:05.863 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:05.868 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:05.868 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:05.868 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:06.163 INFO:teuthology.orchestra.run.smithi032.stdout:generic/461 [not run] ceph does not support shutdown 2024-02-17T01:26:06.166 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/461 2024-02-17T01:26:06.166 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/461 2024-02-17T01:26:06.167 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:06.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:06.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:06.198 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-02-17T01:26:06.378 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:06.382 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:06.382 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:06.383 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:06.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:06.648 INFO:teuthology.orchestra.run.smithi032.stdout:generic/462 [not run] mount 172.21.15.32:6789:/scratch with dax failed 2024-02-17T01:26:06.651 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/462 2024-02-17T01:26:06.652 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/462 2024-02-17T01:26:06.652 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:06.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:06.666 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-02-17T01:26:06.843 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:06.848 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:06.849 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:06.850 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:06.850 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:07.227 INFO:teuthology.orchestra.run.smithi032.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-02-17T01:26:07.230 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/463 2024-02-17T01:26:07.230 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/463 2024-02-17T01:26:07.230 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:26:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:26:07.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:26:07.290 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-02-17T01:26:07.671 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:26:07.677 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:26:07.677 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:26:07.680 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:26:07.680 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:generic/464 56s 2024-02-17T01:27:03.189 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/464 2024-02-17T01:27:03.189 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:03.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:03.200 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-02-17T01:27:03.372 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:03.376 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:03.376 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:03.377 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:07.300 INFO:teuthology.orchestra.run.smithi032.stdout:generic/465 4s 2024-02-17T01:27:07.309 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/465 2024-02-17T01:27:07.309 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:07.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:07.323 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-02-17T01:27:07.724 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:07.727 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:07.728 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:07.729 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:07.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:07.958 INFO:teuthology.orchestra.run.smithi032.stdout:generic/466 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:27:07.963 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/466 2024-02-17T01:27:07.963 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/466 2024-02-17T01:27:07.964 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:07.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:07.983 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-02-17T01:27:08.166 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:08.170 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:08.170 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:08.171 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:08.171 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:14.184 INFO:teuthology.orchestra.run.smithi032.stdout:generic/467 6s 2024-02-17T01:27:14.237 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/467 2024-02-17T01:27:14.237 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:14.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:14.454 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-02-17T01:27:15.442 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:15.445 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:15.446 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:15.446 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:15.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:15.762 INFO:teuthology.orchestra.run.smithi032.stdout:generic/468 [not run] ceph does not support shutdown 2024-02-17T01:27:15.768 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/468 2024-02-17T01:27:15.768 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/468 2024-02-17T01:27:15.768 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:15.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:15.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:15.780 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-02-17T01:27:15.957 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:15.960 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:15.960 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:15.961 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:15.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:16.193 INFO:teuthology.orchestra.run.smithi032.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T01:27:16.197 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/469 2024-02-17T01:27:16.197 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/469 2024-02-17T01:27:16.197 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:16.199 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:16.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:16.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-02-17T01:27:16.387 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:16.390 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:16.390 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:16.392 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:16.392 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:16.659 INFO:teuthology.orchestra.run.smithi032.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-02-17T01:27:16.663 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/470 2024-02-17T01:27:16.663 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/470 2024-02-17T01:27:16.663 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:16.665 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:16.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:16.676 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-02-17T01:27:16.857 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:16.861 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:16.861 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:16.862 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:16.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:58.419 INFO:teuthology.orchestra.run.smithi032.stdout:generic/471 42s 2024-02-17T01:27:58.425 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/471 2024-02-17T01:27:58.425 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:58.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:58.515 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-02-17T01:27:59.108 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:27:59.115 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:27:59.115 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:27:59.117 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:27:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:59.899 INFO:teuthology.orchestra.run.smithi032.stdout:generic/472 [not run] swapfiles are not supported 2024-02-17T01:27:59.904 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/472 2024-02-17T01:27:59.904 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/472 2024-02-17T01:27:59.904 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:27:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:27:59.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:27:59.942 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-02-17T01:28:00.169 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:28:00.173 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:28:00.173 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:28:00.174 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:28:00.174 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:28:00.461 INFO:teuthology.orchestra.run.smithi032.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-17T01:28:00.465 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/473 2024-02-17T01:28:00.465 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/473 2024-02-17T01:28:00.465 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:28:00.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:28:00.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:28:00.481 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-02-17T01:28:00.661 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:28:00.664 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:28:00.665 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:28:00.666 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:28:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:28:00.927 INFO:teuthology.orchestra.run.smithi032.stdout:generic/474 [not run] ceph does not support shutdown 2024-02-17T01:28:00.932 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/474 2024-02-17T01:28:00.932 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/474 2024-02-17T01:28:00.932 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:28:00.935 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:28:00.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:28:00.945 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-02-17T01:28:01.112 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:28:01.116 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:28:01.116 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:28:01.117 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:28:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:28:01.342 INFO:teuthology.orchestra.run.smithi032.stdout:generic/475 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T01:28:01.346 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/475 2024-02-17T01:28:01.346 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/475 2024-02-17T01:28:01.346 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T01:28:01.348 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:28:01.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T01:28:01.358 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-02-17T01:28:01.554 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T01:28:01.558 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T01:28:01.558 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T01:28:01.559 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T01:28:01.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T01:29:57.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:29:57.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:29:57.196 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T01:29:57.211+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594815) UID: 0 2024-02-17T01:29:57.197 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T01:29:57.211+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594815) UID: 0 2024-02-17T01:29:57.200 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T01:29:57.211+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594815) UID: 0 2024-02-17T01:29:57.202 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T01:29:57.213+0000 7f22a5a92640 -1 received signal: Hangup from (PID: 594815) UID: 0 2024-02-17T01:36:18.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:36:18.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:36:18.557 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T01:36:18.574+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594930) UID: 0 2024-02-17T01:36:18.557 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T01:36:18.574+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594930) UID: 0 2024-02-17T01:36:18.558 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T01:36:18.574+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594930) UID: 0 2024-02-17T01:36:18.558 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T01:36:18.574+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594930) UID: 0 2024-02-17T01:36:18.566 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T01:36:18.584+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48097) UID: 0 2024-02-17T01:36:18.567 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T01:36:18.584+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48097) UID: 0 2024-02-17T01:40:15.338 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T01:40:15.355+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48171) UID: 0 2024-02-17T01:40:15.344 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T01:40:15.355+0000 7fec86e01640 -1 Fail to open '/proc/48171/cmdline' error = (2) No such file or directory 2024-02-17T01:40:15.344 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T01:40:15.355+0000 7fec86e01640 -1 received signal: Hangup from (PID: 48171) UID: 0 2024-02-17T01:40:15.344 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T01:40:15.363+0000 7f0f1542f640 -1 Fail to open '/proc/48171/cmdline' error = (2) No such file or directory 2024-02-17T01:40:15.345 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T01:40:15.363+0000 7fa7979e8640 -1 Fail to open '/proc/48171/cmdline' error = (2) No such file or directory 2024-02-17T01:40:15.352 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T01:40:15.363+0000 7fa7979e8640 -1 received signal: Hangup from (PID: 48171) UID: 0 2024-02-17T01:40:15.353 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T01:40:15.363+0000 7f0f1542f640 -1 received signal: Hangup from (PID: 48171) UID: 0 2024-02-17T01:49:39.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:49:39.903 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T01:49:40.209 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T01:49:40.228+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595163) UID: 0 2024-02-17T01:49:40.211 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T01:49:40.226+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595163) UID: 0 2024-02-17T01:49:40.212 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T01:49:40.228+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595163) UID: 0 2024-02-17T01:49:40.218 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T01:49:40.237+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595163) UID: 0 2024-02-17T01:49:40.580 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T01:49:40.600+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48238) UID: 0 2024-02-17T01:49:40.580 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T01:49:40.600+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48238) UID: 0 2024-02-17T01:54:18.753 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T01:54:18.772+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48270) UID: 0 2024-02-17T01:54:18.754 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T01:54:18.772+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48270) UID: 0 2024-02-17T01:54:18.754 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T01:54:18.772+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48270) UID: 0 2024-02-17T01:54:18.754 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T01:54:18.772+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48270) UID: 0 2024-02-17T02:05:41.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:05:41.908 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:05:42.126 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T02:05:42.149+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48347) UID: 0 2024-02-17T02:05:42.127 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T02:05:42.149+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48347) UID: 0 2024-02-17T02:05:43.262 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T02:05:43.285+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595346) UID: 0 2024-02-17T02:05:43.262 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T02:05:43.285+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595346) UID: 0 2024-02-17T02:05:43.266 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T02:05:43.286+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595346) UID: 0 2024-02-17T02:05:43.266 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T02:05:43.285+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595346) UID: 0 2024-02-17T02:12:27.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:12:27.294 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:12:57.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:12:57.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:13:28.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:13:28.115 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:13:58.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:13:58.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:14:28.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:14:28.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:14:28.815 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T02:14:28.840+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595535) UID: 0 2024-02-17T02:14:28.816 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T02:14:28.840+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595535) UID: 0 2024-02-17T02:14:28.816 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T02:14:28.840+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595535) UID: 0 2024-02-17T02:14:28.816 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T02:14:28.840+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595535) UID: 0 2024-02-17T02:19:17.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:19:17.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:19:17.377 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T02:19:17.402+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48557) UID: 0 2024-02-17T02:19:17.377 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T02:19:17.402+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48557) UID: 0 2024-02-17T02:19:17.629 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T02:19:17.654+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595590) UID: 0 2024-02-17T02:19:17.629 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T02:19:17.654+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595590) UID: 0 2024-02-17T02:19:17.632 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T02:19:17.658+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595590) UID: 0 2024-02-17T02:19:17.647 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T02:19:17.667+0000 7f22a5a92640 -1 Fail to open '/proc/595590/cmdline' error = (2) No such file or directory 2024-02-17T02:19:17.647 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T02:19:17.667+0000 7f22a5a92640 -1 received signal: Hangup from (PID: 595590) UID: 0 2024-02-17T02:23:40.675 INFO:teuthology.orchestra.run.smithi032.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.1.log.1: 2024-02-17T02:23:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: stdin: file size changed while zipping 2024-02-17T02:25:11.871 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T02:25:11.883+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48579) UID: 0 2024-02-17T02:25:11.872 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T02:25:11.883+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48579) UID: 0 2024-02-17T02:25:11.873 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T02:25:11.883+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48579) UID: 0 2024-02-17T02:25:11.873 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T02:25:11.883+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48579) UID: 0 2024-02-17T02:40:57.030 INFO:teuthology.orchestra.run.smithi032.stdout:generic/476 4375s 2024-02-17T02:40:57.078 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/476 2024-02-17T02:40:57.078 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:40:57.081 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:40:57.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:40:57.123 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-02-17T02:41:03.525 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:41:03.534 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:41:03.534 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:41:03.535 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:41:03.535 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:41:19.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:41:19.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T02:41:19.118 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T02:41:19.115+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596135) UID: 0 2024-02-17T02:41:19.118 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T02:41:19.115+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596135) UID: 0 2024-02-17T02:41:19.118 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T02:41:19.116+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596135) UID: 0 2024-02-17T02:41:19.119 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T02:41:19.116+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596135) UID: 0 2024-02-17T02:41:20.883 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T02:41:20.880+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48710) UID: 0 2024-02-17T02:41:20.883 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T02:41:20.880+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48710) UID: 0 2024-02-17T02:48:02.808 INFO:teuthology.orchestra.run.smithi032.stdout:generic/477 14s 2024-02-17T02:48:02.885 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/477 2024-02-17T02:48:02.885 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:02.889 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:03.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:03.010 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-02-17T02:48:04.171 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:04.177 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:14.818 INFO:teuthology.orchestra.run.smithi032.stdout:generic/478 10s 2024-02-17T02:48:14.825 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/478 2024-02-17T02:48:14.826 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:14.828 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:14.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:14.856 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-02-17T02:48:15.105 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:15.110 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:15.110 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:15.111 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:15.506 INFO:teuthology.orchestra.run.smithi032.stdout:generic/479 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:15.511 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/479 2024-02-17T02:48:15.512 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/479 2024-02-17T02:48:15.512 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:15.514 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:15.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:15.548 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-02-17T02:48:15.796 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:15.803 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:15.804 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:15.805 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:15.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:16.135 INFO:teuthology.orchestra.run.smithi032.stdout:generic/480 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:16.141 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/480 2024-02-17T02:48:16.141 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/480 2024-02-17T02:48:16.141 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:16.144 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:16.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:16.185 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-02-17T02:48:16.435 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:16.439 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:16.439 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:16.440 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:16.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:16.737 INFO:teuthology.orchestra.run.smithi032.stdout:generic/481 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:16.744 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/481 2024-02-17T02:48:16.744 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/481 2024-02-17T02:48:16.744 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:16.746 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:16.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:16.763 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-02-17T02:48:17.016 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:17.020 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:17.021 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:17.022 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:17.022 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:17.369 INFO:teuthology.orchestra.run.smithi032.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-02-17T02:48:17.373 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/482 2024-02-17T02:48:17.373 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/482 2024-02-17T02:48:17.374 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:17.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:17.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:17.397 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-02-17T02:48:17.631 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:17.635 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:17.636 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:17.637 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:17.937 INFO:teuthology.orchestra.run.smithi032.stdout:generic/483 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:17.941 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/483 2024-02-17T02:48:17.941 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/483 2024-02-17T02:48:17.941 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:17.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:17.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:17.971 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-02-17T02:48:18.223 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:18.227 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:18.228 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:18.229 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:18.536 INFO:teuthology.orchestra.run.smithi032.stdout:generic/484 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:18.540 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/484 2024-02-17T02:48:18.540 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/484 2024-02-17T02:48:18.541 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:18.544 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:18.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:18.560 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-02-17T02:48:18.808 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:18.812 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:18.813 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:18.814 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:18.814 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:19.141 INFO:teuthology.orchestra.run.smithi032.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T02:48:19.146 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/485 2024-02-17T02:48:19.146 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/485 2024-02-17T02:48:19.146 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:19.149 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:19.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:19.178 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-02-17T02:48:19.420 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:19.423 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:19.424 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:19.425 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:19.993 INFO:teuthology.orchestra.run.smithi032.stdout:generic/486 0s 2024-02-17T02:48:19.999 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/486 2024-02-17T02:48:19.999 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:20.002 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:20.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:20.014 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-02-17T02:48:20.254 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:20.258 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:20.258 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:20.259 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:20.259 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:20.564 INFO:teuthology.orchestra.run.smithi032.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-02-17T02:48:20.568 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/487 2024-02-17T02:48:20.569 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/487 2024-02-17T02:48:20.569 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:20.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:20.591 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-02-17T02:48:20.843 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:20.848 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:20.851 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:20.852 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:21.163 INFO:teuthology.orchestra.run.smithi032.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-17T02:48:21.167 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/488 2024-02-17T02:48:21.167 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/488 2024-02-17T02:48:21.167 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:21.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:21.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:21.199 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-02-17T02:48:21.435 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:21.440 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:21.441 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:21.445 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:21.446 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:21.739 INFO:teuthology.orchestra.run.smithi032.stdout:generic/489 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:21.743 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/489 2024-02-17T02:48:21.743 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/489 2024-02-17T02:48:21.744 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:21.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:21.765 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-02-17T02:48:22.017 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:22.027 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:22.027 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:22.028 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:22.028 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:23.939 INFO:teuthology.orchestra.run.smithi032.stdout:generic/490 1s 2024-02-17T02:48:23.946 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/490 2024-02-17T02:48:23.946 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:23.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:24.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:24.056 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-02-17T02:48:24.502 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:24.506 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:24.506 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:24.508 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:24.804 INFO:teuthology.orchestra.run.smithi032.stdout:generic/491 [not run] ceph does not support freezing 2024-02-17T02:48:24.809 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/491 2024-02-17T02:48:24.809 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/491 2024-02-17T02:48:24.809 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:24.816 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:24.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:24.833 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-02-17T02:48:25.090 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:25.095 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:25.096 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:25.097 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:25.097 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:25.397 INFO:teuthology.orchestra.run.smithi032.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-02-17T02:48:25.402 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/492 2024-02-17T02:48:25.402 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/492 2024-02-17T02:48:25.402 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:25.404 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:25.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:25.422 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-02-17T02:48:25.674 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:25.679 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:25.680 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:25.681 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:25.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:26.170 INFO:teuthology.orchestra.run.smithi032.stdout:generic/493 [not run] swapfiles are not supported 2024-02-17T02:48:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/493 2024-02-17T02:48:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/493 2024-02-17T02:48:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:26.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:26.203 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-02-17T02:48:26.446 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:26.450 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:26.451 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:26.456 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:26.928 INFO:teuthology.orchestra.run.smithi032.stdout:generic/494 [not run] swapfiles are not supported 2024-02-17T02:48:26.933 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/494 2024-02-17T02:48:26.933 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/494 2024-02-17T02:48:26.933 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:26.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:26.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:26.964 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-02-17T02:48:27.207 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:27.212 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:27.213 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:27.214 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:27.705 INFO:teuthology.orchestra.run.smithi032.stdout:generic/495 [not run] swapfiles are not supported 2024-02-17T02:48:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/495 2024-02-17T02:48:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/495 2024-02-17T02:48:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:27.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:27.744 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-02-17T02:48:27.983 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:27.988 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:27.989 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:27.989 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:27.989 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:28.444 INFO:teuthology.orchestra.run.smithi032.stdout:generic/496 [not run] swapfiles are not supported 2024-02-17T02:48:28.449 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/496 2024-02-17T02:48:28.449 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/496 2024-02-17T02:48:28.449 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:28.452 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:28.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:28.478 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-02-17T02:48:28.738 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:28.743 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:28.743 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:28.744 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:28.744 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:29.375 INFO:teuthology.orchestra.run.smithi032.stdout:generic/497 [not run] swapfiles are not supported 2024-02-17T02:48:29.380 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/497 2024-02-17T02:48:29.380 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/497 2024-02-17T02:48:29.380 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:29.382 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:29.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:29.408 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-02-17T02:48:29.650 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:29.654 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:29.655 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:29.656 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:generic/498 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/498 2024-02-17T02:48:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/498 2024-02-17T02:48:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:30.051 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:30.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:30.082 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-02-17T02:48:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:30.340 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:30.340 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:30.341 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:30.341 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:30.721 INFO:teuthology.orchestra.run.smithi032.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T02:48:30.725 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/499 2024-02-17T02:48:30.725 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/499 2024-02-17T02:48:30.725 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:30.728 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:30.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:30.756 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-02-17T02:48:31.007 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:31.012 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:31.012 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:31.013 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:31.499 INFO:teuthology.orchestra.run.smithi032.stdout:generic/500 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:31.504 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/500 2024-02-17T02:48:31.504 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/500 2024-02-17T02:48:31.504 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:31.507 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:31.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:31.534 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-02-17T02:48:31.767 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:31.771 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:31.772 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:31.773 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:31.773 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:32.369 INFO:teuthology.orchestra.run.smithi032.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T02:48:32.375 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/501 2024-02-17T02:48:32.375 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/501 2024-02-17T02:48:32.375 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:32.381 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:32.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:32.456 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-02-17T02:48:32.851 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:32.860 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:32.861 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:32.861 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:32.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:33.208 INFO:teuthology.orchestra.run.smithi032.stdout:generic/502 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:33.212 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/502 2024-02-17T02:48:33.212 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/502 2024-02-17T02:48:33.212 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:33.217 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:33.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:33.245 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-02-17T02:48:33.494 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:33.498 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:33.499 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:33.500 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:33.500 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:33.825 INFO:teuthology.orchestra.run.smithi032.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T02:48:33.830 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/503 2024-02-17T02:48:33.830 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/503 2024-02-17T02:48:33.830 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:33.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:33.864 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-02-17T02:48:34.108 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:34.113 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:34.114 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:34.115 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:34.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:34.474 INFO:teuthology.orchestra.run.smithi032.stdout:generic/504 0s 2024-02-17T02:48:34.481 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/504 2024-02-17T02:48:34.481 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:34.484 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:34.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:34.511 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-02-17T02:48:34.748 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:34.755 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:34.755 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:35.173 INFO:teuthology.orchestra.run.smithi032.stdout:generic/505 [not run] ceph does not support shutdown 2024-02-17T02:48:35.188 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/505 2024-02-17T02:48:35.188 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/505 2024-02-17T02:48:35.188 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:35.191 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:35.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:35.216 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-02-17T02:48:35.468 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:35.472 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:35.473 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:35.474 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:35.756 INFO:teuthology.orchestra.run.smithi032.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-17T02:48:35.760 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/506 2024-02-17T02:48:35.760 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/506 2024-02-17T02:48:35.760 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:35.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:35.780 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-02-17T02:48:36.017 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:36.024 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:36.024 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:36.026 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:36.356 INFO:teuthology.orchestra.run.smithi032.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-02-17T02:48:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/507 2024-02-17T02:48:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/507 2024-02-17T02:48:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:36.364 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:36.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:36.395 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-02-17T02:48:36.634 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:36.641 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:36.642 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:36.643 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:36.945 INFO:teuthology.orchestra.run.smithi032.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-02-17T02:48:36.949 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/508 2024-02-17T02:48:36.949 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/508 2024-02-17T02:48:36.949 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:36.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:36.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:36.969 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-02-17T02:48:37.242 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:37.247 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:37.247 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:37.248 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:37.544 INFO:teuthology.orchestra.run.smithi032.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-02-17T02:48:37.548 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/509 2024-02-17T02:48:37.549 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/509 2024-02-17T02:48:37.549 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:37.552 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:37.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:37.583 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-02-17T02:48:37.827 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:37.832 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:37.832 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:37.833 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:37.833 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:38.159 INFO:teuthology.orchestra.run.smithi032.stdout:generic/510 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:38.164 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/510 2024-02-17T02:48:38.164 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/510 2024-02-17T02:48:38.164 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:38.167 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:38.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:38.185 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-02-17T02:48:38.428 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:38.433 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:38.434 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:38.435 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:38.435 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:38.736 INFO:teuthology.orchestra.run.smithi032.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-17T02:48:38.741 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/511 2024-02-17T02:48:38.741 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/511 2024-02-17T02:48:38.742 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:38.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:38.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:38.772 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-02-17T02:48:39.024 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:39.029 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:39.029 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:39.030 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:39.353 INFO:teuthology.orchestra.run.smithi032.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-17T02:48:39.357 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/512 2024-02-17T02:48:39.357 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/512 2024-02-17T02:48:39.357 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:39.360 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:39.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:39.390 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-02-17T02:48:39.631 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:39.635 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:39.636 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:39.637 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:40.104 INFO:teuthology.orchestra.run.smithi032.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T02:48:40.109 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/513 2024-02-17T02:48:40.109 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/513 2024-02-17T02:48:40.109 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:40.114 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:40.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:40.227 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-02-17T02:48:40.605 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:40.611 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:40.611 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:40.613 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:41.098 INFO:teuthology.orchestra.run.smithi032.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T02:48:41.105 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/514 2024-02-17T02:48:41.105 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/514 2024-02-17T02:48:41.105 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:41.107 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:41.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:41.249 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-02-17T02:48:41.619 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:41.626 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:41.627 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:41.628 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:41.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:42.147 INFO:teuthology.orchestra.run.smithi032.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T02:48:42.153 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/515 2024-02-17T02:48:42.153 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/515 2024-02-17T02:48:42.154 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:42.157 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:42.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:42.266 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-02-17T02:48:42.618 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:42.625 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:42.625 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:42.626 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:42.626 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:42.971 INFO:teuthology.orchestra.run.smithi032.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-17T02:48:42.975 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/516 2024-02-17T02:48:42.975 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/516 2024-02-17T02:48:42.975 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:42.977 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:43.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:43.055 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-02-17T02:48:43.458 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:43.464 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:43.464 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:43.466 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:43.466 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:43.927 INFO:teuthology.orchestra.run.smithi032.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-17T02:48:43.988 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/517 2024-02-17T02:48:43.988 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/517 2024-02-17T02:48:43.988 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:43.992 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:44.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:44.162 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-02-17T02:48:44.518 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:44.522 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:44.523 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:44.524 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:44.525 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:45.013 INFO:teuthology.orchestra.run.smithi032.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-17T02:48:45.020 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/518 2024-02-17T02:48:45.020 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/518 2024-02-17T02:48:45.020 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:45.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:45.119 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-02-17T02:48:45.515 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:45.519 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:45.520 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:45.521 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:45.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:45.854 INFO:teuthology.orchestra.run.smithi032.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-02-17T02:48:45.858 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/519 2024-02-17T02:48:45.858 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/519 2024-02-17T02:48:45.858 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:45.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:45.926 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-02-17T02:48:46.416 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:46.421 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:46.421 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:46.423 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:46.423 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:46.725 INFO:teuthology.orchestra.run.smithi032.stdout:generic/520 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2024-02-17T02:48:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/520 2024-02-17T02:48:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/520 2024-02-17T02:48:46.729 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T02:48:46.731 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:48:46.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T02:48:46.758 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-02-17T02:48:47.008 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T02:48:47.014 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T02:48:47.014 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T02:48:47.016 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T02:48:47.016 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T02:51:54.878 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T02:51:54.870+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48717) UID: 0 2024-02-17T02:51:54.879 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T02:51:54.870+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48717) UID: 0 2024-02-17T02:51:54.879 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T02:51:54.870+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48717) UID: 0 2024-02-17T02:51:54.879 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T02:51:54.871+0000 7f0f1542f640 -1 Fail to open '/proc/48717/cmdline' error = (2) No such file or directory 2024-02-17T02:51:54.879 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T02:51:54.871+0000 7f0f1542f640 -1 received signal: Hangup from (PID: 48717) UID: 0 2024-02-17T03:00:40.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:00:40.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:00:40.721 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:00:40.718+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617430) UID: 0 2024-02-17T03:00:40.722 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:00:40.718+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617430) UID: 0 2024-02-17T03:00:40.722 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:00:40.718+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617430) UID: 0 2024-02-17T03:00:40.722 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:00:40.718+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617430) UID: 0 2024-02-17T03:00:40.820 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T03:00:40.817+0000 7ffa5085d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48748) UID: 0 2024-02-17T03:00:40.820 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T03:00:40.817+0000 7f4b4fc92640 -1 Fail to open '/proc/48748/cmdline' error = (2) No such file or directory 2024-02-17T03:00:40.820 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T03:00:40.817+0000 7f4b4fc92640 -1 received signal: Hangup from (PID: 48748) UID: 0 2024-02-17T03:05:12.972 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T03:05:12.966+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48764) UID: 0 2024-02-17T03:05:12.973 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:05:12.966+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48764) UID: 0 2024-02-17T03:05:12.973 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T03:05:12.966+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48764) UID: 0 2024-02-17T03:05:12.973 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T03:05:12.966+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48764) UID: 0 2024-02-17T03:12:55.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:12:55.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:12:55.549 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T03:12:55.546+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-02-17T03:12:55.549 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T03:12:55.546+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-02-17T03:12:55.551 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T03:12:55.546+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-02-17T03:12:55.551 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:12:55.546+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-02-17T03:12:56.168 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:12:56.165+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617485) UID: 0 2024-02-17T03:12:56.169 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:12:56.165+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617485) UID: 0 2024-02-17T03:12:56.169 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:12:56.165+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617485) UID: 0 2024-02-17T03:12:56.198 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:12:56.165+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617485) UID: 0 2024-02-17T03:22:55.007 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:22:55.010 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:22:55.222 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T03:22:55.218+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48822) UID: 0 2024-02-17T03:22:55.223 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T03:22:55.218+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48822) UID: 0 2024-02-17T03:22:55.223 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T03:22:55.218+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48822) UID: 0 2024-02-17T03:22:55.223 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:22:55.218+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48822) UID: 0 2024-02-17T03:26:50.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:26:50.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:26:50.321 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:26:50.315+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617536) UID: 0 2024-02-17T03:26:50.322 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:26:50.315+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617536) UID: 0 2024-02-17T03:26:50.322 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:26:50.317+0000 7f8b9c692640 -1 Fail to open '/proc/617536/cmdline' error = (2) No such file or directory 2024-02-17T03:26:50.322 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:26:50.317+0000 7f8b9c692640 -1 received signal: Hangup from (PID: 617536) UID: 0 2024-02-17T03:26:50.323 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:26:50.315+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617536) UID: 0 2024-02-17T03:31:03.967 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:31:03.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:31:04.048 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:31:04.043+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617562) UID: 0 2024-02-17T03:31:04.048 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:31:04.043+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617562) UID: 0 2024-02-17T03:31:04.049 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:31:04.043+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617562) UID: 0 2024-02-17T03:31:04.049 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:31:04.043+0000 7f8b9c692640 -1 Fail to open '/proc/617562/cmdline' error = (2) No such file or directory 2024-02-17T03:31:04.049 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:31:04.043+0000 7f8b9c692640 -1 received signal: Hangup from (PID: 617562) UID: 0 2024-02-17T03:35:03.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:35:03.185 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:35:03.437 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:35:03.431+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617586) UID: 0 2024-02-17T03:35:03.438 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:35:03.431+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617586) UID: 0 2024-02-17T03:35:03.438 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:35:03.431+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617586) UID: 0 2024-02-17T03:35:03.438 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:35:03.431+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617586) UID: 0 2024-02-17T03:39:35.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:39:35.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:40:05.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:40:05.524 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:40:35.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:40:35.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:41:05.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:41:05.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:41:05.754 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T03:41:05.747+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48967) UID: 0 2024-02-17T03:41:05.754 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T03:41:05.747+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48967) UID: 0 2024-02-17T03:41:05.754 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:41:05.747+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48967) UID: 0 2024-02-17T03:41:05.765 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T03:41:05.747+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48967) UID: 0 2024-02-17T03:44:44.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:44:44.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:45:15.274 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:45:15.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:45:45.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:45:45.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:46:15.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:46:15.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:46:46.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:46:46.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:47:16.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:47:16.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:47:46.433 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:47:46.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:48:16.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:48:16.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:48:46.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:48:46.592 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:49:16.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:49:16.657 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:49:46.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:49:46.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:50:17.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:50:17.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:50:47.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:50:47.352 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:50:47.438 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:50:47.430+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617906) UID: 0 2024-02-17T03:50:47.438 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:50:47.430+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617906) UID: 0 2024-02-17T03:50:47.438 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:50:47.430+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617906) UID: 0 2024-02-17T03:50:47.439 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:50:47.430+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617906) UID: 0 2024-02-17T03:50:47.657 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T03:50:47.587+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49212) UID: 0 2024-02-17T03:50:47.657 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T03:50:47.587+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49212) UID: 0 2024-02-17T03:50:47.685 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:50:47.587+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49212) UID: 0 2024-02-17T03:50:47.685 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T03:50:47.587+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49212) UID: 0 2024-02-17T03:54:45.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:54:45.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:54:45.426 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T03:54:45.418+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617929) UID: 0 2024-02-17T03:54:45.427 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T03:54:45.418+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617929) UID: 0 2024-02-17T03:54:45.427 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T03:54:45.418+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617929) UID: 0 2024-02-17T03:54:45.427 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T03:54:45.418+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617929) UID: 0 2024-02-17T03:54:45.429 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T03:54:45.420+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49235) UID: 0 2024-02-17T03:54:45.429 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T03:54:45.420+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49235) UID: 0 2024-02-17T03:54:45.430 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T03:54:45.420+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49235) UID: 0 2024-02-17T03:54:45.430 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:54:45.421+0000 7fa7979e8640 -1 Fail to open '/proc/49235/cmdline' error = (2) No such file or directory 2024-02-17T03:54:45.430 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T03:54:45.421+0000 7fa7979e8640 -1 received signal: Hangup from (PID: 49235) UID: 0 2024-02-17T03:58:49.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:58:49.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:59:19.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:59:19.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:59:49.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T03:59:49.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:00:20.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:00:20.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:00:50.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:00:50.159 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:01:20.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:01:20.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:01:20.286 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:01:20.276+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49364) UID: 0 2024-02-17T04:01:20.286 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:01:20.276+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49364) UID: 0 2024-02-17T04:01:20.287 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:01:20.276+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49364) UID: 0 2024-02-17T04:01:20.287 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:01:20.276+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49364) UID: 0 2024-02-17T04:01:20.294 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:01:20.284+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618057) UID: 0 2024-02-17T04:01:20.294 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:01:20.284+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618057) UID: 0 2024-02-17T04:01:20.294 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:01:20.284+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618057) UID: 0 2024-02-17T04:01:20.295 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:01:20.284+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618057) UID: 0 2024-02-17T04:05:15.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:05:15.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:05:46.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:05:46.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:06:16.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:06:16.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:06:16.725 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:06:16.719+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618118) UID: 0 2024-02-17T04:06:16.725 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:06:16.719+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618118) UID: 0 2024-02-17T04:06:16.726 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:06:16.719+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618118) UID: 0 2024-02-17T04:06:16.726 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:06:16.720+0000 7f8b9c692640 -1 Fail to open '/proc/618118/cmdline' error = (2) No such file or directory 2024-02-17T04:06:16.726 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:06:16.720+0000 7f8b9c692640 -1 received signal: Hangup from (PID: 618118) UID: 0 2024-02-17T04:10:20.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:10:20.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:10:50.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:10:50.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:11:21.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:11:21.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:11:51.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:11:51.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:12:12.205 INFO:teuthology.orchestra.run.smithi032.stdout:generic/521 5004s 2024-02-17T04:12:12.633 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/521 2024-02-17T04:12:12.634 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2024-02-17T04:12:12.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T04:12:12.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-17T04:12:12.833 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.oprNTeITBlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-02-17T04:12:14.852 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2024-02-17T04:12:14.857 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.14.0-421.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 13 19:41:24 UTC 2024 2024-02-17T04:12:14.858 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2024-02-17T04:12:14.859 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZ/89lsKMKNBAAaUEYvmlDO4YSnXiY+GRWbg== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.sMg5lrJz2Nscratch 2024-02-17T04:12:14.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T04:12:21.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:12:21.157 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:12:51.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:12:51.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:13:21.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:13:21.328 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:13:51.411 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:13:51.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:14:21.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:14:21.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:14:51.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:14:51.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:14:51.612 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:14:51.609+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618784) UID: 0 2024-02-17T04:14:51.612 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:14:51.609+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618784) UID: 0 2024-02-17T04:14:51.612 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:14:51.609+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618784) UID: 0 2024-02-17T04:14:51.613 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:14:51.609+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618784) UID: 0 2024-02-17T04:14:51.615 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:14:51.613+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49613) UID: 0 2024-02-17T04:14:51.616 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:14:51.613+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49613) UID: 0 2024-02-17T04:14:51.616 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:14:51.614+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49613) UID: 0 2024-02-17T04:14:51.616 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:14:51.614+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49613) UID: 0 2024-02-17T04:18:37.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:18:37.151 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:18:37.210 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:18:37.208+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618807) UID: 0 2024-02-17T04:18:37.210 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:18:37.208+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618807) UID: 0 2024-02-17T04:18:37.211 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:18:37.208+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618807) UID: 0 2024-02-17T04:18:37.211 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:18:37.209+0000 7f8b9c692640 -1 Fail to open '/proc/618807/cmdline' error = (2) No such file or directory 2024-02-17T04:18:37.211 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:18:37.209+0000 7f8b9c692640 -1 received signal: Hangup from (PID: 618807) UID: 0 2024-02-17T04:18:37.354 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T04:18:37.350+0000 7f4b4fc92640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49635) UID: 0 2024-02-17T04:18:37.356 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T04:18:37.350+0000 7ffa5085d640 -1 Fail to open '/proc/49635/cmdline' error = (2) No such file or directory 2024-02-17T04:18:37.356 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T04:18:37.350+0000 7ffa5085d640 -1 received signal: Hangup from (PID: 49635) UID: 0 2024-02-17T04:22:01.694 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:22:01.691+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49646) UID: 0 2024-02-17T04:22:01.695 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:22:01.691+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49646) UID: 0 2024-02-17T04:22:01.695 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:22:01.691+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49646) UID: 0 2024-02-17T04:22:01.695 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:22:01.691+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49646) UID: 0 2024-02-17T04:26:21.623 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:26:21.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:26:55.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:26:55.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:27:25.929 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:27:25.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:27:55.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:27:55.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:28:26.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:28:26.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:28:56.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:28:56.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:29:26.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:29:26.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:29:57.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:29:57.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:30:27.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:30:27.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:30:57.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:30:57.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:31:28.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:31:28.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:31:28.090 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:31:28.089+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619017) UID: 0 2024-02-17T04:31:28.090 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:31:28.089+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619017) UID: 0 2024-02-17T04:31:28.091 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:31:28.089+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619017) UID: 0 2024-02-17T04:31:28.091 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:31:28.089+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619017) UID: 0 2024-02-17T04:35:06.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:35:06.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:35:39.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:35:39.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:36:09.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:36:09.371 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:36:39.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:36:39.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:36:39.935 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:36:39.935+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49934) UID: 0 2024-02-17T04:36:39.936 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:36:39.935+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49934) UID: 0 2024-02-17T04:36:39.936 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:36:39.935+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49934) UID: 0 2024-02-17T04:36:39.939 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:36:39.935+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49934) UID: 0 2024-02-17T04:40:32.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:40:32.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:40:32.127 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:40:32.126+0000 7f0f1542f640 -1 Fail to open '/proc/49962/cmdline' error = (2) No such file or directory 2024-02-17T04:40:32.127 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:40:32.126+0000 7f0f1542f640 -1 received signal: Hangup from (PID: 49962) UID: 0 2024-02-17T04:40:32.127 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:40:32.126+0000 7fa7979e8640 -1 Fail to open '/proc/49962/cmdline' error = (2) No such file or directory 2024-02-17T04:40:32.128 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:40:32.126+0000 7fa7979e8640 -1 received signal: Hangup from (PID: 49962) UID: 0 2024-02-17T04:40:32.129 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:40:32.128+0000 7f77a94aa640 -1 Fail to open '/proc/49962/cmdline' error = (2) No such file or directory 2024-02-17T04:40:32.129 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:40:32.128+0000 7f77a94aa640 -1 received signal: Hangup from (PID: 49962) UID: 0 2024-02-17T04:40:32.130 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:40:32.129+0000 7fec86e01640 -1 Fail to open '/proc/49962/cmdline' error = (2) No such file or directory 2024-02-17T04:40:32.130 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:40:32.129+0000 7fec86e01640 -1 received signal: Hangup from (PID: 49962) UID: 0 2024-02-17T04:44:22.634 INFO:teuthology.orchestra.run.smithi039.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.7.log.1: 2024-02-17T04:44:22.635 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: stdin: file size changed while zipping 2024-02-17T04:44:55.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:44:55.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:45:28.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:45:28.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:45:58.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:45:58.463 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:45:58.519 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:45:58.517+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619174) UID: 0 2024-02-17T04:45:58.519 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:45:58.517+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619174) UID: 0 2024-02-17T04:45:58.530 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:45:58.517+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619174) UID: 0 2024-02-17T04:45:58.531 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:45:58.517+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619174) UID: 0 2024-02-17T04:49:38.601 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:49:38.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:49:38.670 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:49:38.668+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50044) UID: 0 2024-02-17T04:49:38.670 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:49:38.668+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50044) UID: 0 2024-02-17T04:49:38.671 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:49:38.668+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50044) UID: 0 2024-02-17T04:49:38.671 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:49:38.668+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50044) UID: 0 2024-02-17T04:49:38.864 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:49:38.862+0000 7f02dd021640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619195) UID: 0 2024-02-17T04:49:38.864 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:49:38.862+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619195) UID: 0 2024-02-17T04:49:38.865 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:49:38.862+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619195) UID: 0 2024-02-17T04:49:38.865 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:49:38.863+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619195) UID: 0 2024-02-17T04:53:22.152 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:53:22.150+0000 7f02d2e19640 -1 bdev(0x55abf225f180 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f02d2e19640 time 2024-02-17T04:53:22.151391+0000 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55abef8d313b] 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.153 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr:*** Caught signal (Aborted) ** 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: in thread 7f02d2e19640 thread_name:bstore_aio 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:53:22.151+0000 7f02d2e19640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f02d2e19640 time 2024-02-17T04:53:22.151391+0000 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55abef8d313b] 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.154 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f02e0454db0] 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f02e04a154c] 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: raise() 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: abort() 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55abef8d31fc] 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 7: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.155 INFO:tasks.ceph.osd.3.smithi032.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.156 INFO:tasks.ceph.osd.3.smithi032.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.156 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-02-17T04:53:22.155+0000 7f02d2e19640 -1 *** Caught signal (Aborted) ** 2024-02-17T04:53:22.156 INFO:tasks.ceph.osd.3.smithi032.stderr: in thread 7f02d2e19640 thread_name:bstore_aio 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f02e0454db0] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f02e04a154c] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: raise() 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: abort() 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55abef8d31fc] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 7: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-17T04:53:22.157 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.173 INFO:tasks.ceph.osd.3.smithi032.stderr: -620> 2024-02-17T04:53:22.150+0000 7f02d2e19640 -1 bdev(0x55abf225f180 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2024-02-17T04:53:22.173 INFO:tasks.ceph.osd.3.smithi032.stderr: -619> 2024-02-17T04:53:22.151+0000 7f02d2e19640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f02d2e19640 time 2024-02-17T04:53:22.151391+0000 2024-02-17T04:53:22.173 INFO:tasks.ceph.osd.3.smithi032.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-02-17T04:53:22.173 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.173 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55abef8d313b] 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 0> 2024-02-17T04:53:22.155+0000 7f02d2e19640 -1 *** Caught signal (Aborted) ** 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: in thread 7f02d2e19640 thread_name:bstore_aio 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.174 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f02e0454db0] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f02e04a154c] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: raise() 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: abort() 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55abef8d31fc] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 7: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-17T04:53:22.175 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.188 INFO:tasks.ceph.osd.3.smithi032.stderr: -825> 2024-02-17T04:53:22.150+0000 7f02d2e19640 -1 bdev(0x55abf225f180 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2024-02-17T04:53:22.188 INFO:tasks.ceph.osd.3.smithi032.stderr: -824> 2024-02-17T04:53:22.151+0000 7f02d2e19640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f02d2e19640 time 2024-02-17T04:53:22.151391+0000 2024-02-17T04:53:22.188 INFO:tasks.ceph.osd.3.smithi032.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1507-g2d9ecbfd/rpm/el9/BUILD/ceph-19.0.0-1507-g2d9ecbfd/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-02-17T04:53:22.188 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.188 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55abef8d313b] 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: -205> 2024-02-17T04:53:22.155+0000 7f02d2e19640 -1 *** Caught signal (Aborted) ** 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: in thread 7f02d2e19640 thread_name:bstore_aio 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.189 INFO:tasks.ceph.osd.3.smithi032.stderr: ceph version 19.0.0-1507-g2d9ecbfd (2d9ecbfd71ad813d2904991462c430e98ff63b84) squid (dev) 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f02e0454db0] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f02e04a154c] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 3: raise() 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 4: abort() 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55abef8d31fc] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x55abf029bec0] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 7: ceph-osd(+0xdbd031) [0x55abf029c031] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f02e049f802] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f02e043f450] 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-17T04:53:22.190 INFO:tasks.ceph.osd.3.smithi032.stderr: 2024-02-17T04:53:22.428 INFO:tasks.ceph.osd.3.smithi032.stderr:daemon-helper: command failed with exit status 5 2024-02-17T04:53:27.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-17T04:53:29.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:53:29.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:53:29.885 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:53:29.883+0000 7fa7979e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50071) UID: 0 2024-02-17T04:53:29.885 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:53:29.883+0000 7fec86e01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50071) UID: 0 2024-02-17T04:53:29.885 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:53:29.883+0000 7f77a94aa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50071) UID: 0 2024-02-17T04:53:29.886 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:53:29.883+0000 7f0f1542f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50071) UID: 0 2024-02-17T04:53:34.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2024-02-17T04:53:41.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2024-02-17T04:53:47.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2024-02-17T04:53:54.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2024-02-17T04:54:00.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2024-02-17T04:54:07.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2024-02-17T04:54:14.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2024-02-17T04:54:20.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~53s 2024-02-17T04:54:27.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2024-02-17T04:54:33.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~66s 2024-02-17T04:54:40.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~73s 2024-02-17T04:54:47.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~79s 2024-02-17T04:54:53.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~86s 2024-02-17T04:55:00.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~93s 2024-02-17T04:55:07.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~99s 2024-02-17T04:55:13.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~106s 2024-02-17T04:55:20.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~112s 2024-02-17T04:55:26.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~119s 2024-02-17T04:55:33.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~126s 2024-02-17T04:55:40.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~132s 2024-02-17T04:55:46.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~139s 2024-02-17T04:55:53.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2024-02-17T04:55:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~152s 2024-02-17T04:56:06.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~159s 2024-02-17T04:56:13.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2024-02-17T04:56:19.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~172s 2024-02-17T04:56:26.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~179s 2024-02-17T04:56:33.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2024-02-17T04:56:39.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~192s 2024-02-17T04:56:46.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~198s 2024-02-17T04:56:52.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2024-02-17T04:56:59.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~212s 2024-02-17T04:57:06.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~218s 2024-02-17T04:57:12.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2024-02-17T04:57:19.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~231s 2024-02-17T04:57:25.924 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~238s 2024-02-17T04:57:32.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2024-02-17T04:57:39.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~251s 2024-02-17T04:57:45.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~258s 2024-02-17T04:57:49.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:57:49.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T04:57:49.920 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:57:49.919+0000 7f8b9c692640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619240) UID: 0 2024-02-17T04:57:49.921 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:57:49.919+0000 7f22a5a92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619240) UID: 0 2024-02-17T04:57:49.921 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:57:49.919+0000 7f278591e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 619240) UID: 0 2024-02-17T04:57:52.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2024-02-17T04:57:58.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2024-02-17T04:58:05.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~278s 2024-02-17T04:58:12.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~284s 2024-02-17T04:58:18.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~291s 2024-02-17T04:58:25.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~298s 2024-02-17T04:58:32.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~304s 2024-02-17T04:58:32.047 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-02-17T04:58:32.047 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T04:58:32.047 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T04:58:32.279 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T04:58:32.280 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T04:58:32.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T04:58:35.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.025+0000 7fb48d97a640 1 Processor -- start 2024-02-17T04:58:35.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.025+0000 7fb48d97a640 1 -- start start 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb48d97a640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb488141150 0x7fb48806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb48d97a640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880cbc30 con 0x7fb4880b1dd0 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb48d97a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880b21b0 con 0x7fb488141ac0 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb48d97a640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880c4ab0 con 0x7fb488141150 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb4877fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb488141150 0x7fb48806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb4877fe640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb488141150 0x7fb48806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53002/0 (socket says 172.21.15.32:53002) 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb4877fe640 1 -- 172.21.15.32:0/333581190 learned_addr learned my addr 172.21.15.32:0/333581190 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb486ffd640 1 --1- 172.21.15.32:0/333581190 >> v1:172.21.15.32:6789/0 conn(0x7fb4880b1dd0 0x7fb48815ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57224/0 (socket says 172.21.15.32:57224) 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb4877fe640 1 -- 172.21.15.32:0/333581190 >> v1:172.21.15.39:6789/0 conn(0x7fb488141ac0 legacy=0x7fb488140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb4877fe640 1 -- 172.21.15.32:0/333581190 >> v1:172.21.15.32:6789/0 conn(0x7fb4880b1dd0 legacy=0x7fb48815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.026+0000 7fb4877fe640 1 -- 172.21.15.32:0/333581190 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48806d150 con 0x7fb488141150 2024-02-17T04:58:35.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.027+0000 7fb4877fe640 1 --2- 172.21.15.32:0/333581190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141150 0x7fb48806df10 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d150 tx=0x7fb48002e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d78d535fa09fc25 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:35.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.027+0000 7fb4867fc640 1 -- 172.21.15.32:0/333581190 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000b0d0 con 0x7fb488141150 2024-02-17T04:58:35.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.027+0000 7fb4867fc640 1 -- 172.21.15.32:0/333581190 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000b230 con 0x7fb488141150 2024-02-17T04:58:35.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.027+0000 7fb4867fc640 1 -- 172.21.15.32:0/333581190 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480009600 con 0x7fb488141150 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 -- 172.21.15.32:0/333581190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141150 msgr2=0x7fb48806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 --2- 172.21.15.32:0/333581190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141150 0x7fb48806df10 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d150 tx=0x7fb48002e200 comp rx=0 tx=0).stop 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 -- 172.21.15.32:0/333581190 shutdown_connections 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 --2- 172.21.15.32:0/333581190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141150 0x7fb48806df10 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 -- 172.21.15.32:0/333581190 >> 172.21.15.32:0/333581190 conn(0x7fb488071150 msgr2=0x7fb488071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 -- 172.21.15.32:0/333581190 shutdown_connections 2024-02-17T04:58:35.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.028+0000 7fb48d97a640 1 -- 172.21.15.32:0/333581190 wait complete. 2024-02-17T04:58:35.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.060+0000 7fb48d97a640 1 Processor -- start 2024-02-17T04:58:35.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.061+0000 7fb48d97a640 1 -- start start 2024-02-17T04:58:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.061+0000 7fb48d97a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4880b1dd0 0x7fb4881eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.061+0000 7fb48d97a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 0x7fb4881574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.061+0000 7fb48d97a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141ac0 0x7fb4880b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb48d97a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488139110 con 0x7fb488141ac0 2024-02-17T04:58:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb48d97a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b5500 con 0x7fb4880b1dd0 2024-02-17T04:58:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb48d97a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb488139310 con 0x7fb488141150 2024-02-17T04:58:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 0x7fb4881574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb4877fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141ac0 0x7fb4880b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 0x7fb4881574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:34984/0 (socket says 172.21.15.32:34984) 2024-02-17T04:58:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 -- 172.21.15.32:0/1366916360 learned_addr learned my addr 172.21.15.32:0/1366916360 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb486ffd640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4880b1dd0 0x7fb4881eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 -- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4880b1dd0 msgr2=0x7fb4881eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4880b1dd0 0x7fb4881eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 -- 172.21.15.32:0/1366916360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141ac0 msgr2=0x7fb4880b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141ac0 0x7fb4880b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb47ffff640 1 -- 172.21.15.32:0/1366916360 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48000bd40 con 0x7fb488141150 2024-02-17T04:58:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.062+0000 7fb4877fe640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141ac0 0x7fb4880b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T04:58:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.063+0000 7fb47ffff640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 0x7fb4881574d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c3c0 tx=0x7fb47000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.063+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700052d0 con 0x7fb488141150 2024-02-17T04:58:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.063+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4881395f0 con 0x7fb488141150 2024-02-17T04:58:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.063+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470005430 con 0x7fb488141150 2024-02-17T04:58:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.064+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470007220 con 0x7fb488141150 2024-02-17T04:58:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.066+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb470007380 con 0x7fb488141150 2024-02-17T04:58:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.066+0000 7fb484ff9640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb46806b810 0x7fb46806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.066+0000 7fb486ffd640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb46806b810 0x7fb46806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.067+0000 7fb486ffd640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb46806b810 0x7fb46806dcd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb478000f60 tx=0x7fb478007c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:35.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.081+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb488139bb0 con 0x7fb488141150 2024-02-17T04:58:35.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.081+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6188+0+0 (secure 0 0 0) 0x7fb470058210 con 0x7fb488141150 2024-02-17T04:58:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.105+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb488068fd0 con 0x7fb488141150 2024-02-17T04:58:35.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.114+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb470053db0 con 0x7fb488141150 2024-02-17T04:58:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.408+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4880cc790 con 0x7fb488141150 2024-02-17T04:58:35.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.410+0000 7fb484ff9640 1 -- 172.21.15.32:0/1366916360 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17125 (secure 0 0 0) 0x7fb470057470 con 0x7fb488141150 2024-02-17T04:58:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-02-17T04:58:35.415 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":45,"fsid":"2fde0ac4-9f5d-41d6-aea9-1575265f7f65","created":"2024-02-17T00:36:13.624659+0000","modified":"2024-02-17T04:53:24.000450+0000","last_up_change":"2024-02-17T04:53:22.981297+0000","last_in_change":"2024-02-17T00:36:15.842113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T00:36:25.991729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-02-17T00:37:48.933613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.9700000286102295,"raw_score_stable":1.9700000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-02-17T00:37:50.024420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6100000143051147,"score_stable":1.6100000143051147,"optimal_score":0.87999999523162842,"raw_score_acting":1.4199999570846558,"raw_score_stable":1.4199999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfb4a088-5364-41fe-906d-67bc52745b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6820","nonce":3739667141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6824","nonce":3739667141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6831","nonce":3739667141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3739667141},{"type":"v1","addr":"172.21.15.32:6828","nonce":3739667141}]},"public_addr":"172.21.15.32:6820/3739667141","cluster_addr":"172.21.15.32:6824/3739667141","heartbeat_back_addr":"172.21.15.32:6831/3739667141","heartbeat_front_addr":"172.21.15.32:6828/3739667141","state":["exists","up"]},{"osd":1,"uuid":"16bdb24b-1c4a-47f7-874c-3d6fd0655717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6817","nonce":3524684164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6821","nonce":3524684164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6829","nonce":3524684164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":3524684164},{"type":"v1","addr":"172.21.15.32:6825","nonce":3524684164}]},"public_addr":"172.21.15.32:6817/3524684164","cluster_addr":"172.21.15.32:6821/3524684164","heartbeat_back_addr":"172.21.15.32:6829/3524684164","heartbeat_front_addr":"172.21.15.32:6825/3524684164","state":["exists","up"]},{"osd":2,"uuid":"e95aff5e-d74f-4f24-97ff-7d37a50e73db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6809","nonce":3819571530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6811","nonce":3819571530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6815","nonce":3819571530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3819571530},{"type":"v1","addr":"172.21.15.32:6813","nonce":3819571530}]},"public_addr":"172.21.15.32:6809/3819571530","cluster_addr":"172.21.15.32:6811/3819571530","heartbeat_back_addr":"172.21.15.32:6815/3819571530","heartbeat_front_addr":"172.21.15.32:6813/3819571530","state":["exists","up"]},{"osd":3,"uuid":"cc8ea2aa-625a-4dd0-9b00-5d24308065c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6801","nonce":154825715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6803","nonce":154825715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6807","nonce":154825715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":154825715},{"type":"v1","addr":"172.21.15.32:6805","nonce":154825715}]},"public_addr":"172.21.15.32:6801/154825715","cluster_addr":"172.21.15.32:6803/154825715","heartbeat_back_addr":"172.21.15.32:6807/154825715","heartbeat_front_addr":"172.21.15.32:6805/154825715","state":["exists"]},{"osd":4,"uuid":"f9860253-5a7b-4e91-8c2e-d5aa82cbd515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6819","nonce":3708375265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6824","nonce":3708375265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6831","nonce":3708375265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6827","nonce":3708375265},{"type":"v1","addr":"172.21.15.39:6828","nonce":3708375265}]},"public_addr":"172.21.15.39:6819/3708375265","cluster_addr":"172.21.15.39:6824/3708375265","heartbeat_back_addr":"172.21.15.39:6831/3708375265","heartbeat_front_addr":"172.21.15.39:6828/3708375265","state":["exists","up"]},{"osd":5,"uuid":"66b2d2e5-9c10-4735-b890-fa7991e3c008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6801","nonce":3921495390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6803","nonce":3921495390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6807","nonce":3921495390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3921495390},{"type":"v1","addr":"172.21.15.39:6805","nonce":3921495390}]},"public_addr":"172.21.15.39:6801/3921495390","cluster_addr":"172.21.15.39:6803/3921495390","heartbeat_back_addr":"172.21.15.39:6807/3921495390","heartbeat_front_addr":"172.21.15.39:6805/3921495390","state":["exists","up"]},{"osd":6,"uuid":"38ab3eb1-5e4d-4c5c-a81d-92cb3ceef2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6818","nonce":4203051677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6821","nonce":4203051677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6829","nonce":4203051677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":4203051677},{"type":"v1","addr":"172.21.15.39:6825","nonce":4203051677}]},"public_addr":"172.21.15.39:6818/4203051677","cluster_addr":"172.21.15.39:6821/4203051677","heartbeat_back_addr":"172.21.15.39:6829/4203051677","heartbeat_front_addr":"172.21.15.39:6825/4203051677","state":["exists","up"]},{"osd":7,"uuid":"a1292a63-a671-4fda-b897-a67d5ffdfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6809","nonce":4207552871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6811","nonce":4207552871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6815","nonce":4207552871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4207552871},{"type":"v1","addr":"172.21.15.39:6813","nonce":4207552871}]},"public_addr":"172.21.15.39:6809/4207552871","cluster_addr":"172.21.15.39:6811/4207552871","heartbeat_back_addr":"172.21.15.39:6815/4207552871","heartbeat_front_addr":"172.21.15.39:6813/4207552871","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.066198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.069869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.009787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.017077+0000","dead_epoch":44},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.043414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016495+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:21.016594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T00:36:20.908258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.b","mappings":[{"from":4,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T04:58:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb46806b810 msgr2=0x7fb46806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb46806b810 0x7fb46806dcd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb478000f60 tx=0x7fb478007c80 comp rx=0 tx=0).stop 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 msgr2=0x7fb4881574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 0x7fb4881574d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c3c0 tx=0x7fb47000c880 comp rx=0 tx=0).stop 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 shutdown_connections 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb488141ac0 0x7fb4880b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7fb46806b810 0x7fb46806dcd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb488141150 0x7fb4881574d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 --2- 172.21.15.32:0/1366916360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4880b1dd0 0x7fb4881eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.413+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 >> 172.21.15.32:0/1366916360 conn(0x7fb488071150 msgr2=0x7fb4880ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.414+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 shutdown_connections 2024-02-17T04:58:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.414+0000 7fb48d97a640 1 -- 172.21.15.32:0/1366916360 wait complete. 2024-02-17T04:58:35.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T00:36:25.991729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T00:37:48.933613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.9700000286102295, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T00:37:50.024420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6100000143051147, 'score_stable': 1.6100000143051147, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.4199999570846558, 'raw_score_stable': 1.4199999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T04:58:35.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T04:58:35.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.593+0000 7f9b47872640 1 Processor -- start 2024-02-17T04:58:35.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.593+0000 7f9b47872640 1 -- start start 2024-02-17T04:58:35.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.594+0000 7f9b47872640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9b400cccd0 0x7f9b400ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b4560e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9b400cccd0 0x7f9b400ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b45e0f640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9b400cd7c0 0x7f9b400cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57238/0 (socket says 172.21.15.32:57238) 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b45e0f640 1 -- 172.21.15.32:0/3783641242 learned_addr learned my addr 172.21.15.32:0/3783641242 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b400704d0 con 0x7f9b400cd7c0 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b400ce100 con 0x7f9b4006fa60 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4015e320 con 0x7f9b400cccd0 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982124385 0 0) 0x7f9b400704d0 con 0x7f9b400cd7c0 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.595+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b2c003520 con 0x7f9b400cd7c0 2024-02-17T04:58:35.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 192944017 0 0) 0x7f9b2c003520 con 0x7f9b400cd7c0 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 >> v2:172.21.15.39:3300/0 conn(0x7f9b400cccd0 msgr2=0x7f9b400ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 --2- 172.21.15.32:0/3783641242 >> v2:172.21.15.39:3300/0 conn(0x7f9b400cccd0 0x7f9b400ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 >> v1:172.21.15.39:6789/0 conn(0x7f9b4006fa60 legacy=0x7f9b400cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4006ff10 con 0x7f9b400cd7c0 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3830509448 0 0) 0x7f9b380019f0 con 0x7f9b400cd7c0 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 >> v1:172.21.15.32:6789/0 conn(0x7f9b400cd7c0 legacy=0x7f9b400cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b2c003970 0x7f9b2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c0042d0 0x7f9b2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2c004fa0 0x7f9b2c00ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4015e320 con 0x7f9b2c0042d0 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0104d0 con 0x7f9b2c004fa0 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c010690 con 0x7f9b2c003970 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b4560e640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b2c003970 0x7f9b2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b44e0d640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c0042d0 0x7f9b2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.596+0000 7f9b45e0f640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2c004fa0 0x7f9b2c00ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b4560e640 1 -- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2c004fa0 msgr2=0x7f9b2c00ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b4560e640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2c004fa0 0x7f9b2c00ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b4560e640 1 -- 172.21.15.32:0/3783641242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c0042d0 msgr2=0x7f9b2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b4560e640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c0042d0 0x7f9b2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b4560e640 1 -- 172.21.15.32:0/3783641242 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c003520 con 0x7f9b2c003970 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b45e0f640 1 -- 172.21.15.32:0/3783641242 reap_dead start 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.597+0000 7f9b4560e640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b2c003970 0x7f9b2c003d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009af0 tx=0x7f9b2c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52a45a2dfde05ac server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.598+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c02c690 con 0x7f9b2c003970 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.598+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c02c7f0 con 0x7f9b2c003970 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.598+0000 7f9b37fff640 1 -- 172.21.15.32:0/3783641242 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c02cb80 con 0x7f9b2c003970 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b2c003970 msgr2=0x7f9b2c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b2c003970 0x7f9b2c003d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009af0 tx=0x7f9b2c0057f0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 shutdown_connections 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 --2- 172.21.15.32:0/3783641242 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b2c003970 0x7f9b2c003d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 >> 172.21.15.32:0/3783641242 conn(0x7f9b400999f0 msgr2=0x7f9b400b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 shutdown_connections 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.599+0000 7f9b47872640 1 -- 172.21.15.32:0/3783641242 wait complete. 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.600+0000 7f9b47872640 1 Processor -- start 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.600+0000 7f9b47872640 1 -- start start 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b47872640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c003970 0x7f9b4014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b47872640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 0x7f9b4014cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b47872640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b4014d4d0 0x7f9b400ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b47872640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4014ac70 con 0x7f9b2c003970 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b47872640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b400afb00 con 0x7f9b400c5280 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b47872640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4014da30 con 0x7f9b4014d4d0 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b44e0d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 0x7f9b4014cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b44e0d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 0x7f9b4014cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:59888/0 (socket says 172.21.15.32:59888) 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b44e0d640 1 -- 172.21.15.32:0/3851628629 learned_addr learned my addr 172.21.15.32:0/3851628629 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.601+0000 7f9b45e0f640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b4014d4d0 0x7f9b400ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b44e0d640 1 -- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b4014d4d0 msgr2=0x7f9b400ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b44e0d640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b4014d4d0 0x7f9b400ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b44e0d640 1 -- 172.21.15.32:0/3851628629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c003970 msgr2=0x7f9b4014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b44e0d640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c003970 0x7f9b4014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b44e0d640 1 -- 172.21.15.32:0/3851628629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4014dd10 con 0x7f9b400c5280 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b44e0d640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 0x7f9b4014cf90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000f570 tx=0x7f9b3000fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30005320 con 0x7f9b400c5280 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30005480 con 0x7f9b400c5280 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b400af790 con 0x7f9b400c5280 2024-02-17T04:58:35.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30007270 con 0x7f9b400c5280 2024-02-17T04:58:35.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.602+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b400c56e0 con 0x7f9b400c5280 2024-02-17T04:58:35.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.604+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b40068f60 con 0x7f9b400c5280 2024-02-17T04:58:35.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.605+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9b300073d0 con 0x7f9b400c5280 2024-02-17T04:58:35.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.606+0000 7f9b35ffb640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9b2406b840 0x7f9b2406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:35.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.606+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6188+0+0 (secure 0 0 0) 0x7f9b30089a90 con 0x7f9b400c5280 2024-02-17T04:58:35.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.606+0000 7f9b4560e640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9b2406b840 0x7f9b2406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:35.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.607+0000 7f9b4560e640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9b2406b840 0x7f9b2406dd00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c036000 tx=0x7f9b3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:35.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.613+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b300543f0 con 0x7f9b400c5280 2024-02-17T04:58:35.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.875+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b400afc40 con 0x7f9b400c5280 2024-02-17T04:58:35.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.876+0000 7f9b35ffb640 1 -- 172.21.15.32:0/3851628629 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b30057ab0 con 0x7f9b400c5280 2024-02-17T04:58:35.877 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9b2406b840 msgr2=0x7f9b2406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9b2406b840 0x7f9b2406dd00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c036000 tx=0x7f9b3c02e000 comp rx=0 tx=0).stop 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 msgr2=0x7f9b4014cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 0x7f9b4014cf90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000f570 tx=0x7f9b3000fa30 comp rx=0 tx=0).stop 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 shutdown_connections 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f9b2406b840 0x7f9b2406dd00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9b4014d4d0 0x7f9b400ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b400c5280 0x7f9b4014cf90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 --2- 172.21.15.32:0/3851628629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b2c003970 0x7f9b4014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:35.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 >> 172.21.15.32:0/3851628629 conn(0x7f9b400999f0 msgr2=0x7f9b400b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:35.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 shutdown_connections 2024-02-17T04:58:35.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:35.878+0000 7f9b47872640 1 -- 172.21.15.32:0/3851628629 wait complete. 2024-02-17T04:58:35.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T04:58:36.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.023+0000 7f1b6c565640 1 Processor -- start 2024-02-17T04:58:36.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.023+0000 7f1b6c565640 1 -- start start 2024-02-17T04:58:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.024+0000 7f1b6c565640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 0x7f1b640cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.024+0000 7f1b6c565640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b640d0a00 0x7f1b6409a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6a301640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 0x7f1b640cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6a301640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 0x7f1b640cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.32:59900/0 (socket says 172.21.15.32:59900) 2024-02-17T04:58:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b69b00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b640d0a00 0x7f1b6409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6a301640 1 -- 172.21.15.32:0/3743925468 learned_addr learned my addr 172.21.15.32:0/3743925468 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b641615e0 con 0x7f1b6409a7d0 2024-02-17T04:58:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6406c9f0 con 0x7f1b640d0a00 2024-02-17T04:58:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6406ccd0 con 0x7f1b64161200 2024-02-17T04:58:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b69b00640 1 -- 172.21.15.32:0/3743925468 >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 msgr2=0x7f1b640cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T04:58:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b69b00640 1 --2- 172.21.15.32:0/3743925468 >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 0x7f1b640cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b69b00640 1 -- 172.21.15.32:0/3743925468 >> v1:172.21.15.39:6789/0 conn(0x7f1b6409a7d0 legacy=0x7f1b64161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b69b00640 1 -- 172.21.15.32:0/3743925468 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64099a90 con 0x7f1b640d0a00 2024-02-17T04:58:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.025+0000 7f1b6a301640 1 --2- 172.21.15.32:0/3743925468 >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 0x7f1b640cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T04:58:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.027+0000 7f1b69b00640 1 --2- 172.21.15.32:0/3743925468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b640d0a00 0x7f1b6409a290 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f1b64072ba0 tx=0x7f1b6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c15c1a1008b731 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.028+0000 7f1b692ff640 1 -- 172.21.15.32:0/3743925468 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60031830 con 0x7f1b640d0a00 2024-02-17T04:58:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.028+0000 7f1b692ff640 1 -- 172.21.15.32:0/3743925468 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b60031990 con 0x7f1b640d0a00 2024-02-17T04:58:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.028+0000 7f1b692ff640 1 -- 172.21.15.32:0/3743925468 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60031d20 con 0x7f1b640d0a00 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b640d0a00 msgr2=0x7f1b6409a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 --2- 172.21.15.32:0/3743925468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b640d0a00 0x7f1b6409a290 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f1b64072ba0 tx=0x7f1b6002b8d0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 shutdown_connections 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 --2- 172.21.15.32:0/3743925468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b640d0a00 0x7f1b6409a290 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 --2- 172.21.15.32:0/3743925468 >> v2:172.21.15.39:3300/0 conn(0x7f1b64161200 0x7f1b640cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 >> 172.21.15.32:0/3743925468 conn(0x7f1b640b31a0 msgr2=0x7f1b640b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 shutdown_connections 2024-02-17T04:58:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.029+0000 7f1b6c565640 1 -- 172.21.15.32:0/3743925468 wait complete. 2024-02-17T04:58:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.031+0000 7f1b6c565640 1 Processor -- start 2024-02-17T04:58:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.031+0000 7f1b6c565640 1 -- start start 2024-02-17T04:58:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6c565640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b6409a7d0 0x7f1b641f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6c565640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b640d0a00 0x7f1b640c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6c565640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 0x7f1b6415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6c565640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641f39f0 con 0x7f1b64161200 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6c565640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640c8550 con 0x7f1b640d0a00 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6c565640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641f44a0 con 0x7f1b6409a7d0 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 0x7f1b6415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 0x7f1b6415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53044/0 (socket says 172.21.15.32:53044) 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 -- 172.21.15.32:0/452414719 learned_addr learned my addr 172.21.15.32:0/452414719 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b69b00640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b640d0a00 0x7f1b640c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6a301640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b6409a7d0 0x7f1b641f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 -- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b6409a7d0 msgr2=0x7f1b641f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b6409a7d0 0x7f1b641f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 -- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b640d0a00 msgr2=0x7f1b640c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b640d0a00 0x7f1b640c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 -- 172.21.15.32:0/452414719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540094d0 con 0x7f1b64161200 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.032+0000 7f1b6ab02640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 0x7f1b6415fab0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c760 tx=0x7f1b5c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.033+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c006d50 con 0x7f1b64161200 2024-02-17T04:58:36.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.033+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b60009400 con 0x7f1b64161200 2024-02-17T04:58:36.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.033+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c003970 con 0x7f1b64161200 2024-02-17T04:58:36.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.033+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c003d20 con 0x7f1b64161200 2024-02-17T04:58:36.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.033+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b641f41c0 con 0x7f1b64161200 2024-02-17T04:58:36.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.034+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b640680c0 con 0x7f1b64161200 2024-02-17T04:58:36.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.034+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1b5c0050d0 con 0x7f1b64161200 2024-02-17T04:58:36.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.035+0000 7f1b5affd640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b4806b810 0x7f1b4806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.035+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6188+0+0 (secure 0 0 0) 0x7f1b5c089d10 con 0x7f1b64161200 2024-02-17T04:58:36.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.035+0000 7f1b6a301640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b4806b810 0x7f1b4806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.036+0000 7f1b6a301640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b4806b810 0x7f1b4806dcd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1b54006ca0 tx=0x7f1b54009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.042+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b5c0581c0 con 0x7f1b64161200 2024-02-17T04:58:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.313+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b64068f60 con 0x7f1b64161200 2024-02-17T04:58:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.314+0000 7f1b5affd640 1 -- 172.21.15.32:0/452414719 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b5c057d50 con 0x7f1b64161200 2024-02-17T04:58:36.315 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-02-17T04:58:36.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b4806b810 msgr2=0x7f1b4806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b4806b810 0x7f1b4806dcd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1b54006ca0 tx=0x7f1b54009240 comp rx=0 tx=0).stop 2024-02-17T04:58:36.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 msgr2=0x7f1b6415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 0x7f1b6415fab0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c760 tx=0x7f1b5c00cb60 comp rx=0 tx=0).stop 2024-02-17T04:58:36.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 shutdown_connections 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b64161200 0x7f1b6415fab0 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b640d0a00 0x7f1b640c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f1b4806b810 0x7f1b4806dcd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 --2- 172.21.15.32:0/452414719 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b6409a7d0 0x7f1b641f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 >> 172.21.15.32:0/452414719 conn(0x7f1b640b31a0 msgr2=0x7f1b640cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 shutdown_connections 2024-02-17T04:58:36.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.317+0000 7f1b6c565640 1 -- 172.21.15.32:0/452414719 wait complete. 2024-02-17T04:58:36.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T04:58:36.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.473+0000 7f3d7600b640 1 Processor -- start 2024-02-17T04:58:36.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.473+0000 7f3d7600b640 1 -- start start 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.474+0000 7f3d7600b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d700b1480 0x7f3d700b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.474+0000 7f3d7600b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.474+0000 7f3d7600b640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d700b25e0 con 0x7f3d700cfc40 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.474+0000 7f3d7600b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7015bec0 con 0x7f3d700b1480 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.474+0000 7f3d7600b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700b19d0 con 0x7f3d700cc580 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d6f7fe640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3d700cfc40 0x7f3d700d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57242/0 (socket says 172.21.15.32:57242) 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d6f7fe640 1 -- 172.21.15.32:0/2219474811 learned_addr learned my addr 172.21.15.32:0/2219474811 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d67fff640 1 --2- 172.21.15.32:0/2219474811 >> v2:172.21.15.39:3300/0 conn(0x7f3d700b1480 0x7f3d700b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d6ffff640 1 --2- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d67fff640 1 -- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 msgr2=0x7f3d700cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T04:58:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d67fff640 1 --2- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d67fff640 1 -- 172.21.15.32:0/2219474811 >> v1:172.21.15.32:6789/0 conn(0x7f3d700cfc40 legacy=0x7f3d700d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.475+0000 7f3d67fff640 1 -- 172.21.15.32:0/2219474811 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700b1cb0 con 0x7f3d700b1480 2024-02-17T04:58:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.476+0000 7f3d67fff640 1 --2- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700b1480 0x7f3d700b0ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d580097a0 tx=0x7f3d5802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d00198acf2c8a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.477+0000 7f3d6effd640 1 -- 172.21.15.32:0/2219474811 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58030710 con 0x7f3d700b1480 2024-02-17T04:58:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.477+0000 7f3d6effd640 1 -- 172.21.15.32:0/2219474811 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5802e050 con 0x7f3d700b1480 2024-02-17T04:58:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.477+0000 7f3d6effd640 1 -- 172.21.15.32:0/2219474811 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58030a90 con 0x7f3d700b1480 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 -- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700b1480 msgr2=0x7f3d700b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 --2- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700b1480 0x7f3d700b0ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d580097a0 tx=0x7f3d5802b710 comp rx=0 tx=0).stop 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 -- 172.21.15.32:0/2219474811 shutdown_connections 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 --2- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700b1480 0x7f3d700b0ad0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 --2- 172.21.15.32:0/2219474811 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 -- 172.21.15.32:0/2219474811 >> 172.21.15.32:0/2219474811 conn(0x7f3d7008af80 msgr2=0x7f3d7008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.478+0000 7f3d7600b640 1 -- 172.21.15.32:0/2219474811 shutdown_connections 2024-02-17T04:58:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.479+0000 7f3d7600b640 1 -- 172.21.15.32:0/2219474811 wait complete. 2024-02-17T04:58:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.480+0000 7f3d7600b640 1 Processor -- start 2024-02-17T04:58:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.480+0000 7f3d7600b640 1 -- start start 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d7600b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 0x7f3d70158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d7600b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d7600b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700cfc40 0x7f3d700ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d7600b640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700afa90 con 0x7f3d700b1480 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d7600b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70157190 con 0x7f3d700cfc40 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d7600b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70157470 con 0x7f3d700cc580 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 0x7f3d70158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 0x7f3d70158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53056/0 (socket says 172.21.15.32:53056) 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 -- 172.21.15.32:0/3536893098 learned_addr learned my addr 172.21.15.32:0/3536893098 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6ffff640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700cfc40 0x7f3d700ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d67fff640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 -- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 msgr2=0x7f3d700c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 -- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700cfc40 msgr2=0x7f3d700ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700cfc40 0x7f3d700ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.481+0000 7f3d6f7fe640 1 -- 172.21.15.32:0/3536893098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58009400 con 0x7f3d700b1480 2024-02-17T04:58:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.482+0000 7f3d6f7fe640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 0x7f3d70158230 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000c780 tx=0x7f3d6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.483+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600072d0 con 0x7f3d700b1480 2024-02-17T04:58:36.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.483+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d70157750 con 0x7f3d700b1480 2024-02-17T04:58:36.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.483+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d70157d10 con 0x7f3d700b1480 2024-02-17T04:58:36.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.483+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60007430 con 0x7f3d700b1480 2024-02-17T04:58:36.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.484+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600047e0 con 0x7f3d700b1480 2024-02-17T04:58:36.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.484+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54005290 con 0x7f3d700b1480 2024-02-17T04:58:36.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.485+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3d60004960 con 0x7f3d700b1480 2024-02-17T04:58:36.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.486+0000 7f3d6cff9640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3d5006b810 0x7f3d5006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.486+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6188+0+0 (secure 0 0 0) 0x7f3d60089a50 con 0x7f3d700b1480 2024-02-17T04:58:36.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.486+0000 7f3d67fff640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3d5006b810 0x7f3d5006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.487+0000 7f3d67fff640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3d5006b810 0x7f3d5006dcd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d58034000 tx=0x7f3d58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.493+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d600543e0 con 0x7f3d700b1480 2024-02-17T04:58:36.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.766+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d54005810 con 0x7f3d700b1480 2024-02-17T04:58:36.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.766+0000 7f3d6cff9640 1 -- 172.21.15.32:0/3536893098 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d60018070 con 0x7f3d700b1480 2024-02-17T04:58:36.768 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-02-17T04:58:36.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3d5006b810 msgr2=0x7f3d5006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3d5006b810 0x7f3d5006dcd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d58034000 tx=0x7f3d58008030 comp rx=0 tx=0).stop 2024-02-17T04:58:36.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 msgr2=0x7f3d70158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 0x7f3d70158230 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000c780 tx=0x7f3d6000cc40 comp rx=0 tx=0).stop 2024-02-17T04:58:36.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 shutdown_connections 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d700cfc40 0x7f3d700ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f3d5006b810 0x7f3d5006dcd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3d700cc580 0x7f3d700c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 --2- 172.21.15.32:0/3536893098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d700b1480 0x7f3d70158230 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.768+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 >> 172.21.15.32:0/3536893098 conn(0x7f3d7008af80 msgr2=0x7f3d700c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.769+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 shutdown_connections 2024-02-17T04:58:36.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.769+0000 7f3d7600b640 1 -- 172.21.15.32:0/3536893098 wait complete. 2024-02-17T04:58:36.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.915+0000 7f6a46f8c640 1 Processor -- start 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.915+0000 7f6a46f8c640 1 -- start start 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a46f8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a4016e7e0 0x7f6a400b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a46f8c640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a400b1de0 0x7f6a400cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a46f8c640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a400cc720 con 0x7f6a4016a460 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a46f8c640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a400cca00 con 0x7f6a400b1de0 2024-02-17T04:58:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a46f8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a400ccce0 con 0x7f6a4016e7e0 2024-02-17T04:58:36.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a45529640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a400b1de0 0x7f6a400cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a45529640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a400b1de0 0x7f6a400cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53070/0 (socket says 172.21.15.32:53070) 2024-02-17T04:58:36.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a45529640 1 -- 172.21.15.32:0/168272136 learned_addr learned my addr 172.21.15.32:0/168272136 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:36.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.916+0000 7f6a3ffff640 1 --2- 172.21.15.32:0/168272136 >> v2:172.21.15.39:3300/0 conn(0x7f6a4016e7e0 0x7f6a400b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.917+0000 7f6a45529640 1 -- 172.21.15.32:0/168272136 >> v2:172.21.15.39:3300/0 conn(0x7f6a4016e7e0 msgr2=0x7f6a400b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.917+0000 7f6a45529640 1 --2- 172.21.15.32:0/168272136 >> v2:172.21.15.39:3300/0 conn(0x7f6a4016e7e0 0x7f6a400b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.917+0000 7f6a45529640 1 -- 172.21.15.32:0/168272136 >> v1:172.21.15.32:6789/0 conn(0x7f6a4016a460 legacy=0x7f6a4016e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.917+0000 7f6a45529640 1 -- 172.21.15.32:0/168272136 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400ccfc0 con 0x7f6a400b1de0 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.918+0000 7f6a45529640 1 --2- 172.21.15.32:0/168272136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a400cd7c0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f6a4006cc80 tx=0x7f6a3802e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811845c9bcbc98b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.918+0000 7f6a3f7fe640 1 -- 172.21.15.32:0/168272136 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38035500 con 0x7f6a400b1de0 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.918+0000 7f6a3f7fe640 1 -- 172.21.15.32:0/168272136 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38035660 con 0x7f6a400b1de0 2024-02-17T04:58:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.918+0000 7f6a3f7fe640 1 -- 172.21.15.32:0/168272136 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380359f0 con 0x7f6a400b1de0 2024-02-17T04:58:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 -- 172.21.15.32:0/168272136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 msgr2=0x7f6a400cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/168272136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a400cd7c0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f6a4006cc80 tx=0x7f6a3802e830 comp rx=0 tx=0).stop 2024-02-17T04:58:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 -- 172.21.15.32:0/168272136 shutdown_connections 2024-02-17T04:58:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/168272136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a400cd7c0 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/168272136 >> v2:172.21.15.39:3300/0 conn(0x7f6a4016e7e0 0x7f6a400b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 -- 172.21.15.32:0/168272136 >> 172.21.15.32:0/168272136 conn(0x7f6a40071150 msgr2=0x7f6a40071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 -- 172.21.15.32:0/168272136 shutdown_connections 2024-02-17T04:58:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.919+0000 7f6a46f8c640 1 -- 172.21.15.32:0/168272136 wait complete. 2024-02-17T04:58:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.921+0000 7f6a46f8c640 1 Processor -- start 2024-02-17T04:58:36.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.921+0000 7f6a46f8c640 1 -- start start 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a46f8c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a4016c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a46f8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4016a460 0x7f6a402009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a46f8c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 0x7f6a4015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a46f8c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40160740 con 0x7f6a400b1de0 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a46f8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40200f30 con 0x7f6a4016a460 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a46f8c640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4015cd90 con 0x7f6a4016e7e0 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a44d28640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a4016c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a45529640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 0x7f6a4015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a45529640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 0x7f6a4015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.32:35026/0 (socket says 172.21.15.32:35026) 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.922+0000 7f6a45529640 1 -- 172.21.15.32:0/1261143391 learned_addr learned my addr 172.21.15.32:0/1261143391 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a3ffff640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4016a460 0x7f6a402009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a44d28640 1 -- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 msgr2=0x7f6a4015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a44d28640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 0x7f6a4015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a44d28640 1 -- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4016a460 msgr2=0x7f6a402009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a44d28640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4016a460 0x7f6a402009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a44d28640 1 -- 172.21.15.32:0/1261143391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38008b20 con 0x7f6a400b1de0 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a45529640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 0x7f6a4015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a3ffff640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4016a460 0x7f6a402009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a44d28640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a4016c8a0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c370 tx=0x7f6a3400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.923+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340052d0 con 0x7f6a400b1de0 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.924+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34005450 con 0x7f6a400b1de0 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.924+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34007260 con 0x7f6a400b1de0 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.924+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4016a9c0 con 0x7f6a400b1de0 2024-02-17T04:58:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.924+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4016d160 con 0x7f6a400b1de0 2024-02-17T04:58:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.925+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a40068fd0 con 0x7f6a400b1de0 2024-02-17T04:58:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.926+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6a340073c0 con 0x7f6a400b1de0 2024-02-17T04:58:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.926+0000 7f6a3d7fa640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a2406b810 0x7f6a2406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T04:58:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.926+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6188+0+0 (secure 0 0 0) 0x7f6a34089680 con 0x7f6a400b1de0 2024-02-17T04:58:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.926+0000 7f6a3ffff640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a2406b810 0x7f6a2406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T04:58:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.927+0000 7f6a3ffff640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a2406b810 0x7f6a2406dcd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6a40067cc0 tx=0x7f6a2c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T04:58:36.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:36.931+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a34053f70 con 0x7f6a400b1de0 2024-02-17T04:58:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.233+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a4006c1a0 con 0x7f6a400b1de0 2024-02-17T04:58:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.233+0000 7f6a3d7fa640 1 -- 172.21.15.32:0/1261143391 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a34057630 con 0x7f6a400b1de0 2024-02-17T04:58:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a2406b810 msgr2=0x7f6a2406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a2406b810 0x7f6a2406dcd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6a40067cc0 tx=0x7f6a2c009190 comp rx=0 tx=0).stop 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 msgr2=0x7f6a4016c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a4016c8a0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c370 tx=0x7f6a3400c830 comp rx=0 tx=0).stop 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 shutdown_connections 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:6832/2740259094,v1:172.21.15.39:6833/2740259094] conn(0x7f6a2406b810 0x7f6a2406dcd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a4016e7e0 0x7f6a4015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a4016a460 0x7f6a402009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 --2- 172.21.15.32:0/1261143391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a400b1de0 0x7f6a4016c8a0 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 >> 172.21.15.32:0/1261143391 conn(0x7f6a40071150 msgr2=0x7f6a40168d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 shutdown_connections 2024-02-17T04:58:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-02-17T04:58:37.236+0000 7f6a46f8c640 1 -- 172.21.15.32:0/1261143391 wait complete. 2024-02-17T04:58:37.253 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-17T04:58:37.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T04:58:37.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-17T04:58:37.321 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T04:58:37.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T04:58:37.321 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T04:58:37.401 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-02-17T04:58:37.401 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T04:58:37.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057147,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.32:6789:/test /tmp/tmp.nBvl8wthmctest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=2fde0ac4-9f5d-41d6-aea9-1575265f7f65,acl 0 0 2024-02-17T04:58:37.419 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-02-17T04:58:37.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T04:58:37.419 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-02-17T04:58:37.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T04:58:37.477 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-02-17T04:58:37.478 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T04:58:37.478 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T04:58:37.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056376,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-17T04:58:37.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T04:58:37.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T04:58:37.518 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T04:58:37.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T04:58:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-02-17T04:58:37.589 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-02-17T04:58:37.589 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T04:58:37.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056376,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-17T04:58:37.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-02-17T04:58:37.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T04:58:37.650 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-02-17T04:58:37.709 INFO:teuthology.orchestra.run.smithi039.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-02-17T04:58:37.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T04:58:39.322 INFO:tasks.ceph.osd.0:Sent signal 15 2024-02-17T04:58:39.322 INFO:tasks.ceph.osd.1:Sent signal 15 2024-02-17T04:58:39.322 INFO:tasks.ceph.osd.2:Sent signal 15 2024-02-17T04:58:39.323 INFO:tasks.ceph.osd.4:Sent signal 15 2024-02-17T04:58:39.323 INFO:tasks.ceph.osd.5:Sent signal 15 2024-02-17T04:58:39.323 INFO:tasks.ceph.osd.6:Sent signal 15 2024-02-17T04:58:39.323 INFO:tasks.ceph.osd.7:Sent signal 15 2024-02-17T04:58:39.323 INFO:tasks.ceph.mds.a:Sent signal 15 2024-02-17T04:58:39.324 INFO:tasks.ceph.mds.c:Sent signal 15 2024-02-17T04:58:39.324 INFO:tasks.ceph.mds.b:Sent signal 15 2024-02-17T04:58:39.324 INFO:tasks.ceph.mds.d:Sent signal 15 2024-02-17T04:58:39.324 INFO:tasks.ceph.mon.a:Sent signal 15 2024-02-17T04:58:39.324 INFO:tasks.ceph.mon.b:Sent signal 15 2024-02-17T04:58:39.325 INFO:tasks.ceph.mon.c:Sent signal 15 2024-02-17T04:58:39.325 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-02-17T04:58:39.325 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-02-17T04:58:39.326 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:58:39.322+0000 7fa7979e8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 38343) UID: 0 2024-02-17T04:58:39.326 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:58:39.322+0000 7fa7979e8640 -1 osd.4 45 *** Got signal Terminated *** 2024-02-17T04:58:39.326 INFO:tasks.ceph.osd.4.smithi039.stderr:2024-02-17T04:58:39.322+0000 7fa7979e8640 -1 osd.4 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.326 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:58:39.322+0000 7fec86e01640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 38346) UID: 0 2024-02-17T04:58:39.326 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:58:39.322+0000 7fec86e01640 -1 osd.5 45 *** Got signal Terminated *** 2024-02-17T04:58:39.326 INFO:tasks.ceph.osd.5.smithi039.stderr:2024-02-17T04:58:39.322+0000 7fec86e01640 -1 osd.5 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.327 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:58:39.322+0000 7f77a94aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 38348) UID: 0 2024-02-17T04:58:39.327 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:58:39.322+0000 7f77a94aa640 -1 osd.7 45 *** Got signal Terminated *** 2024-02-17T04:58:39.327 INFO:tasks.ceph.osd.7.smithi039.stderr:2024-02-17T04:58:39.322+0000 7f77a94aa640 -1 osd.7 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.327 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:58:39.322+0000 7f0f1542f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 38349) UID: 0 2024-02-17T04:58:39.327 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:58:39.322+0000 7f0f1542f640 -1 osd.6 45 *** Got signal Terminated *** 2024-02-17T04:58:39.328 INFO:tasks.ceph.osd.6.smithi039.stderr:2024-02-17T04:58:39.322+0000 7f0f1542f640 -1 osd.6 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.328 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T04:58:39.323+0000 7ffa5085d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44759) UID: 0 2024-02-17T04:58:39.328 INFO:tasks.ceph.mds.b.smithi039.stderr:2024-02-17T04:58:39.323+0000 7ffa5085d640 -1 mds.b *** got signal Terminated *** 2024-02-17T04:58:39.328 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T04:58:39.323+0000 7f4b4fc92640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 44758) UID: 0 2024-02-17T04:58:39.328 INFO:tasks.ceph.mds.d.smithi039.stderr:2024-02-17T04:58:39.323+0000 7f4b4fc92640 -1 mds.d *** got signal Terminated *** 2024-02-17T04:58:39.329 INFO:tasks.ceph.mon.b.smithi039.stderr:2024-02-17T04:58:39.324+0000 7febbb0ac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 37774) UID: 0 2024-02-17T04:58:39.329 INFO:tasks.ceph.mon.b.smithi039.stderr:2024-02-17T04:58:39.324+0000 7febbb0ac640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-02-17T04:58:39.329 INFO:tasks.ceph.mon.c.smithi039.stderr:2024-02-17T04:58:39.324+0000 7f19d7eb7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 37777) UID: 0 2024-02-17T04:58:39.329 INFO:tasks.ceph.mon.c.smithi039.stderr:2024-02-17T04:58:39.324+0000 7f19d7eb7640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-02-17T04:58:39.330 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:58:39.322+0000 7f278591e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 38221) UID: 0 2024-02-17T04:58:39.330 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:58:39.322+0000 7f278591e640 -1 osd.2 45 *** Got signal Terminated *** 2024-02-17T04:58:39.330 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-02-17T04:58:39.322+0000 7f278591e640 -1 osd.2 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.330 INFO:tasks.ceph.mds.a.smithi032.stderr:2024-02-17T04:58:39.324+0000 7f8834d8b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 51256) UID: 0 2024-02-17T04:58:39.330 INFO:tasks.ceph.mds.a.smithi032.stderr:2024-02-17T04:58:39.324+0000 7f8834d8b640 -1 mds.a *** got signal Terminated *** 2024-02-17T04:58:39.331 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:58:39.321+0000 7f8b9c692640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38212) UID: 0 2024-02-17T04:58:39.331 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:58:39.321+0000 7f8b9c692640 -1 osd.0 45 *** Got signal Terminated *** 2024-02-17T04:58:39.331 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-02-17T04:58:39.321+0000 7f8b9c692640 -1 osd.0 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.331 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-02-17T04:58:39.324+0000 7fc2575b7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 51257) UID: 0 2024-02-17T04:58:39.331 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-02-17T04:58:39.324+0000 7fc2575b7640 -1 mds.c *** got signal Terminated *** 2024-02-17T04:58:39.331 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-02-17T04:58:39.325+0000 7fd4cb01c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 37936) UID: 0 2024-02-17T04:58:39.332 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-02-17T04:58:39.325+0000 7fd4cb01c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-17T04:58:39.332 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-02-17T04:58:39.325+0000 7fd4c5811640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T04:58:39.334 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:58:39.326+0000 7f22a5a92640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 38213) UID: 0 2024-02-17T04:58:39.334 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:58:39.326+0000 7f22a5a92640 -1 osd.1 45 *** Got signal Terminated *** 2024-02-17T04:58:39.334 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-02-17T04:58:39.326+0000 7f22a5a92640 -1 osd.1 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T04:58:39.527 INFO:tasks.ceph.mgr.y.smithi032.stderr:daemon-helper: command crashed with signal 15 2024-02-17T05:00:52.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:00:52.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:00:52.488 INFO:teuthology.orchestra.run.smithi039.stderr:ceph-osd: no process found 2024-02-17T05:03:43.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:03:43.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:04:13.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:04:13.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:04:43.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:04:43.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:05:13.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:05:13.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:05:43.317 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:05:43.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:06:13.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:06:13.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:06:43.468 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:06:43.472 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:07:13.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:07:13.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:07:43.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:07:43.620 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:08:13.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:08:13.710 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:08:43.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:08:43.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:09:13.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:09:13.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:09:43.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:09:43.925 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:10:13.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:10:13.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:10:44.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:10:44.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:11:14.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:11:14.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:11:44.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:11:44.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:12:14.310 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:12:14.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:12:44.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:12:44.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:13:14.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:13:14.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:13:44.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:13:44.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:14:14.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:14:14.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:14:44.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:14:44.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:15:14.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:15:14.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:15:44.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:15:44.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:16:14.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:16:14.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:16:44.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:16:44.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:17:15.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:17:15.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:17:45.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:17:45.105 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:18:15.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:18:15.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:18:45.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:18:45.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:19:15.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:19:15.328 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:19:45.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:19:45.399 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:20:15.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:20:15.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:20:45.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:20:45.562 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:21:15.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:21:15.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:21:45.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:21:45.697 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:22:15.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:22:15.763 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:22:45.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:22:45.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:23:15.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:23:15.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:23:45.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:23:45.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:24:16.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:24:16.058 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:24:46.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:24:46.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:25:16.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:25:16.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:25:46.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:25:46.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:26:16.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:26:16.339 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:26:46.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:26:46.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:27:16.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:27:16.625 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:27:46.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:27:46.699 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:28:16.765 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:28:16.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:28:46.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:28:46.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:29:16.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:29:16.913 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:29:46.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:29:46.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:30:17.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:30:17.041 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:30:47.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:30:47.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:31:17.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:31:17.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:31:47.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:31:47.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:32:17.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:32:17.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:32:47.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:32:47.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:33:17.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:33:17.476 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:33:47.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:33:47.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:34:17.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:34:17.619 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:34:47.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:34:47.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:35:17.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:35:17.763 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:35:47.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:35:47.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:36:17.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:36:17.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:36:47.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:36:47.998 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:37:18.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:37:18.071 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:37:48.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:37:48.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:38:18.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:38:18.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:38:48.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:38:48.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:39:18.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:39:18.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:39:48.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:39:48.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:40:18.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:40:18.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:40:48.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:40:48.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:41:18.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:41:18.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:41:48.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:41:48.772 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:42:18.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:42:18.851 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:42:48.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:42:48.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:43:19.007 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:43:19.010 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:43:49.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:43:49.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:44:19.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:44:19.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:44:49.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:44:49.221 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:45:19.332 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:45:19.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:45:49.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:45:49.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:46:19.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:46:19.496 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:46:49.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:46:49.576 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:47:19.644 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:47:19.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:47:49.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:47:49.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:48:19.812 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:48:19.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:48:49.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:48:49.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:49:19.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:49:19.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:49:50.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:49:50.020 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:50:20.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:50:20.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:50:50.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:50:50.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:51:20.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:51:20.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:51:50.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:51:50.317 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:52:20.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:52:20.398 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:52:50.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:52:50.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:53:20.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:53:20.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:53:50.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:53:50.723 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:54:20.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:54:20.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:54:50.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:54:50.867 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:55:20.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:55:20.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:55:50.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:55:51.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:56:21.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:56:21.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:56:51.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:56:51.157 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:57:21.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:57:21.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:57:51.339 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:57:51.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:58:21.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:58:21.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:58:51.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:58:51.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:59:21.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:59:21.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:59:51.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T05:59:51.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:00:21.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:00:21.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:00:51.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:00:51.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:01:21.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:01:21.865 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:01:51.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:01:51.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:02:22.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:02:22.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:02:52.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:02:52.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:03:22.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:03:22.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:03:52.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:03:52.250 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:04:22.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:04:22.324 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:04:52.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:04:52.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:05:22.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:05:22.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:05:52.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:05:52.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:06:22.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:06:22.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:06:52.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:06:52.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:07:22.752 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:07:22.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:07:52.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:07:52.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:08:22.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:08:22.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:08:52.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:08:52.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:09:23.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:09:23.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:09:53.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:09:53.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:10:23.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:10:23.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:10:53.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:10:53.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:11:23.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:11:23.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:11:53.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:11:53.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:12:23.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:12:23.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:12:53.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:12:53.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:13:23.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:13:23.631 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:13:53.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:13:53.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:14:23.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:14:23.775 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:14:53.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:14:53.837 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:15:23.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:15:23.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:15:53.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:15:53.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:16:24.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:16:24.056 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:16:54.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:16:54.131 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:17:24.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:17:24.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:17:54.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:17:54.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:18:24.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:18:24.338 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:18:54.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:18:54.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:19:24.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:19:24.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:19:54.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:19:54.608 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:20:24.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:20:24.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:20:54.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:20:54.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:21:24.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:21:24.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:21:54.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:21:54.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:22:24.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:22:24.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:22:55.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:22:55.061 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:23:25.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:23:25.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:23:55.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:23:55.195 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:24:25.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:24:25.264 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:24:55.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:24:55.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:25:25.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:25:25.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:25:55.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:25:55.488 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:26:25.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:26:25.562 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:26:55.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:26:55.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:27:25.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:27:25.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:27:55.813 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:27:55.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:28:25.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:28:25.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:28:55.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:28:55.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:29:26.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:29:26.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:29:56.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:29:56.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:30:26.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:30:26.199 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:30:56.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:30:56.270 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:31:26.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:31:26.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:31:56.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:31:56.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:32:26.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:32:26.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:32:56.567 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:32:56.571 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:33:26.642 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:33:26.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:33:56.710 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:33:56.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:34:26.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:34:26.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:34:56.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:34:56.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:35:26.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:35:26.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:35:56.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:35:57.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:36:27.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:36:27.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:36:57.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:36:57.148 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:37:27.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:37:27.219 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:37:57.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:37:57.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:38:27.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:38:27.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:38:57.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:38:57.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:39:27.489 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:39:27.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:39:57.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:39:57.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:40:27.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:40:27.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:40:57.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:40:57.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:41:27.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:41:27.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:41:57.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:41:57.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:42:28.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:42:28.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:42:58.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:42:58.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:43:28.217 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:43:28.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:43:58.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:43:58.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:44:28.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:44:28.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:44:58.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:44:58.553 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:45:28.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:45:28.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:45:58.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:45:58.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:46:28.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:46:28.903 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:46:58.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:46:58.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:47:29.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:47:29.039 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:47:59.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:47:59.104 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:48:29.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:48:29.177 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:48:59.243 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:48:59.247 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:49:29.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:49:29.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:49:59.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:49:59.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:50:29.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:50:29.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:50:59.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:50:59.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:51:29.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:51:29.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:51:59.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:51:59.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:52:29.733 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:52:29.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:52:59.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:52:59.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:53:29.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:53:29.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:53:59.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:53:59.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:54:30.004 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:54:30.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:55:00.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:55:00.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:55:30.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:55:30.151 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:56:00.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:56:00.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:56:30.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:56:30.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:57:00.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:57:00.374 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:57:30.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:57:30.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:58:00.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:58:00.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:58:30.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:58:30.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:59:00.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:59:00.786 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:59:30.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T06:59:30.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:00:00.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:00:00.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:00:31.012 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:00:31.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:01:01.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:01:01.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:01:31.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:01:31.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:02:01.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:02:01.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:02:31.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:02:31.360 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:03:01.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:03:01.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:03:31.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:03:31.503 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:04:01.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:04:01.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:04:31.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:04:31.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:05:01.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:05:01.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:05:31.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:05:31.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:06:01.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:06:01.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:06:31.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:06:31.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:07:02.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:07:02.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:07:32.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:07:32.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:08:02.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:08:02.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:08:32.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:08:32.242 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:09:02.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:09:02.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:09:32.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:09:32.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:10:02.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:10:02.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:10:32.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:10:32.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:11:02.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:11:02.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:11:32.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:11:32.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:12:02.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:12:02.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:12:32.980 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:12:32.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:13:03.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:13:03.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:13:33.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:13:33.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:14:03.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:14:03.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:14:33.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:14:33.279 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:15:03.339 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:15:03.343 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:15:33.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:15:33.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:16:03.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:16:03.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:16:33.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:16:33.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:17:03.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:17:03.642 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:17:33.734 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:17:33.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:18:03.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:18:03.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:18:33.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:18:33.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:19:03.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:19:03.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:19:34.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:19:34.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:20:04.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:20:04.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:20:34.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:20:34.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:21:04.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:21:04.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:21:34.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:21:34.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:22:04.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:22:04.456 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:22:34.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:22:34.530 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:23:04.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:23:04.607 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:23:34.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:23:34.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:24:04.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:24:04.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:24:34.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:24:34.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:25:04.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:25:04.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:25:35.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:25:35.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:26:05.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:26:05.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:26:35.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:26:35.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:27:05.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:27:05.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:27:35.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:27:35.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:28:05.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:28:05.456 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:28:35.532 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:28:35.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:29:05.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:29:05.720 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:29:35.786 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:29:35.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:30:05.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:30:05.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:30:36.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:30:36.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:31:06.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:31:06.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:31:36.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:31:36.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:32:06.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:32:06.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:32:36.302 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:32:36.306 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:33:06.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:33:06.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:33:36.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:33:36.460 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:34:06.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:34:06.524 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:34:36.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:34:36.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:35:06.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:35:06.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:35:36.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:35:36.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:36:06.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:36:06.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:36:37.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:36:37.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:37:07.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:37:07.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:37:37.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:37:37.173 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:38:07.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:38:07.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:38:37.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:38:37.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:39:07.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:39:07.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:39:37.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:39:37.504 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:40:07.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:40:07.576 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:40:37.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:40:37.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:41:07.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:41:07.718 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:41:37.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:41:37.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:42:07.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:42:07.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:42:37.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:42:37.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:43:08.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:43:08.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:43:38.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:43:38.111 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:44:08.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:44:08.172 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:44:38.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:44:38.250 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:45:08.319 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:45:08.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:45:38.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:45:38.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:46:08.586 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:46:08.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:46:38.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:46:38.692 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:47:08.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:47:08.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:47:38.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:47:38.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:48:08.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:48:08.908 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:48:38.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:48:38.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:49:09.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:49:09.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:49:39.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:49:39.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:50:09.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:50:09.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:50:39.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:50:39.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:51:09.325 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:51:09.329 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:51:39.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:51:39.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:52:09.489 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:52:09.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:52:39.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:52:39.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:53:09.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:53:09.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:53:39.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:53:39.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:54:09.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:54:09.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:54:39.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:54:39.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:55:09.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:55:09.971 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:55:40.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:55:40.044 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:56:10.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:56:10.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:56:40.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:56:40.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:57:10.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:57:10.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:57:40.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:57:40.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:58:10.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:58:10.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:58:40.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:58:40.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:59:10.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:59:10.720 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:59:40.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T07:59:40.794 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:00:10.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:00:10.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:00:40.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:00:40.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:01:11.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:01:11.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:01:41.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:01:41.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:02:11.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:02:11.405 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:02:41.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:02:41.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:03:11.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:03:11.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:03:41.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:03:41.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:04:11.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:04:11.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:04:41.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:04:41.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:05:11.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:05:11.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:05:41.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:05:41.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:06:11.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:06:12.000 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:06:42.209 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:06:42.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:07:12.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:07:12.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:07:42.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:07:42.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:08:12.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:08:12.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:08:42.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:08:42.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:09:12.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:09:12.576 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:09:42.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:09:42.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:10:12.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:10:12.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:10:42.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:10:42.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:11:12.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:11:12.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:11:42.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:11:42.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:12:13.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:12:13.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:12:43.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:12:43.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:13:13.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:13:13.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:13:43.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:13:43.247 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:14:13.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:14:13.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:14:43.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:14:43.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:15:13.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:15:13.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:15:43.532 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:15:43.536 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:16:13.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:16:13.743 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:16:43.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:16:43.818 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:17:13.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:17:13.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:17:43.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:17:43.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:18:14.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:18:14.034 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:18:44.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:18:44.105 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:19:14.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:19:14.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:19:44.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:19:44.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:20:14.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:20:14.318 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:20:44.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:20:44.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:21:14.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:21:14.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:21:44.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:21:44.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:22:14.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:22:14.622 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:22:44.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:22:44.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:23:14.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:23:14.774 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:23:44.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:23:44.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:24:14.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:24:14.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:24:44.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:24:44.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:25:15.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:25:15.048 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:25:45.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:25:45.130 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:26:15.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:26:15.191 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:26:45.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:26:45.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:27:15.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:27:15.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:27:45.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:27:45.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:28:15.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:28:15.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:28:45.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:28:45.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:29:15.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:29:15.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:29:45.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:29:45.718 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:30:15.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:30:15.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:30:45.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:30:45.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:31:15.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:31:15.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:31:46.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:31:46.024 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:32:16.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:32:16.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:32:46.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:32:46.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:33:16.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:33:16.241 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:33:46.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:33:46.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:34:16.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:34:16.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:34:46.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:34:46.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:35:16.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:35:16.538 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:35:46.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:35:46.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:36:16.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:36:16.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:36:46.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:36:46.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:37:16.815 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:37:16.818 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:37:46.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:37:46.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:38:16.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:38:16.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:38:47.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:38:47.034 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:39:17.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:39:17.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:39:47.175 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:39:47.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:40:17.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:40:17.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:40:47.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:40:47.312 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:41:17.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:41:17.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:41:47.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:41:47.468 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:42:17.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:42:17.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:42:47.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:42:47.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:43:17.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:43:17.685 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:43:47.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:43:47.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:44:17.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:44:17.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:44:48.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:44:48.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:45:18.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:45:18.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:45:48.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:45:48.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:46:18.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:46:18.261 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:46:48.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:46:48.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:47:18.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:47:18.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:47:48.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:47:48.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:48:18.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:48:18.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:48:48.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:48:48.691 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:49:18.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:49:18.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:49:48.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:49:48.834 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:50:18.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:50:18.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:50:48.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:50:48.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:51:19.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:51:19.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:51:49.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:51:49.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:52:19.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:52:19.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:52:49.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:52:49.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:53:19.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:53:19.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:53:49.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:53:49.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:54:19.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:54:19.540 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:54:49.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:54:49.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:55:19.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:55:19.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:55:49.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:55:49.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:56:19.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:56:19.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:56:49.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:56:49.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:57:20.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:57:20.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:57:50.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:57:50.156 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:58:20.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:58:20.228 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:58:50.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:58:50.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:59:20.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:59:20.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:59:50.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T08:59:50.455 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:00:20.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:00:20.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:00:50.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:00:50.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:01:20.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:01:20.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:01:50.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:01:50.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:02:20.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:02:20.943 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:02:51.012 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:02:51.015 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:03:21.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:03:21.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:03:51.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:03:51.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:04:21.217 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:04:21.222 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:04:51.297 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:04:51.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:05:21.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:05:21.363 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:05:51.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:05:51.462 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:06:21.531 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:06:21.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:06:51.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:06:51.609 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:07:21.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:07:21.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:07:51.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:07:51.759 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:08:21.828 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:08:21.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:08:51.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:08:51.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:09:22.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:09:22.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:09:52.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:09:52.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:10:22.143 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:10:22.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:10:52.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:10:52.217 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:11:22.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:11:22.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:11:52.384 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:11:52.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:12:22.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:12:22.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:12:52.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:12:52.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:13:22.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:13:22.623 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:13:52.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:13:52.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:14:22.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:14:22.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:14:52.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:14:52.843 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:15:22.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:15:22.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:15:52.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:15:52.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:16:23.037 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:16:23.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:16:53.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:16:53.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:17:23.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:17:23.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:17:53.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:17:53.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:18:23.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:18:23.317 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:18:53.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:18:53.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:19:23.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:19:23.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:19:53.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:19:53.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:20:23.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:20:23.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:20:53.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:20:53.696 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:21:23.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:21:23.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:21:53.827 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:21:53.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:22:23.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:22:23.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:22:53.963 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:22:53.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:23:24.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:23:24.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:23:54.220 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:23:54.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:24:24.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:24:24.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:24:54.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:24:54.371 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:25:24.449 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:25:24.453 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:25:54.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:25:54.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:26:24.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:26:24.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:26:54.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:26:54.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:27:24.764 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:27:24.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:27:54.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:27:54.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:28:24.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:28:24.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:28:54.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:28:54.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:29:25.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:29:25.065 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:29:55.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:29:55.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:30:25.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:30:25.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:30:55.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:30:55.428 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:31:25.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:31:25.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:31:55.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:31:55.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:32:25.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:32:25.639 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:32:55.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:32:55.717 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:33:25.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:33:25.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:33:55.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:33:55.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:34:25.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:34:25.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:34:56.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:34:56.020 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:35:26.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:35:26.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:35:56.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:35:56.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:36:26.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:36:26.376 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:36:56.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:36:56.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:37:26.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:37:26.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:37:56.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:37:56.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:38:26.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:38:26.675 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:38:56.742 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:38:56.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:39:26.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:39:26.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:39:56.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:39:56.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:40:26.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:40:26.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:40:57.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:40:57.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:41:27.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:41:27.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:41:57.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:41:57.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:42:27.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:42:27.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:42:57.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:42:57.405 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:43:27.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:43:27.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:43:57.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:43:57.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:44:27.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:44:27.631 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:44:57.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:44:57.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:45:27.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:45:27.785 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:45:57.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:45:57.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:46:27.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:46:27.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:46:58.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:46:58.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:47:28.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:47:28.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:47:58.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:47:58.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:48:28.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:48:28.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:48:58.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:48:58.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:49:28.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:49:28.498 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:49:58.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:49:58.571 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:50:28.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:50:28.644 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:50:58.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:50:58.740 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:51:28.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:51:28.802 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:51:58.873 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:51:58.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:52:28.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:52:28.949 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:52:59.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:52:59.024 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:53:29.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:53:29.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:53:59.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:53:59.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:54:29.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:54:29.230 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:54:59.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:54:59.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:55:29.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:55:29.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:55:59.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:55:59.455 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:56:29.518 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:56:29.522 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:56:59.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:56:59.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:57:29.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:57:29.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:57:59.733 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:57:59.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:58:29.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:58:29.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:58:59.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:58:59.897 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:59:29.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T09:59:29.969 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:00:00.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:00:00.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:00:30.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:00:30.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:01:00.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:01:00.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:01:30.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:01:30.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:02:00.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:02:00.365 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:02:30.433 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:02:30.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:03:00.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:03:00.509 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:03:30.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:03:30.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:04:00.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:04:00.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:04:30.731 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:04:30.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:05:00.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:05:00.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:05:30.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:05:30.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:06:00.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:06:00.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:06:31.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:06:31.021 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:07:01.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:07:01.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:07:31.151 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:07:31.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:08:01.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:08:01.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:08:31.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:08:31.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:09:01.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:09:01.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:09:31.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:09:31.427 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:10:01.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:10:01.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:10:31.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:10:31.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:11:01.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:11:01.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:11:31.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:11:31.723 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:12:01.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:12:01.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:12:31.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:12:31.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:13:01.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:13:01.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:13:32.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:13:32.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:14:02.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:14:02.087 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:14:32.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:14:32.159 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:15:02.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:15:02.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:15:32.297 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:15:32.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:16:02.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:16:02.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:16:32.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:16:32.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:17:02.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:17:02.618 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:17:32.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:17:32.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:18:02.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:18:02.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:18:32.822 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:18:32.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:19:02.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:19:02.899 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:19:32.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:19:32.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:20:03.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:20:03.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:20:33.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:20:33.271 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:21:03.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:21:03.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:21:33.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:21:33.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:22:03.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:22:03.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:22:33.567 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:22:33.570 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:23:03.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:23:03.675 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:23:33.728 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:23:33.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:24:03.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:24:03.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:24:33.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:24:33.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:25:03.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:25:03.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:25:34.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:25:34.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:26:04.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:26:04.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:26:34.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:26:34.172 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:27:04.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:27:04.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:27:34.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:27:34.308 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:28:04.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:28:04.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:28:34.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:28:34.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:29:04.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:29:04.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:29:34.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:29:34.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:30:04.815 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:30:04.818 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:30:34.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:30:34.911 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:31:04.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:31:04.987 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:31:35.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:31:35.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:32:05.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:32:05.133 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:32:35.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:32:35.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:33:05.271 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:33:05.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:33:35.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:33:35.338 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:34:05.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:34:05.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:34:35.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:34:35.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:35:05.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:35:05.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:35:35.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:35:35.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:36:05.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:36:05.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:36:35.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:36:35.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:37:05.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:37:05.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:37:36.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:37:36.065 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:38:06.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:38:06.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:38:36.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:38:36.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:39:06.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:39:06.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:39:36.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:39:36.383 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:40:06.458 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:40:06.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:40:36.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:40:36.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:41:06.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:41:06.631 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:41:36.708 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:41:36.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:42:06.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:42:06.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:42:36.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:42:36.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:43:06.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:43:06.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:43:36.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:43:36.976 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:44:07.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:44:07.048 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:44:37.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:44:37.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:45:07.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:45:07.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:45:37.257 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:45:37.261 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:46:07.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:46:07.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:46:37.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:46:37.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:47:07.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:47:07.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:47:37.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:47:37.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:48:07.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:48:07.616 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:48:37.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:48:37.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:49:07.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:49:07.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:49:37.818 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:49:37.822 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:50:07.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:50:07.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:50:37.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:50:37.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:51:08.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:51:08.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:51:38.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:51:38.214 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:52:08.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:52:08.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:52:38.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:52:38.349 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:53:08.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:53:08.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:53:38.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:53:38.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:54:08.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:54:08.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:54:38.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:54:38.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:55:08.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:55:08.776 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:55:38.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:55:38.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:56:08.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:56:08.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:56:38.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:56:38.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:57:09.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:57:09.065 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:57:39.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:57:39.129 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:58:09.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:58:09.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:58:39.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:58:39.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:59:09.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:59:09.349 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:59:39.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T10:59:39.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:00:09.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:00:09.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:00:39.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:00:39.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:01:09.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:01:09.617 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:01:39.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:01:39.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:02:09.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:02:09.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:02:39.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:02:39.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:03:09.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:03:09.897 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:03:39.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:03:39.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:04:10.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:04:10.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:04:40.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:04:40.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:05:10.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:05:10.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:05:40.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:05:40.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:06:10.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:06:10.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:06:40.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:06:40.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:07:10.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:07:10.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:07:40.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:07:40.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:08:10.586 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:08:10.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:08:40.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:08:40.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:09:10.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:09:10.720 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:09:40.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:09:40.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:10:10.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:10:10.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:10:40.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:10:40.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:11:11.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:11:11.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:11:41.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:11:41.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:12:11.257 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:12:11.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:12:41.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:12:41.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:13:11.414 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:13:11.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:13:41.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:13:41.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:14:11.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:14:11.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:14:41.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:14:41.616 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:15:11.708 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:15:11.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:15:41.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:15:41.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:16:11.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:16:11.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:16:41.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:16:41.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:17:12.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:17:12.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:17:42.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:17:42.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:18:12.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:18:12.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:18:42.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:18:42.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:19:12.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:19:12.304 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:19:42.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:19:42.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:20:12.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:20:12.459 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:20:42.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:20:42.520 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:21:12.586 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:21:12.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:21:42.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:21:42.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:22:12.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:22:12.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:22:42.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:22:42.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:23:12.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:23:12.883 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:23:42.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:23:42.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:24:13.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:24:13.035 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:24:43.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:24:43.105 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:25:13.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:25:13.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:25:43.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:25:43.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:26:13.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:26:13.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:26:43.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:26:43.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:27:13.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:27:13.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:27:43.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:27:43.598 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:28:13.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:28:13.696 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:28:43.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:28:43.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:29:13.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:29:13.828 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:29:43.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:29:43.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:30:13.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:30:13.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:30:44.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:30:44.052 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:31:14.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:31:14.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:31:44.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:31:44.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:32:14.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:32:14.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:32:44.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:32:44.350 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:33:14.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:33:14.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:33:44.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:33:44.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:34:14.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:34:14.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:34:44.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:34:44.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:35:14.812 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:35:14.816 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:35:44.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:35:44.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:36:14.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:36:14.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:36:45.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:36:45.007 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:37:15.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:37:15.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:37:45.132 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:37:45.136 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:38:15.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:38:15.214 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:38:45.274 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:38:45.278 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:39:15.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:39:15.356 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:39:45.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:39:45.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:40:15.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:40:15.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:40:45.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:40:45.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:41:15.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:41:15.642 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:41:45.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:41:45.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:42:15.779 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:42:15.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:42:45.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:42:45.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:43:15.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:43:15.918 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:43:45.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:43:45.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:44:16.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:44:16.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:44:46.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:44:46.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:45:16.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:45:16.203 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:45:46.261 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:45:46.264 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:46:16.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:46:16.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:46:46.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:46:46.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:47:16.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:47:16.496 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:47:46.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:47:46.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:48:16.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:48:16.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:48:46.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:48:46.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:49:16.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:49:16.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:49:46.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:49:46.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:50:16.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:50:16.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:50:46.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:50:47.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:51:17.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:51:17.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:51:47.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:51:47.152 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:52:17.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:52:17.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:52:47.317 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:52:47.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:53:17.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:53:17.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:53:47.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:53:47.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:54:17.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:54:17.527 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:54:47.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:54:47.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:55:17.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:55:17.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:55:47.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:55:47.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:56:17.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:56:17.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:56:47.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:56:47.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:57:17.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:57:17.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:57:47.995 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:57:47.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:58:18.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:58:18.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:58:48.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:58:48.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:59:18.217 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:59:18.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:59:48.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T11:59:48.282 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:00:18.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:00:18.361 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:00:48.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:00:48.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:01:18.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:01:18.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:01:48.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:01:48.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:02:18.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:02:18.664 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:02:48.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:02:48.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:03:18.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:03:18.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:03:48.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:03:48.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:04:18.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:04:18.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:04:49.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:04:49.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:05:19.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:05:19.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:05:49.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:05:49.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:06:19.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:06:19.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:06:49.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:06:49.335 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:07:19.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:07:19.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:07:49.487 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:07:49.491 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:08:19.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:08:19.584 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:08:49.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:08:49.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:09:19.710 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:09:19.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:09:49.788 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:09:49.791 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:10:19.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:10:19.856 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:10:49.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:10:49.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:11:20.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:11:20.010 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:11:50.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:11:50.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:12:20.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:12:20.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:12:50.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:12:50.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:13:20.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:13:20.299 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:13:50.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:13:50.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:14:20.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:14:20.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:14:50.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:14:50.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:20.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:20.588 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:50.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:50.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:20.729 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:20.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:50.786 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:50.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:20.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:20.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:50.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:50.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:21.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:21.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:51.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:51.203 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:21.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:21.278 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:51.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:51.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:21.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:21.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:51.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:51.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:21:21.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:21:21.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:21:51.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:21:51.620 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:22:21.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:22:21.689 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:22:51.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:22:51.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:23:21.827 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:23:21.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:23:51.913 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:23:51.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:24:21.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:24:21.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:24:52.050 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:24:52.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:25:22.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:25:22.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:25:52.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:25:52.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:26:09.340 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-02-17T12:26:09.341 DEBUG:teuthology.task.console_log:Killing console logger for smithi032 2024-02-17T12:26:09.341 DEBUG:teuthology.task.console_log:Killing console logger for smithi039 2024-02-17T12:26:09.342 DEBUG:teuthology.exit:Finished running handlers